crmd[12192]: 2007/09/20_14:30:22 info: handle_shutdown_request: Creating shutdown request for host-2.awale.qc.ca cibmon[12186]: 2007/09/20_14:30:22 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[12199]: 2007/09/20_14:30:22 info: extract_event: Aborting on shutdown attribute for 77c6bcf6-f1e9-4e62-a33e-6ddd3530b92e tengine[12199]: 2007/09/20_14:30:22 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[12186]: 2007/09/20_14:30:22 info: log_cib_diff: cib_update: Diff: --- 0.1.25 crmd[12192]: 2007/09/20_14:30:22 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] cibmon[12186]: 2007/09/20_14:30:22 info: log_cib_diff: cib_update: Diff: +++ 0.1.26 crmd[12192]: 2007/09/20_14:30:22 info: do_state_transition: All 2 cluster nodes are eligible to run resources. cibmon[12186]: 2007/09/20_14:30:22 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:22 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:22 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:22 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:22 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:22 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:22 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:22 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:22 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:22 info: log_data_element: cib_update: + pengine[12200]: 2007/09/20_14:30:22 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[12200]: 2007/09/20_14:30:22 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[12200]: 2007/09/20_14:30:22 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[12200]: 2007/09/20_14:30:22 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[12200]: 2007/09/20_14:30:22 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[12200]: 2007/09/20_14:30:22 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[12200]: 2007/09/20_14:30:22 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[12200]: 2007/09/20_14:30:22 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[12200]: 2007/09/20_14:30:22 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[12200]: 2007/09/20_14:30:22 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[12200]: 2007/09/20_14:30:22 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[12200]: 2007/09/20_14:30:22 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[12200]: 2007/09/20_14:30:22 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[12200]: 2007/09/20_14:30:22 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[12200]: 2007/09/20_14:30:22 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[12200]: 2007/09/20_14:30:22 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[12200]: 2007/09/20_14:30:22 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[12200]: 2007/09/20_14:30:22 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:22 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:22 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:22 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:22 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:22 WARN: process_orphan_resource: Nothing known about resource vmstat-mon running on host-1.awale.qc.ca pengine[12200]: 2007/09/20_14:30:22 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:22 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:22 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:22 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:22 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:22 info: process_orphan_resource: Making sure orphan vmstat-mon is stopped pengine[12200]: 2007/09/20_14:30:22 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:22 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:22 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:22 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:22 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:22 WARN: process_orphan_resource: Nothing known about resource child_DoFencing:0 running on host-1.awale.qc.ca pengine[12200]: 2007/09/20_14:30:22 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:22 info: log_data_element: create_fake_resource: Orphan resource crmd[12192]: 2007/09/20_14:30:22 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[12200]: 2007/09/20_14:30:22 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:22 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:22 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:22 info: process_orphan_resource: Making sure orphan child_DoFencing:0 is stopped pengine[12200]: 2007/09/20_14:30:22 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:22 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:22 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:22 WARN: process_orphan_resource: Nothing known about resource child_DoFencing:1 running on host-1.awale.qc.ca tengine[12199]: 2007/09/20_14:30:22 info: unpack_graph: Unpacked transition 41: 11 actions in 11 synapses pengine[12200]: 2007/09/20_14:30:22 info: log_data_element: create_fake_resource: Orphan resource tengine[12199]: 2007/09/20_14:30:22 info: te_pseudo_action: Pseudo action 17 fired and confirmed pengine[12200]: 2007/09/20_14:30:22 info: log_data_element: create_fake_resource: Orphan resource tengine[12199]: 2007/09/20_14:30:22 info: send_rsc_command: Initiating action 57: share-drbd_0:0_pre_notify_stop_0 on host-2.awale.qc.ca pengine[12200]: 2007/09/20_14:30:22 info: log_data_element: create_fake_resource: Orphan resource tengine[12199]: 2007/09/20_14:30:22 info: send_rsc_command: Initiating action 62: share-drbd_0:1_pre_notify_stop_0 on host-1.awale.qc.ca pengine[12200]: 2007/09/20_14:30:22 info: process_orphan_resource: Making sure orphan child_DoFencing:1 is stopped pengine[12200]: 2007/09/20_14:30:22 WARN: unpack_rsc_op: Processing failed op (share-FS_start_0) on host-1.awale.qc.ca pengine[12200]: 2007/09/20_14:30:22 WARN: unpack_rsc_op: Handling failed start for share-FS on host-1.awale.qc.ca pengine[12200]: 2007/09/20_14:30:22 info: determine_online_status: Node host-2.awale.qc.ca is shutting down pengine[12200]: 2007/09/20_14:30:22 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:22 info: unpack_find_resource: Making sure orphan share-drbd_0:1/share-drbd_0:2 is stopped on host-2.awale.qc.ca pengine[12200]: 2007/09/20_14:30:22 info: unpack_find_resource: Internally renamed share-drbd_0:1 on host-2.awale.qc.ca to share-drbd_0:2 pengine[12200]: 2007/09/20_14:30:22 WARN: unpack_rsc_op: Processing failed op (share-FS_start_0) on host-2.awale.qc.ca pengine[12200]: 2007/09/20_14:30:22 WARN: unpack_rsc_op: Handling failed start for share-FS on host-2.awale.qc.ca pengine[12200]: 2007/09/20_14:30:22 info: clone_print: Master/Slave Set: ms-drbd_0 pengine[12200]: 2007/09/20_14:30:22 info: native_print: share-drbd_0:0 (heartbeat::ocf:drbd): Slave host-2.awale.qc.ca pengine[12200]: 2007/09/20_14:30:22 info: native_print: share-drbd_0:1 (heartbeat::ocf:drbd): Started host-1.awale.qc.ca pengine[12200]: 2007/09/20_14:30:22 info: group_print: Resource Group: DW pengine[12200]: 2007/09/20_14:30:22 info: native_print: msg_first (heartbeat:msg): Stopped pengine[12200]: 2007/09/20_14:30:22 info: native_print: share-FS (heartbeat::ocf:Filesystem): Stopped pengine[12200]: 2007/09/20_14:30:22 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Stopped pengine[12200]: 2007/09/20_14:30:22 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Stopped pengine[12200]: 2007/09/20_14:30:22 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[12200]: 2007/09/20_14:30:22 info: native_print: dw-httpd (heartbeat:daemontools): Stopped pengine[12200]: 2007/09/20_14:30:22 info: native_print: msg_last (heartbeat:msg): Stopped pengine[12200]: 2007/09/20_14:30:22 WARN: native_color: Resource msg_first cannot run anywhere pengine[12200]: 2007/09/20_14:30:22 info: master_color: Promoted 0 instances of a possible 1 to master pengine[12200]: 2007/09/20_14:30:22 WARN: native_color: Resource share-FS cannot run anywhere crmd[12192]: 2007/09/20_14:30:23 info: do_lrm_rsc_op: Performing op=share-drbd_0:1_notify_0 key=62:41:49d75c42-75a0-4bf8-ad1c-7b1910776561) pengine[12200]: 2007/09/20_14:30:22 WARN: native_color: Resource share-drbdlinks cannot run anywhere pengine[12200]: 2007/09/20_14:30:22 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere pengine[12200]: 2007/09/20_14:30:22 WARN: native_color: Resource mysql cannot run anywhere pengine[12200]: 2007/09/20_14:30:22 WARN: native_color: Resource dw-httpd cannot run anywhere pengine[12200]: 2007/09/20_14:30:22 WARN: native_color: Resource msg_last cannot run anywhere pengine[12200]: 2007/09/20_14:30:22 WARN: native_color: Resource share-drbd_0:0 cannot run anywhere pengine[12200]: 2007/09/20_14:30:22 info: master_color: Promoted 0 instances of a possible 1 to master pengine[12200]: 2007/09/20_14:30:22 notice: StopRsc: host-2.awale.qc.ca Stop share-drbd_0:0 pengine[12200]: 2007/09/20_14:30:22 notice: NoRoleChange: Leave resource share-drbd_0:1 (host-1.awale.qc.ca) pengine[12200]: 2007/09/20_14:30:22 notice: StopRsc: host-2.awale.qc.ca Stop share-drbd_0:0 pengine[12200]: 2007/09/20_14:30:22 notice: NoRoleChange: Leave resource share-drbd_0:1 (host-1.awale.qc.ca) pengine[12200]: 2007/09/20_14:30:22 info: native_color: Stopping orphan resource vmstat-mon pengine[12200]: 2007/09/20_14:30:22 info: native_color: Stopping orphan resource child_DoFencing:0 pengine[12200]: 2007/09/20_14:30:22 info: native_color: Stopping orphan resource child_DoFencing:1 pengine[12200]: 2007/09/20_14:30:22 info: native_color: Stopping orphan resource share-drbd_0:2 pengine[12200]: 2007/09/20_14:30:22 info: stage6: Scheduling Node host-2.awale.qc.ca for shutdown pengine[12200]: 2007/09/20_14:30:22 WARN: process_pe_message: Transition 41: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-432.bz2 pengine[12200]: 2007/09/20_14:30:22 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. lrmd[12189]: 2007/09/20_14:30:23 info: RA output: (share-drbd_0:1:notify:stdout) r0: ACTION=notify drbd[15739][15750]: 2007/09/20_14:30:23 DEBUG: r0 notify: pre for stop - counts: active 0 - starting 0 - stopping 1 crmd[12192]: 2007/09/20_14:30:23 info: process_lrm_event: LRM operation share-drbd_0:1_notify_0 (call=86, rc=0) complete cibmon[12186]: 2007/09/20_14:30:23 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[12199]: 2007/09/20_14:30:23 info: match_graph_event: Action share-drbd_0:1_pre_notify_stop_0 (62) confirmed on host-1.awale.qc.ca cibmon[12186]: 2007/09/20_14:30:23 info: log_cib_diff: cib_update: Diff: --- 0.1.26 cibmon[12186]: 2007/09/20_14:30:23 info: log_cib_diff: cib_update: Diff: +++ 0.1.27 cibmon[12186]: 2007/09/20_14:30:23 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:23 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:23 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:23 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:23 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:23 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:23 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:23 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:23 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:23 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:23 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:23 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:24 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[12199]: 2007/09/20_14:30:24 info: match_graph_event: Action share-drbd_0:0_pre_notify_stop_0 (57) confirmed on host-2.awale.qc.ca cibmon[12186]: 2007/09/20_14:30:24 info: log_cib_diff: cib_update: Diff: --- 0.1.27 tengine[12199]: 2007/09/20_14:30:24 info: te_pseudo_action: Pseudo action 18 fired and confirmed cibmon[12186]: 2007/09/20_14:30:24 info: log_cib_diff: cib_update: Diff: +++ 0.1.28 tengine[12199]: 2007/09/20_14:30:24 info: te_pseudo_action: Pseudo action 15 fired and confirmed cibmon[12186]: 2007/09/20_14:30:24 info: log_data_element: cib_update: - tengine[12199]: 2007/09/20_14:30:24 info: send_rsc_command: Initiating action 6: share-drbd_0:0_stop_0 on host-2.awale.qc.ca cibmon[12186]: 2007/09/20_14:30:24 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:24 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:24 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:24 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:24 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:24 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:24 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:24 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:24 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:24 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:24 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:25 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[12186]: 2007/09/20_14:30:25 info: log_cib_diff: cib_delete: Diff: --- 0.1.28 cibmon[12186]: 2007/09/20_14:30:25 info: log_cib_diff: cib_delete: Diff: +++ 0.1.29 cibmon[12186]: 2007/09/20_14:30:25 info: log_data_element: cib_delete: - cibmon[12186]: 2007/09/20_14:30:25 info: log_data_element: cib_delete: - cibmon[12186]: 2007/09/20_14:30:25 info: log_data_element: cib_delete: - cibmon[12186]: 2007/09/20_14:30:25 info: log_data_element: cib_delete: - cibmon[12186]: 2007/09/20_14:30:25 info: log_data_element: cib_delete: - cibmon[12186]: 2007/09/20_14:30:25 info: log_data_element: cib_delete: - cibmon[12186]: 2007/09/20_14:30:25 info: log_data_element: cib_delete: - cibmon[12186]: 2007/09/20_14:30:25 info: log_data_element: cib_delete: - cibmon[12186]: 2007/09/20_14:30:25 info: log_data_element: cib_delete: - cibmon[12186]: 2007/09/20_14:30:25 info: log_data_element: cib_delete: - cibmon[12186]: 2007/09/20_14:30:25 info: log_data_element: cib_delete: - cibmon[12186]: 2007/09/20_14:30:25 info: log_data_element: cib_delete: + cibmon[12186]: 2007/09/20_14:30:25 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[12186]: 2007/09/20_14:30:25 info: log_cib_diff: cib_delete: Diff: --- 0.1.29 cibmon[12186]: 2007/09/20_14:30:25 info: log_cib_diff: cib_delete: Diff: +++ 0.1.30 cibmon[12186]: 2007/09/20_14:30:25 info: log_data_element: cib_delete: - cibmon[12186]: 2007/09/20_14:30:25 info: log_data_element: cib_delete: + cibmon[12186]: 2007/09/20_14:30:26 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[12186]: 2007/09/20_14:30:26 info: log_cib_diff: cib_update: Diff: --- 0.1.30 tengine[12199]: 2007/09/20_14:30:26 info: match_graph_event: Action share-drbd_0:0_stop_0 (6) confirmed on host-2.awale.qc.ca cibmon[12186]: 2007/09/20_14:30:26 info: log_cib_diff: cib_update: Diff: +++ 0.1.31 tengine[12199]: 2007/09/20_14:30:26 info: te_pseudo_action: Pseudo action 16 fired and confirmed cibmon[12186]: 2007/09/20_14:30:26 info: log_data_element: cib_update: - tengine[12199]: 2007/09/20_14:30:26 info: te_pseudo_action: Pseudo action 19 fired and confirmed cibmon[12186]: 2007/09/20_14:30:26 info: log_data_element: cib_update: - tengine[12199]: 2007/09/20_14:30:26 info: te_crm_command: Executing crm-event (37): do_shutdown on host-2.awale.qc.ca cibmon[12186]: 2007/09/20_14:30:26 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:26 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:26 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:26 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:26 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:26 info: log_data_element: cib_update: - crmd[12192]: 2007/09/20_14:30:26 info: do_lrm_rsc_op: Performing op=share-drbd_0:1_notify_0 key=63:41:49d75c42-75a0-4bf8-ad1c-7b1910776561) cibmon[12186]: 2007/09/20_14:30:26 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:26 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:26 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:26 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:26 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:26 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:26 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:26 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:26 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:26 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:26 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:26 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:26 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:26 info: log_data_element: cib_update: + lrmd[12189]: 2007/09/20_14:30:27 info: RA output: (share-drbd_0:1:notify:stdout) r0: ACTION=notify drbd[15752][15763]: 2007/09/20_14:30:27 DEBUG: r0 notify: post for stop - counts: active 0 - starting 0 - stopping 1 drbd[15752][15765]: 2007/09/20_14:30:27 DEBUG: r0: Calling drbdadm -c /etc/drbd.conf state r0 drbd[15752][15772]: 2007/09/20_14:30:27 DEBUG: r0: Exit code 0 drbd[15752][15773]: 2007/09/20_14:30:27 DEBUG: r0: Command output: Secondary/Unknown drbd[15752][15781]: 2007/09/20_14:30:27 DEBUG: r0: Calling drbdadm -c /etc/drbd.conf cstate r0 crmd[12192]: 2007/09/20_14:30:27 notice: crmd_client_status_callback: Status update: Client host-2.awale.qc.ca/crmd now has status [offline] cib[12188]: 2007/09/20_14:30:27 info: cib_process_shutdown_req: Shutdown REQ from host-2.awale.qc.ca cibmon[12186]: 2007/09/20_14:30:27 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[12186]: 2007/09/20_14:30:27 info: log_cib_diff: cib_update: Local-only Change: 0.1.31 cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_update: + drbd[15752][15794]: 2007/09/20_14:30:27 DEBUG: r0: Exit code 0 drbd[15752][15795]: 2007/09/20_14:30:27 DEBUG: r0: Command output: WFConnection drbd[15752][15796]: 2007/09/20_14:30:27 DEBUG: r0 status: Secondary/Unknown Secondary Unknown WFConnection drbd[15752][15797]: 2007/09/20_14:30:27 DEBUG: r0: Calling /usr/sbin/crm_master -v 10 -l reboot crm_master[15799]: 2007/09/20_14:30:27 info: Invoked: /usr/sbin/crm_master -v 10 -l reboot cibmon[12186]: 2007/09/20_14:30:27 info: cibmon_diff: [cib_diff_notify] cib_modify confirmed cibmon[12186]: 2007/09/20_14:30:27 info: log_cib_diff: cib_modify: Diff: --- 0.1.31 cibmon[12186]: 2007/09/20_14:30:27 info: log_cib_diff: cib_modify: Diff: +++ 0.1.32 tengine[12199]: 2007/09/20_14:30:27 info: extract_event: Aborting on transient_attributes changes for 1da8804b-8a93-4145-9d40-1133699fe377 cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_modify: - tengine[12199]: 2007/09/20_14:30:27 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_modify: - tengine[12199]: 2007/09/20_14:30:27 info: update_abort_priority: Abort action 0 superceeded by 2 cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_modify: - tengine[12199]: 2007/09/20_14:30:27 info: te_update_diff: Aborting on transient_attributes deletions cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_modify: - cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_modify: - cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_modify: - cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_modify: - cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_modify: - cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_modify: - cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_modify: - cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_modify: - cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_modify: - cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_modify: + cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_modify: + cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_modify: + cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_modify: + cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_modify: + cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_modify: + cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_modify: + cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_modify: + cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_modify: + cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_modify: + cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_modify: + cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_modify: + drbd[15752][15800]: 2007/09/20_14:30:27 DEBUG: r0: Exit code 0 drbd[15752][15801]: 2007/09/20_14:30:27 DEBUG: r0: Command output: crm_master[15799]: 2007/09/20_14:30:27 info: Invoked: /usr/sbin/crm_master -v 10 -l reboot lrmd[12189]: 2007/09/20_14:30:27 info: RA output: (share-drbd_0:1:notify:stdout) crm_master[15799]: 2007/09/20_14:30:27 info: Invoked: /usr/sbin/crm_master -v 10 -l reboot crmd[12192]: 2007/09/20_14:30:27 info: process_lrm_event: LRM operation share-drbd_0:1_notify_0 (call=87, rc=0) complete cibmon[12186]: 2007/09/20_14:30:27 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[12186]: 2007/09/20_14:30:27 info: log_cib_diff: cib_update: Diff: --- 0.1.32 cibmon[12186]: 2007/09/20_14:30:27 info: log_cib_diff: cib_update: Diff: +++ 0.1.33 tengine[12199]: 2007/09/20_14:30:27 info: match_graph_event: Action share-drbd_0:1_post_notify_stop_0 (63) confirmed on host-1.awale.qc.ca cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_update: - tengine[12199]: 2007/09/20_14:30:27 info: te_pseudo_action: Pseudo action 20 fired and confirmed cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:27 info: log_data_element: cib_update: + ccm[12187]: 2007/09/20_14:30:28 debug: quorum plugin: majority ccm[12187]: 2007/09/20_14:30:28 debug: cluster:linux-ha, member_count=1, member_quorum_votes=100 ccm[12187]: 2007/09/20_14:30:28 debug: total_node_count=2, total_quorum_votes=200 ccm[12187]: 2007/09/20_14:30:28 debug: quorum plugin: twonodes ccm[12187]: 2007/09/20_14:30:28 debug: cluster:linux-ha, member_count=1, member_quorum_votes=100 ccm[12187]: 2007/09/20_14:30:28 debug: total_node_count=2, total_quorum_votes=200 ccm[12187]: 2007/09/20_14:30:28 info: Break tie for 2 nodes cluster cib[12188]: 2007/09/20_14:30:28 info: cib_client_status_callback: Status update: Client host-2.awale.qc.ca/cib now has status [leave] crmd[12192]: 2007/09/20_14:30:28 info: mem_handle_event: Got an event OC_EV_MS_INVALID from ccm cib[12188]: 2007/09/20_14:30:28 info: mem_handle_event: Got an event OC_EV_MS_INVALID from ccm crmd[12192]: 2007/09/20_14:30:28 info: mem_handle_event: no mbr_track info cib[12188]: 2007/09/20_14:30:28 info: mem_handle_event: no mbr_track info crmd[12192]: 2007/09/20_14:30:28 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm cib[12188]: 2007/09/20_14:30:28 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm crmd[12192]: 2007/09/20_14:30:28 info: mem_handle_event: instance=3, nodes=1, new=0, lost=1, n_idx=0, new_idx=1, old_idx=3 cib[12188]: 2007/09/20_14:30:28 info: mem_handle_event: instance=3, nodes=1, new=0, lost=1, n_idx=0, new_idx=1, old_idx=3 crmd[12192]: 2007/09/20_14:30:28 info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=3) cib[12188]: 2007/09/20_14:30:28 info: cib_ccm_msg_callback: LOST: host-2.awale.qc.ca crmd[12192]: 2007/09/20_14:30:28 info: ccm_event_detail: NEW MEMBERSHIP: trans=3, nodes=1, new=0, lost=1 n_idx=0, new_idx=1, old_idx=3 cib[12188]: 2007/09/20_14:30:28 info: cib_ccm_msg_callback: PEER: host-1.awale.qc.ca crmd[12192]: 2007/09/20_14:30:28 info: ccm_event_detail: CURRENT: host-1.awale.qc.ca [nodeid=0, born=3] crmd[12192]: 2007/09/20_14:30:28 info: ccm_event_detail: LOST: host-2.awale.qc.ca [nodeid=1, born=2] cibmon[12186]: 2007/09/20_14:30:28 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[12186]: 2007/09/20_14:30:28 info: log_cib_diff: cib_update: Local-only Change: 0.1.33 cibmon[12186]: 2007/09/20_14:30:28 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:28 info: log_data_element: cib_update: - crmd[12192]: 2007/09/20_14:30:28 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[12199]: 2007/09/20_14:30:28 info: run_graph: Transition 41: (Complete=11, Pending=0, Fired=0, Skipped=0, Incomplete=0) cibmon[12186]: 2007/09/20_14:30:28 info: log_data_element: cib_update: - crmd[12192]: 2007/09/20_14:30:28 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[12186]: 2007/09/20_14:30:28 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:28 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:28 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:28 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:28 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:28 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:28 info: log_data_element: cib_update: + pengine[12200]: 2007/09/20_14:30:28 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[12200]: 2007/09/20_14:30:28 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[12200]: 2007/09/20_14:30:28 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[12200]: 2007/09/20_14:30:28 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[12200]: 2007/09/20_14:30:28 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[12200]: 2007/09/20_14:30:28 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[12200]: 2007/09/20_14:30:28 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[12200]: 2007/09/20_14:30:28 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[12200]: 2007/09/20_14:30:28 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[12200]: 2007/09/20_14:30:28 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[12200]: 2007/09/20_14:30:28 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' crmd[12192]: 2007/09/20_14:30:28 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[12200]: 2007/09/20_14:30:28 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' tengine[12199]: 2007/09/20_14:30:28 info: unpack_graph: Unpacked transition 42: 0 actions in 0 synapses pengine[12200]: 2007/09/20_14:30:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' tengine[12199]: 2007/09/20_14:30:28 info: run_graph: Transition 42: (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0) pengine[12200]: 2007/09/20_14:30:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' tengine[12199]: 2007/09/20_14:30:28 info: notify_crmd: Transition 42 status: te_complete - pengine[12200]: 2007/09/20_14:30:28 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[12200]: 2007/09/20_14:30:28 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[12200]: 2007/09/20_14:30:28 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[12200]: 2007/09/20_14:30:28 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:28 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:28 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:28 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:28 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:28 WARN: process_orphan_resource: Nothing known about resource vmstat-mon running on host-1.awale.qc.ca pengine[12200]: 2007/09/20_14:30:28 info: log_data_element: create_fake_resource: Orphan resource crmd[12192]: 2007/09/20_14:30:28 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[12200]: 2007/09/20_14:30:28 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:28 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:28 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:28 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:28 info: process_orphan_resource: Making sure orphan vmstat-mon is stopped pengine[12200]: 2007/09/20_14:30:28 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:28 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:28 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:28 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:28 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:28 WARN: process_orphan_resource: Nothing known about resource child_DoFencing:0 running on host-1.awale.qc.ca pengine[12200]: 2007/09/20_14:30:28 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:28 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:28 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:28 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:28 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:28 info: process_orphan_resource: Making sure orphan child_DoFencing:0 is stopped pengine[12200]: 2007/09/20_14:30:28 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:28 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:28 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:28 WARN: process_orphan_resource: Nothing known about resource child_DoFencing:1 running on host-1.awale.qc.ca pengine[12200]: 2007/09/20_14:30:28 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:28 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:28 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:28 info: process_orphan_resource: Making sure orphan child_DoFencing:1 is stopped pengine[12200]: 2007/09/20_14:30:28 WARN: unpack_rsc_op: Processing failed op (share-FS_start_0) on host-1.awale.qc.ca pengine[12200]: 2007/09/20_14:30:28 WARN: unpack_rsc_op: Handling failed start for share-FS on host-1.awale.qc.ca pengine[12200]: 2007/09/20_14:30:28 info: clone_print: Master/Slave Set: ms-drbd_0 pengine[12200]: 2007/09/20_14:30:28 info: native_print: share-drbd_0:0 (heartbeat::ocf:drbd): Stopped pengine[12200]: 2007/09/20_14:30:28 info: native_print: share-drbd_0:1 (heartbeat::ocf:drbd): Started host-1.awale.qc.ca pengine[12200]: 2007/09/20_14:30:28 info: group_print: Resource Group: DW pengine[12200]: 2007/09/20_14:30:28 info: native_print: msg_first (heartbeat:msg): Stopped pengine[12200]: 2007/09/20_14:30:28 info: native_print: share-FS (heartbeat::ocf:Filesystem): Stopped pengine[12200]: 2007/09/20_14:30:28 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Stopped pengine[12200]: 2007/09/20_14:30:28 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Stopped pengine[12200]: 2007/09/20_14:30:28 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[12200]: 2007/09/20_14:30:28 info: native_print: dw-httpd (heartbeat:daemontools): Stopped pengine[12200]: 2007/09/20_14:30:28 info: native_print: msg_last (heartbeat:msg): Stopped pengine[12200]: 2007/09/20_14:30:28 WARN: native_color: Resource msg_first cannot run anywhere pengine[12200]: 2007/09/20_14:30:28 info: master_color: Promoted 0 instances of a possible 1 to master pengine[12200]: 2007/09/20_14:30:28 WARN: native_color: Resource share-FS cannot run anywhere pengine[12200]: 2007/09/20_14:30:28 WARN: native_color: Resource share-drbdlinks cannot run anywhere pengine[12200]: 2007/09/20_14:30:28 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere pengine[12200]: 2007/09/20_14:30:28 WARN: native_color: Resource mysql cannot run anywhere pengine[12200]: 2007/09/20_14:30:28 WARN: native_color: Resource dw-httpd cannot run anywhere pengine[12200]: 2007/09/20_14:30:28 WARN: native_color: Resource msg_last cannot run anywhere pengine[12200]: 2007/09/20_14:30:28 WARN: native_color: Resource share-drbd_0:0 cannot run anywhere pengine[12200]: 2007/09/20_14:30:28 info: master_color: Promoted 0 instances of a possible 1 to master pengine[12200]: 2007/09/20_14:30:28 notice: NoRoleChange: Leave resource share-drbd_0:1 (host-1.awale.qc.ca) pengine[12200]: 2007/09/20_14:30:28 notice: NoRoleChange: Leave resource share-drbd_0:1 (host-1.awale.qc.ca) pengine[12200]: 2007/09/20_14:30:28 info: native_color: Stopping orphan resource vmstat-mon pengine[12200]: 2007/09/20_14:30:28 info: native_color: Stopping orphan resource child_DoFencing:0 pengine[12200]: 2007/09/20_14:30:28 info: native_color: Stopping orphan resource child_DoFencing:1 pengine[12200]: 2007/09/20_14:30:28 WARN: process_pe_message: Transition 42: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-433.bz2 pengine[12200]: 2007/09/20_14:30:28 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. heartbeat[11310]: 2007/09/20_14:30:36 WARN: node host-2.awale.qc.ca: is dead crmd[12192]: 2007/09/20_14:30:36 notice: crmd_ha_status_callback: Status update: Node host-2.awale.qc.ca now has status [dead] heartbeat[11310]: 2007/09/20_14:30:36 info: Link host-2.awale.qc.ca:eth0 dead. cibmon[12186]: 2007/09/20_14:30:36 info: cibmon_diff: [cib_diff_notify] cib_update confirmed tengine[12199]: 2007/09/20_14:30:36 info: te_update_diff: Aborting on transient_attributes deletions cibmon[12186]: 2007/09/20_14:30:36 info: log_cib_diff: cib_update: Local-only Change: 0.1.33 crmd[12192]: 2007/09/20_14:30:36 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] tengine[12199]: 2007/09/20_14:30:36 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[12186]: 2007/09/20_14:30:36 info: log_data_element: cib_update: - crmd[12192]: 2007/09/20_14:30:36 info: do_state_transition: All 1 cluster nodes are eligible to run resources. cibmon[12186]: 2007/09/20_14:30:36 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:36 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:36 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:36 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:36 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:36 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:36 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:36 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:36 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:36 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:36 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:36 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:36 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:36 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:36 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:36 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:36 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:36 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:36 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:36 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:36 info: log_data_element: cib_update: + pengine[12200]: 2007/09/20_14:30:36 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[12200]: 2007/09/20_14:30:36 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[12200]: 2007/09/20_14:30:36 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[12200]: 2007/09/20_14:30:36 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[12200]: 2007/09/20_14:30:36 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[12200]: 2007/09/20_14:30:36 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[12200]: 2007/09/20_14:30:36 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[12200]: 2007/09/20_14:30:36 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[12200]: 2007/09/20_14:30:36 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[12200]: 2007/09/20_14:30:36 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[12200]: 2007/09/20_14:30:36 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[12200]: 2007/09/20_14:30:36 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[12200]: 2007/09/20_14:30:36 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[12200]: 2007/09/20_14:30:36 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[12200]: 2007/09/20_14:30:36 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[12200]: 2007/09/20_14:30:36 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[12200]: 2007/09/20_14:30:36 info: determine_online_status: Node host-1.awale.qc.ca is online pengine[12200]: 2007/09/20_14:30:36 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:36 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:36 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:36 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:36 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:36 WARN: process_orphan_resource: Nothing known about resource vmstat-mon running on host-1.awale.qc.ca pengine[12200]: 2007/09/20_14:30:36 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:36 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:36 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:36 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:36 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:36 info: process_orphan_resource: Making sure orphan vmstat-mon is stopped pengine[12200]: 2007/09/20_14:30:36 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:36 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:36 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:36 info: log_data_element: process_orphan_resource: Orphan resource crmd[12192]: 2007/09/20_14:30:36 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[12200]: 2007/09/20_14:30:36 info: log_data_element: process_orphan_resource: Orphan resource tengine[12199]: 2007/09/20_14:30:36 info: unpack_graph: Unpacked transition 43: 0 actions in 0 synapses pengine[12200]: 2007/09/20_14:30:36 WARN: process_orphan_resource: Nothing known about resource child_DoFencing:0 running on host-1.awale.qc.ca crmd[12192]: 2007/09/20_14:30:36 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[12199]: 2007/09/20_14:30:36 info: run_graph: Transition 43: (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0) pengine[12200]: 2007/09/20_14:30:36 info: log_data_element: create_fake_resource: Orphan resource tengine[12199]: 2007/09/20_14:30:36 info: notify_crmd: Transition 43 status: te_complete - pengine[12200]: 2007/09/20_14:30:36 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:36 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:36 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:36 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:36 info: process_orphan_resource: Making sure orphan child_DoFencing:0 is stopped pengine[12200]: 2007/09/20_14:30:36 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:36 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:36 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:36 WARN: process_orphan_resource: Nothing known about resource child_DoFencing:1 running on host-1.awale.qc.ca pengine[12200]: 2007/09/20_14:30:36 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:36 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:36 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:36 info: process_orphan_resource: Making sure orphan child_DoFencing:1 is stopped pengine[12200]: 2007/09/20_14:30:36 WARN: unpack_rsc_op: Processing failed op (share-FS_start_0) on host-1.awale.qc.ca pengine[12200]: 2007/09/20_14:30:36 WARN: unpack_rsc_op: Handling failed start for share-FS on host-1.awale.qc.ca pengine[12200]: 2007/09/20_14:30:36 info: clone_print: Master/Slave Set: ms-drbd_0 pengine[12200]: 2007/09/20_14:30:36 info: native_print: share-drbd_0:0 (heartbeat::ocf:drbd): Stopped pengine[12200]: 2007/09/20_14:30:36 info: native_print: share-drbd_0:1 (heartbeat::ocf:drbd): Started host-1.awale.qc.ca pengine[12200]: 2007/09/20_14:30:36 info: group_print: Resource Group: DW pengine[12200]: 2007/09/20_14:30:36 info: native_print: msg_first (heartbeat:msg): Stopped pengine[12200]: 2007/09/20_14:30:36 info: native_print: share-FS (heartbeat::ocf:Filesystem): Stopped pengine[12200]: 2007/09/20_14:30:36 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Stopped pengine[12200]: 2007/09/20_14:30:36 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Stopped pengine[12200]: 2007/09/20_14:30:36 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[12200]: 2007/09/20_14:30:36 info: native_print: dw-httpd (heartbeat:daemontools): Stopped pengine[12200]: 2007/09/20_14:30:36 info: native_print: msg_last (heartbeat:msg): Stopped pengine[12200]: 2007/09/20_14:30:36 WARN: native_color: Resource msg_first cannot run anywhere pengine[12200]: 2007/09/20_14:30:36 info: master_color: Promoted 0 instances of a possible 1 to master pengine[12200]: 2007/09/20_14:30:36 WARN: native_color: Resource share-FS cannot run anywhere pengine[12200]: 2007/09/20_14:30:36 WARN: native_color: Resource share-drbdlinks cannot run anywhere pengine[12200]: 2007/09/20_14:30:36 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere pengine[12200]: 2007/09/20_14:30:36 WARN: native_color: Resource mysql cannot run anywhere pengine[12200]: 2007/09/20_14:30:36 WARN: native_color: Resource dw-httpd cannot run anywhere pengine[12200]: 2007/09/20_14:30:36 WARN: native_color: Resource msg_last cannot run anywhere pengine[12200]: 2007/09/20_14:30:36 WARN: native_color: Resource share-drbd_0:0 cannot run anywhere pengine[12200]: 2007/09/20_14:30:36 info: master_color: Promoted 0 instances of a possible 1 to master pengine[12200]: 2007/09/20_14:30:36 notice: NoRoleChange: Leave resource share-drbd_0:1 (host-1.awale.qc.ca) pengine[12200]: 2007/09/20_14:30:36 notice: NoRoleChange: Leave resource share-drbd_0:1 (host-1.awale.qc.ca) pengine[12200]: 2007/09/20_14:30:36 info: native_color: Stopping orphan resource vmstat-mon pengine[12200]: 2007/09/20_14:30:36 info: native_color: Stopping orphan resource child_DoFencing:0 pengine[12200]: 2007/09/20_14:30:36 info: native_color: Stopping orphan resource child_DoFencing:1 pengine[12200]: 2007/09/20_14:30:36 WARN: process_pe_message: Transition 43: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-434.bz2 pengine[12200]: 2007/09/20_14:30:36 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. heartbeat[11310]: 2007/09/20_14:30:56 info: killing /usr/lib/heartbeat/mgmtd -v process group 12193 with signal 15 mgmtd[12193]: 2007/09/20_14:30:56 info: mgmtd is shutting down mgmtd[12193]: 2007/09/20_14:30:56 debug: [mgmtd] stopped heartbeat[11310]: 2007/09/20_14:30:56 info: killing /usr/lib/heartbeat/crmd process group 12192 with signal 15 crmd[12192]: 2007/09/20_14:30:56 info: crm_shutdown: Requesting shutdown crmd[12192]: 2007/09/20_14:30:56 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_SHUTDOWN cause=C_SHUTDOWN origin=crm_shutdown ] crmd[12192]: 2007/09/20_14:30:56 info: do_state_transition: All 1 cluster nodes are eligible to run resources. crmd[12192]: 2007/09/20_14:30:56 info: do_shutdown_req: Sending shutdown request to DC: host-1.awale.qc.ca crmd[12192]: 2007/09/20_14:30:56 info: do_shutdown_req: Processing shutdown locally crmd[12192]: 2007/09/20_14:30:56 info: handle_shutdown_request: Creating shutdown request for host-1.awale.qc.ca cibmon[12186]: 2007/09/20_14:30:56 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[12186]: 2007/09/20_14:30:56 info: log_cib_diff: cib_update: Diff: --- 0.1.33 tengine[12199]: 2007/09/20_14:30:56 info: extract_event: Aborting on shutdown attribute for 1da8804b-8a93-4145-9d40-1133699fe377 cibmon[12186]: 2007/09/20_14:30:56 info: log_cib_diff: cib_update: Diff: +++ 0.1.34 tengine[12199]: 2007/09/20_14:30:56 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_update: + pengine[12200]: 2007/09/20_14:30:56 notice: cluster_option: Using default value 'stop' for cluster option 'no-quorum-policy' pengine[12200]: 2007/09/20_14:30:56 notice: cluster_option: Using default value 'true' for cluster option 'symmetric-cluster' pengine[12200]: 2007/09/20_14:30:56 notice: cluster_option: Using default value 'false' for cluster option 'stonith-enabled' pengine[12200]: 2007/09/20_14:30:56 notice: cluster_option: Using default value 'reboot' for cluster option 'stonith-action' pengine[12200]: 2007/09/20_14:30:56 notice: cluster_option: Using default value '0' for cluster option 'default-resource-stickiness' pengine[12200]: 2007/09/20_14:30:56 notice: cluster_option: Using default value '0' for cluster option 'default-resource-failure-stickiness' pengine[12200]: 2007/09/20_14:30:56 notice: cluster_option: Using default value 'true' for cluster option 'is-managed-default' pengine[12200]: 2007/09/20_14:30:56 notice: cluster_option: Using default value '60s' for cluster option 'cluster-delay' pengine[12200]: 2007/09/20_14:30:56 notice: cluster_option: Using default value '20s' for cluster option 'default-action-timeout' pengine[12200]: 2007/09/20_14:30:56 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-resources' pengine[12200]: 2007/09/20_14:30:56 notice: cluster_option: Using default value 'true' for cluster option 'stop-orphan-actions' pengine[12200]: 2007/09/20_14:30:56 notice: cluster_option: Using default value 'false' for cluster option 'remove-after-stop' pengine[12200]: 2007/09/20_14:30:56 notice: cluster_option: Using default value '-1' for cluster option 'pe-error-series-max' pengine[12200]: 2007/09/20_14:30:56 notice: cluster_option: Using default value '-1' for cluster option 'pe-warn-series-max' pengine[12200]: 2007/09/20_14:30:56 notice: cluster_option: Using default value '-1' for cluster option 'pe-input-series-max' pengine[12200]: 2007/09/20_14:30:56 notice: cluster_option: Using default value 'true' for cluster option 'startup-fencing' pengine[12200]: 2007/09/20_14:30:56 info: determine_online_status: Node host-1.awale.qc.ca is shutting down pengine[12200]: 2007/09/20_14:30:56 info: log_data_element: process_orphan_resource: Orphan resource crmd[12192]: 2007/09/20_14:30:56 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[12200]: 2007/09/20_14:30:56 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:56 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:56 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:56 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:56 WARN: process_orphan_resource: Nothing known about resource vmstat-mon running on host-1.awale.qc.ca pengine[12200]: 2007/09/20_14:30:56 info: log_data_element: create_fake_resource: Orphan resource tengine[12199]: 2007/09/20_14:30:56 info: unpack_graph: Unpacked transition 44: 9 actions in 9 synapses pengine[12200]: 2007/09/20_14:30:56 info: log_data_element: create_fake_resource: Orphan resource tengine[12199]: 2007/09/20_14:30:56 info: te_pseudo_action: Pseudo action 13 fired and confirmed pengine[12200]: 2007/09/20_14:30:56 info: log_data_element: create_fake_resource: Orphan resource tengine[12199]: 2007/09/20_14:30:56 info: send_rsc_command: Initiating action 55: share-drbd_0:1_pre_notify_stop_0 on host-1.awale.qc.ca pengine[12200]: 2007/09/20_14:30:56 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:56 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:56 info: process_orphan_resource: Making sure orphan vmstat-mon is stopped pengine[12200]: 2007/09/20_14:30:56 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:56 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:56 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:56 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:56 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:56 WARN: process_orphan_resource: Nothing known about resource child_DoFencing:0 running on host-1.awale.qc.ca pengine[12200]: 2007/09/20_14:30:56 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:56 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:56 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:56 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:56 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:56 info: process_orphan_resource: Making sure orphan child_DoFencing:0 is stopped pengine[12200]: 2007/09/20_14:30:56 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:56 info: log_data_element: process_orphan_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:56 info: log_data_element: process_orphan_resource: Orphan resource crmd[12192]: 2007/09/20_14:30:56 info: do_lrm_rsc_op: Performing op=share-drbd_0:1_notify_0 key=55:44:49d75c42-75a0-4bf8-ad1c-7b1910776561) pengine[12200]: 2007/09/20_14:30:56 WARN: process_orphan_resource: Nothing known about resource child_DoFencing:1 running on host-1.awale.qc.ca pengine[12200]: 2007/09/20_14:30:56 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:56 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:56 info: log_data_element: create_fake_resource: Orphan resource pengine[12200]: 2007/09/20_14:30:56 info: process_orphan_resource: Making sure orphan child_DoFencing:1 is stopped pengine[12200]: 2007/09/20_14:30:56 WARN: unpack_rsc_op: Processing failed op (share-FS_start_0) on host-1.awale.qc.ca pengine[12200]: 2007/09/20_14:30:56 WARN: unpack_rsc_op: Handling failed start for share-FS on host-1.awale.qc.ca pengine[12200]: 2007/09/20_14:30:56 info: clone_print: Master/Slave Set: ms-drbd_0 pengine[12200]: 2007/09/20_14:30:56 info: native_print: share-drbd_0:0 (heartbeat::ocf:drbd): Stopped pengine[12200]: 2007/09/20_14:30:56 info: native_print: share-drbd_0:1 (heartbeat::ocf:drbd): Started host-1.awale.qc.ca pengine[12200]: 2007/09/20_14:30:56 info: group_print: Resource Group: DW pengine[12200]: 2007/09/20_14:30:56 info: native_print: msg_first (heartbeat:msg): Stopped pengine[12200]: 2007/09/20_14:30:56 info: native_print: share-FS (heartbeat::ocf:Filesystem): Stopped pengine[12200]: 2007/09/20_14:30:56 info: native_print: share-drbdlinks (heartbeat:drbdlinks): Stopped pengine[12200]: 2007/09/20_14:30:56 info: native_print: IPaddr_10_0_0_59 (heartbeat::ocf:IPaddr): Stopped pengine[12200]: 2007/09/20_14:30:56 info: native_print: mysql (heartbeat::ocf:mysql): Stopped pengine[12200]: 2007/09/20_14:30:56 info: native_print: dw-httpd (heartbeat:daemontools): Stopped pengine[12200]: 2007/09/20_14:30:56 info: native_print: msg_last (heartbeat:msg): Stopped pengine[12200]: 2007/09/20_14:30:56 WARN: native_color: Resource msg_first cannot run anywhere pengine[12200]: 2007/09/20_14:30:56 info: master_color: Promoted 0 instances of a possible 1 to master pengine[12200]: 2007/09/20_14:30:56 WARN: native_color: Resource share-FS cannot run anywhere pengine[12200]: 2007/09/20_14:30:56 WARN: native_color: Resource share-drbdlinks cannot run anywhere pengine[12200]: 2007/09/20_14:30:56 WARN: native_color: Resource IPaddr_10_0_0_59 cannot run anywhere pengine[12200]: 2007/09/20_14:30:56 WARN: native_color: Resource mysql cannot run anywhere pengine[12200]: 2007/09/20_14:30:56 WARN: native_color: Resource dw-httpd cannot run anywhere pengine[12200]: 2007/09/20_14:30:56 WARN: native_color: Resource msg_last cannot run anywhere pengine[12200]: 2007/09/20_14:30:56 WARN: native_color: Resource share-drbd_0:1 cannot run anywhere pengine[12200]: 2007/09/20_14:30:56 WARN: native_color: Resource share-drbd_0:0 cannot run anywhere pengine[12200]: 2007/09/20_14:30:56 info: master_color: Promoted 0 instances of a possible 1 to master pengine[12200]: 2007/09/20_14:30:56 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd_0:1 pengine[12200]: 2007/09/20_14:30:56 notice: StopRsc: host-1.awale.qc.ca Stop share-drbd_0:1 pengine[12200]: 2007/09/20_14:30:56 info: native_color: Stopping orphan resource vmstat-mon pengine[12200]: 2007/09/20_14:30:56 info: native_color: Stopping orphan resource child_DoFencing:0 pengine[12200]: 2007/09/20_14:30:56 info: native_color: Stopping orphan resource child_DoFencing:1 pengine[12200]: 2007/09/20_14:30:56 info: stage6: Scheduling Node host-1.awale.qc.ca for shutdown pengine[12200]: 2007/09/20_14:30:56 WARN: process_pe_message: Transition 44: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-435.bz2 pengine[12200]: 2007/09/20_14:30:56 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. lrmd[12189]: 2007/09/20_14:30:56 info: RA output: (share-drbd_0:1:notify:stdout) r0: ACTION=notify drbd[15824][15835]: 2007/09/20_14:30:56 DEBUG: r0 notify: pre for stop - counts: active 0 - starting 0 - stopping 1 crmd[12192]: 2007/09/20_14:30:56 info: process_lrm_event: LRM operation share-drbd_0:1_notify_0 (call=88, rc=0) complete cibmon[12186]: 2007/09/20_14:30:56 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[12186]: 2007/09/20_14:30:56 info: log_cib_diff: cib_update: Diff: --- 0.1.34 cibmon[12186]: 2007/09/20_14:30:56 info: log_cib_diff: cib_update: Diff: +++ 0.1.35 cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_update: - tengine[12199]: 2007/09/20_14:30:56 info: match_graph_event: Action share-drbd_0:1_pre_notify_stop_0 (55) confirmed on host-1.awale.qc.ca cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_update: - tengine[12199]: 2007/09/20_14:30:56 info: te_pseudo_action: Pseudo action 14 fired and confirmed cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_update: - tengine[12199]: 2007/09/20_14:30:56 info: te_pseudo_action: Pseudo action 11 fired and confirmed cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_update: - tengine[12199]: 2007/09/20_14:30:56 info: send_rsc_command: Initiating action 4: share-drbd_0:1_stop_0 on host-1.awale.qc.ca cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_update: - crmd[12192]: 2007/09/20_14:30:56 info: do_lrm_rsc_op: Performing op=share-drbd_0:1_stop_0 key=4:44:49d75c42-75a0-4bf8-ad1c-7b1910776561) cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_update: + cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_update: + crmd[12192]: 2007/09/20_14:30:56 info: process_lrm_event: LRM operation share-drbd_0:1_monitor_120000 (call=77, rc=-2) Cancelled cibmon[12186]: 2007/09/20_14:30:56 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[12186]: 2007/09/20_14:30:56 info: log_cib_diff: cib_delete: Diff: --- 0.1.35 cibmon[12186]: 2007/09/20_14:30:56 info: log_cib_diff: cib_delete: Diff: +++ 0.1.36 cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_delete: - cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_delete: - cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_delete: - cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_delete: - cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_delete: - cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_delete: - cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_delete: - cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_delete: - cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_delete: - cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_delete: - cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_delete: - cibmon[12186]: 2007/09/20_14:30:56 info: log_data_element: cib_delete: + lrmd[12189]: 2007/09/20_14:30:56 info: RA output: (share-drbd_0:1:stop:stdout) r0: ACTION=stop drbd[15836][15848]: 2007/09/20_14:30:56 DEBUG: r0: Calling drbdadm -c /etc/drbd.conf state r0 drbd[15836][15855]: 2007/09/20_14:30:56 DEBUG: r0: Exit code 0 drbd[15836][15856]: 2007/09/20_14:30:56 DEBUG: r0: Command output: Secondary/Unknown drbd[15836][15864]: 2007/09/20_14:30:56 DEBUG: r0: Calling drbdadm -c /etc/drbd.conf cstate r0 drbd[15836][15877]: 2007/09/20_14:30:57 DEBUG: r0: Exit code 0 drbd[15836][15878]: 2007/09/20_14:30:57 DEBUG: r0: Command output: WFConnection drbd[15836][15879]: 2007/09/20_14:30:57 DEBUG: r0 status: Secondary/Unknown Secondary Unknown WFConnection drbd[15836][15880]: 2007/09/20_14:30:57 DEBUG: r0: Calling /usr/sbin/crm_master -D crm_master[15882]: 2007/09/20_14:30:57 info: Invoked: /usr/sbin/crm_master -D cibmon[12186]: 2007/09/20_14:30:57 info: cibmon_diff: [cib_diff_notify] cib_delete confirmed cibmon[12186]: 2007/09/20_14:30:57 info: log_cib_diff: cib_delete: Diff: --- 0.1.36 cibmon[12186]: 2007/09/20_14:30:57 info: log_cib_diff: cib_delete: Diff: +++ 0.1.37 cibmon[12186]: 2007/09/20_14:30:57 info: log_data_element: cib_delete: - cibmon[12186]: 2007/09/20_14:30:57 info: log_data_element: cib_delete: + drbd[15836][15883]: 2007/09/20_14:30:57 DEBUG: r0: Exit code 0 drbd[15836][15884]: 2007/09/20_14:30:57 DEBUG: r0: Command output: crm_master[15882]: 2007/09/20_14:30:57 info: Invoked: /usr/sbin/crm_master -D lrmd[12189]: 2007/09/20_14:30:57 info: RA output: (share-drbd_0:1:stop:stdout) crm_master[15882]: 2007/09/20_14:30:57 info: Invoked: /usr/sbin/crm_master -D drbd[15836][15885]: 2007/09/20_14:30:57 DEBUG: r0: Calling drbdadm -c /etc/drbd.conf down r0 drbd[15836][15893]: 2007/09/20_14:30:57 DEBUG: r0: Exit code 0 drbd[15836][15894]: 2007/09/20_14:30:57 DEBUG: r0: Command output: lrmd[12189]: 2007/09/20_14:30:57 info: RA output: (share-drbd_0:1:stop:stdout) drbd[15836][15895]: 2007/09/20_14:30:57 DEBUG: r0 stop: drbdadm down succeeded. drbd[15836][15897]: 2007/09/20_14:30:57 DEBUG: r0: Calling drbdadm -c /etc/drbd.conf state r0 drbd[15836][15904]: 2007/09/20_14:30:57 DEBUG: r0: Exit code 0 drbd[15836][15905]: 2007/09/20_14:30:57 DEBUG: r0: Command output: Not configured drbd[15836][15913]: 2007/09/20_14:30:57 DEBUG: r0: Calling drbdadm -c /etc/drbd.conf cstate r0 drbd[15836][15926]: 2007/09/20_14:30:57 DEBUG: r0: Exit code 0 drbd[15836][15927]: 2007/09/20_14:30:57 DEBUG: r0: Command output: Not configured drbd[15836][15928]: 2007/09/20_14:30:57 DEBUG: r0 status: Not configured Not configured Not configured Unconfigured crmd[12192]: 2007/09/20_14:30:57 info: process_lrm_event: LRM operation share-drbd_0:1_stop_0 (call=89, rc=0) complete cibmon[12186]: 2007/09/20_14:30:57 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[12186]: 2007/09/20_14:30:57 info: log_cib_diff: cib_update: Diff: --- 0.1.37 cibmon[12186]: 2007/09/20_14:30:57 info: log_cib_diff: cib_update: Diff: +++ 0.1.38 cibmon[12186]: 2007/09/20_14:30:57 info: log_data_element: cib_update: - cibmon[12186]: 2007/09/20_14:30:57 info: log_data_element: cib_update: - tengine[12199]: 2007/09/20_14:30:57 info: match_graph_event: Action share-drbd_0:1_stop_0 (4) confirmed on host-1.awale.qc.ca cibmon[12186]: 2007/09/20_14:30:57 info: log_data_element: cib_update: - tengine[12199]: 2007/09/20_14:30:57 info: te_pseudo_action: Pseudo action 12 fired and confirmed cibmon[12186]: 2007/09/20_14:30:57 info: log_data_element: cib_update: - tengine[12199]: 2007/09/20_14:30:57 info: te_pseudo_action: Pseudo action 15 fired and confirmed cibmon[12186]: 2007/09/20_14:30:57 info: log_data_element: cib_update: - tengine[12199]: 2007/09/20_14:30:57 info: te_pseudo_action: Pseudo action 16 fired and confirmed cibmon[12186]: 2007/09/20_14:30:57 info: log_data_element: cib_update: - crmd[12192]: 2007/09/20_14:30:57 info: do_dc_release: DC role released tengine[12199]: 2007/09/20_14:30:57 info: run_graph: Transition 44: (Complete=9, Pending=0, Fired=0, Skipped=0, Incomplete=0) cibmon[12186]: 2007/09/20_14:30:57 info: log_data_element: cib_update: - crmd[12192]: 2007/09/20_14:30:57 info: stop_subsystem: Sent -TERM to pengine: [12200] tengine[12199]: 2007/09/20_14:30:57 info: notify_crmd: Transition 44 status: te_complete - cibmon[12186]: 2007/09/20_14:30:57 info: log_data_element: cib_update: - crmd[12192]: 2007/09/20_14:30:57 info: stop_subsystem: Sent -TERM to tengine: [12199] tengine[12199]: 2007/09/20_14:30:57 info: update_abort_priority: Abort priority upgraded to 1000000 cibmon[12186]: 2007/09/20_14:30:57 info: log_data_element: cib_update: - crmd[12192]: 2007/09/20_14:30:57 info: do_shutdown: Terminating the pengine tengine[12199]: 2007/09/20_14:30:57 info: update_abort_priority: Abort action 2 superceeded by 3 cibmon[12186]: 2007/09/20_14:30:57 info: log_data_element: cib_update: - crmd[12192]: 2007/09/20_14:30:57 info: stop_subsystem: Sent -TERM to pengine: [12200] tengine[12199]: 2007/09/20_14:30:57 info: notify_crmd: Exiting after transition cibmon[12186]: 2007/09/20_14:30:57 info: log_data_element: cib_update: - crmd[12192]: 2007/09/20_14:30:57 info: do_shutdown: Terminating the tengine tengine[12199]: 2007/09/20_14:30:57 info: te_init: Exiting tengine cibmon[12186]: 2007/09/20_14:30:57 info: log_data_element: cib_update: + crmd[12192]: 2007/09/20_14:30:57 info: stop_subsystem: Sent -TERM to tengine: [12199] cibmon[12186]: 2007/09/20_14:30:57 info: log_data_element: cib_update: + crmd[12192]: 2007/09/20_14:30:57 info: do_shutdown: Waiting for subsystems to exit cibmon[12186]: 2007/09/20_14:30:57 info: log_data_element: cib_update: + crmd[12192]: 2007/09/20_14:30:57 WARN: register_fsa_input_adv: do_shutdown stalled the FSA with pending inputs cibmon[12186]: 2007/09/20_14:30:57 info: log_data_element: cib_update: + crmd[12192]: 2007/09/20_14:30:57 WARN: do_log: [[FSA]] Input I_TE_SUCCESS from route_message() received in state (S_STOPPING) cibmon[12186]: 2007/09/20_14:30:57 info: log_data_element: cib_update: + crmd[12192]: 2007/09/20_14:30:57 info: do_shutdown: Terminating the pengine cibmon[12186]: 2007/09/20_14:30:57 info: log_data_element: cib_update: + crmd[12192]: 2007/09/20_14:30:57 info: stop_subsystem: Sent -TERM to tengine: [12199] cibmon[12186]: 2007/09/20_14:30:57 info: log_data_element: cib_update: + crmd[12192]: 2007/09/20_14:30:57 info: do_shutdown: Waiting for subsystems to exit cibmon[12186]: 2007/09/20_14:30:57 info: log_data_element: cib_update: + crmd[12192]: 2007/09/20_14:30:57 WARN: register_fsa_input_adv: do_shutdown stalled the FSA with pending inputs cibmon[12186]: 2007/09/20_14:30:57 info: log_data_element: cib_update: + crmd[12192]: 2007/09/20_14:30:57 info: crmdManagedChildDied: Process tengine:[12199] exited (signal=0, exitcode=0) cibmon[12186]: 2007/09/20_14:30:57 info: log_data_element: cib_update: + crmd[12192]: 2007/09/20_14:30:57 info: crmdManagedChildDied: Process pengine:[12200] exited (signal=0, exitcode=0) cibmon[12186]: 2007/09/20_14:30:57 info: log_data_element: cib_update: + crmd[12192]: 2007/09/20_14:30:57 WARN: do_log: [[FSA]] Input I_RELEASE_SUCCESS from do_dc_release() received in state (S_STOPPING) crmd[12192]: 2007/09/20_14:30:57 info: do_state_transition: State transition S_STOPPING -> S_TERMINATE [ input=I_TERMINATE cause=C_FSA_INTERNAL origin=do_shutdown ] crmd[12192]: 2007/09/20_14:30:57 info: verify_stopped: Checking for active resources before exit ccm[12187]: 2007/09/20_14:30:57 info: client (pid=12192) removed from ccm crmd[12192]: 2007/09/20_14:30:57 info: verify_stopped: Checking for active resources before exit crmd[12192]: 2007/09/20_14:30:57 info: do_lrm_control: Disconnected from the LRM crmd[12192]: 2007/09/20_14:30:57 info: do_ha_control: Disconnected from Heartbeat crmd[12192]: 2007/09/20_14:30:57 info: do_cib_control: Disconnecting CIB cib[12188]: 2007/09/20_14:30:57 info: cib_process_readwrite: We are now in R/O mode crmd[12192]: 2007/09/20_14:30:57 info: crmd_cib_connection_destroy: Connection to the CIB terminated... crmd[12192]: 2007/09/20_14:30:57 info: do_exit: Performing A_EXIT_0 - gracefully exiting the CRMd crmd[12192]: 2007/09/20_14:30:57 info: free_mem: Dropping I_TERMINATE: [ state=S_TERMINATE cause=C_FSA_INTERNAL origin=verify_stopped ] crmd[12192]: 2007/09/20_14:30:57 info: free_mem: Dropping I_TERMINATE: [ state=S_TERMINATE cause=C_FSA_INTERNAL origin=verify_stopped ] crmd[12192]: 2007/09/20_14:30:57 info: do_exit: [crmd] stopped (0) heartbeat[11310]: 2007/09/20_14:30:57 info: killing /usr/lib/heartbeat/attrd process group 12191 with signal 15 attrd[12191]: 2007/09/20_14:30:57 info: attrd_shutdown: Exiting attrd[12191]: 2007/09/20_14:30:57 info: main: Exiting... heartbeat[11310]: 2007/09/20_14:30:57 info: killing /usr/lib/heartbeat/stonithd process group 12190 with signal 15 stonithd[12190]: 2007/09/20_14:30:57 notice: /usr/lib/heartbeat/stonithd normally quit. heartbeat[11310]: 2007/09/20_14:30:57 info: killing /usr/lib/heartbeat/lrmd -r process group 12189 with signal 15 lrmd[12189]: 2007/09/20_14:30:57 info: lrmd is shutting down heartbeat[11310]: 2007/09/20_14:30:57 info: killing /usr/lib/heartbeat/cib process group 12188 with signal 15 cibmon[12186]: 2007/09/20_14:30:57 info: cib_native_msgready: Lost connection to the CIB service [12188]. cib[12188]: 2007/09/20_14:30:57 WARN: disconnect_cib_client: Disconnecting cibmon/cib_callback... cibmon[12186]: 2007/09/20_14:30:57 CRIT: cib_native_dispatch: Lost connection to the CIB service [12188/callback]. cibmon[12186]: 2007/09/20_14:30:57 ERROR: cib_connection_destroy: Connection to the CIB terminated... exiting cib[12188]: 2007/09/20_14:30:57 WARN: disconnect_cib_client: Disconnecting /cib_ro... cib[12188]: 2007/09/20_14:30:57 info: cib_shutdown: Disconnected 2 clients cib[12188]: 2007/09/20_14:30:57 info: cib_process_disconnect: All clients disconnected... cib[12188]: 2007/09/20_14:30:57 info: terminate_ha_connection: initiate_exit: Disconnecting heartbeat cib[12188]: 2007/09/20_14:30:57 info: cib_ha_connection_destroy: Heartbeat disconnection complete... exiting cib[12188]: 2007/09/20_14:30:57 info: main: Done ccm[12187]: 2007/09/20_14:30:57 info: client (pid=12188) removed from ccm heartbeat[11310]: 2007/09/20_14:30:57 info: killing /usr/lib/heartbeat/ccm process group 12187 with signal 15 ccm[12187]: 2007/09/20_14:30:57 info: received SIGTERM, going to shut down heartbeat[11310]: 2007/09/20_14:30:57 info: client [/usr/lib/heartbeat/cibmon -d] is not running. heartbeat[11310]: 2007/09/20_14:30:58 info: killing HBFIFO process 12177 with signal 15 heartbeat[11310]: 2007/09/20_14:30:58 info: killing HBWRITE process 12178 with signal 15 heartbeat[11310]: 2007/09/20_14:30:58 info: killing HBREAD process 12179 with signal 15 heartbeat[11310]: 2007/09/20_14:30:58 info: killing HBWRITE process 12180 with signal 15 heartbeat[11310]: 2007/09/20_14:30:58 info: killing HBREAD process 12181 with signal 15 heartbeat[11310]: 2007/09/20_14:30:58 info: Core process 12178 exited. 5 remaining heartbeat[11310]: 2007/09/20_14:30:58 info: Core process 12177 exited. 4 remaining heartbeat[11310]: 2007/09/20_14:30:58 info: Core process 12179 exited. 3 remaining heartbeat[11310]: 2007/09/20_14:30:58 info: Core process 12180 exited. 2 remaining heartbeat[11310]: 2007/09/20_14:30:58 info: Core process 12181 exited. 1 remaining heartbeat[11310]: 2007/09/20_14:30:58 info: host-1.awale.qc.ca Heartbeat shutdown complete. logd[11288]: 2007/09/20_14:30:59 debug: logd_term_action: received SIGTERM logd[11288]: 2007/09/20_14:30:59 debug: logd_term_action: waiting for 0 messages to be read by write process logd[11288]: 2007/09/20_14:30:59 debug: logd_term_action: sending SIGTERM to write process logd[11291]: 2007/09/20_14:30:59 info: logd_term_write_action: received SIGTERM logd[11291]: 2007/09/20_14:30:59 debug: Writing out 0 messages then quitting logd[11291]: 2007/09/20_14:30:59 info: Exiting write process logd[15967]: 2007/09/20_14:54:25 info: logd started with /etc/logd.cf. logd[15971]: 2007/09/20_14:54:25 info: G_main_add_SignalHandler: Added signal handler for signal 15 logd[15967]: 2007/09/20_14:54:25 info: G_main_add_SignalHandler: Added signal handler for signal 15 heartbeat[15988]: 2007/09/20_14:54:25 info: No log entry found in ha.cf -- use logd heartbeat[15988]: 2007/09/20_14:54:25 info: Enabling logging daemon heartbeat[15988]: 2007/09/20_14:54:25 info: logfile and debug file are those specified in logd config file (default /etc/logd.cf) heartbeat[15988]: 2007/09/20_14:54:25 info: ************************** heartbeat[15988]: 2007/09/20_14:54:25 info: Configuration validated. Starting heartbeat 2.1.2 heartbeat[15989]: 2007/09/20_14:54:25 info: heartbeat: version 2.1.2 heartbeat[15989]: 2007/09/20_14:54:25 info: Heartbeat generation: 1188360883 heartbeat[15989]: 2007/09/20_14:54:25 info: G_main_add_TriggerHandler: Added signal manual handler heartbeat[15989]: 2007/09/20_14:54:25 info: G_main_add_TriggerHandler: Added signal manual handler heartbeat[15989]: 2007/09/20_14:54:25 info: Removing /var/run/heartbeat/rsctmp failed, recreating. heartbeat[15989]: 2007/09/20_14:54:25 info: glib: UDP Broadcast heartbeat started on port 694 (694) interface eth0 heartbeat[15989]: 2007/09/20_14:54:25 info: glib: UDP Broadcast heartbeat closed on port 694 interface eth0 - Status: 1 heartbeat[15989]: 2007/09/20_14:54:25 info: glib: ping group heartbeat started. heartbeat[15989]: 2007/09/20_14:54:25 info: G_main_add_SignalHandler: Added signal handler for signal 17 heartbeat[15989]: 2007/09/20_14:54:25 info: Local status now set to: 'up' heartbeat[15989]: 2007/09/20_14:54:27 info: Link local:local up. heartbeat[15989]: 2007/09/20_14:54:27 info: Status update for node local: status ping heartbeat[15989]: 2007/09/20_14:54:27 info: Link host-1.awale.qc.ca:eth0 up. heartbeat[15989]: 2007/09/20_14:54:32 info: Link host-2.awale.qc.ca:eth0 up. heartbeat[15989]: 2007/09/20_14:54:32 info: Status update for node host-2.awale.qc.ca: status up heartbeat[15989]: 2007/09/20_14:54:33 debug: get_delnodelist: delnodelist= heartbeat[15989]: 2007/09/20_14:54:33 info: Comm_now_up(): updating status to active heartbeat[15989]: 2007/09/20_14:54:33 info: Local status now set to: 'active' heartbeat[15989]: 2007/09/20_14:54:33 info: Starting child client "/usr/lib/heartbeat/cibmon -d" (90,90) heartbeat[15989]: 2007/09/20_14:54:33 info: Starting child client "/usr/lib/heartbeat/ccm" (90,90) heartbeat[15989]: 2007/09/20_14:54:33 info: Starting child client "/usr/lib/heartbeat/cib" (90,90) heartbeat[16000]: 2007/09/20_14:54:33 info: Starting "/usr/lib/heartbeat/cibmon -d" as uid 90 gid 90 (pid 16000) heartbeat[15989]: 2007/09/20_14:54:33 info: Starting child client "/usr/lib/heartbeat/lrmd -r" (0,0) heartbeat[15989]: 2007/09/20_14:54:33 info: Starting child client "/usr/lib/heartbeat/stonithd" (0,0) heartbeat[15989]: 2007/09/20_14:54:33 info: Starting child client "/usr/lib/heartbeat/attrd" (90,90) heartbeat[15989]: 2007/09/20_14:54:33 info: Starting child client "/usr/lib/heartbeat/crmd" (90,90) heartbeat[15989]: 2007/09/20_14:54:33 info: Starting child client "/usr/lib/heartbeat/mgmtd -v" (0,0) heartbeat[15989]: 2007/09/20_14:54:33 WARN: G_CH_dispatch_int: Dispatch function for read child took too long to execute: 90 ms (> 50 ms) (GSource: 0xa09e110) heartbeat[15989]: 2007/09/20_14:54:33 info: Status update for node host-2.awale.qc.ca: status active heartbeat[16001]: 2007/09/20_14:54:33 info: Starting "/usr/lib/heartbeat/ccm" as uid 90 gid 90 (pid 16001) heartbeat[16002]: 2007/09/20_14:54:33 info: Starting "/usr/lib/heartbeat/cib" as uid 90 gid 90 (pid 16002) heartbeat[16003]: 2007/09/20_14:54:33 info: Starting "/usr/lib/heartbeat/lrmd -r" as uid 0 gid 0 (pid 16003) cibmon[16000]: 2007/09/20_14:54:33 info: G_main_add_SignalHandler: Added signal handler for signal 15 heartbeat[16006]: 2007/09/20_14:54:33 info: Starting "/usr/lib/heartbeat/crmd" as uid 90 gid 90 (pid 16006) heartbeat[16004]: 2007/09/20_14:54:33 info: Starting "/usr/lib/heartbeat/stonithd" as uid 0 gid 0 (pid 16004) heartbeat[16005]: 2007/09/20_14:54:33 info: Starting "/usr/lib/heartbeat/attrd" as uid 90 gid 90 (pid 16005) heartbeat[16007]: 2007/09/20_14:54:33 info: Starting "/usr/lib/heartbeat/mgmtd -v" as uid 0 gid 0 (pid 16007) stonithd[16004]: 2007/09/20_14:54:33 info: G_main_add_SignalHandler: Added signal handler for signal 10 stonithd[16004]: 2007/09/20_14:54:33 info: G_main_add_SignalHandler: Added signal handler for signal 12 cib[16002]: 2007/09/20_14:54:33 info: G_main_add_SignalHandler: Added signal handler for signal 15 cib[16002]: 2007/09/20_14:54:33 info: G_main_add_TriggerHandler: Added signal manual handler cib[16002]: 2007/09/20_14:54:33 info: G_main_add_SignalHandler: Added signal handler for signal 17 cib[16002]: 2007/09/20_14:54:33 info: main: Retrieval of a per-action CIB: disabled cib[16002]: 2007/09/20_14:54:33 info: readCibXmlFile: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml lrmd[16003]: 2007/09/20_14:54:33 info: G_main_add_SignalHandler: Added signal handler for signal 15 lrmd[16003]: 2007/09/20_14:54:33 info: G_main_add_SignalHandler: Added signal handler for signal 17 lrmd[16003]: 2007/09/20_14:54:33 info: G_main_add_SignalHandler: Added signal handler for signal 10 lrmd[16003]: 2007/09/20_14:54:33 info: G_main_add_SignalHandler: Added signal handler for signal 12 lrmd[16003]: 2007/09/20_14:54:33 info: Started. cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: log_data_element: readCibXmlFile: [on-disk] cib[16002]: 2007/09/20_14:54:33 info: startCib: CIB Initialization completed successfully cib[16002]: 2007/09/20_14:54:33 info: cib_register_ha: Signing in with Heartbeat cib[16002]: 2007/09/20_14:54:33 info: cib_register_ha: FSA Hostname: host-1.awale.qc.ca cib[16002]: 2007/09/20_14:54:33 WARN: cib_init: CCM Activation failed cib[16002]: 2007/09/20_14:54:33 WARN: cib_init: CCM Connection failed 1 times (30 max) crmd[16006]: 2007/09/20_14:54:33 info: main: CRM Hg Version: 9a995a8a7052 tip crmd[16006]: 2007/09/20_14:54:33 info: crmd_init: Starting crmd crmd[16006]: 2007/09/20_14:54:33 info: G_main_add_SignalHandler: Added signal handler for signal 15 crmd[16006]: 2007/09/20_14:54:33 info: G_main_add_TriggerHandler: Added signal manual handler crmd[16006]: 2007/09/20_14:54:33 info: G_main_add_SignalHandler: Added signal handler for signal 17 attrd[16005]: 2007/09/20_14:54:33 info: G_main_add_SignalHandler: Added signal handler for signal 15 attrd[16005]: 2007/09/20_14:54:33 info: register_with_ha: Hostname: host-1.awale.qc.ca ccm[16001]: 2007/09/20_14:54:33 info: Hostname: host-1.awale.qc.ca attrd[16005]: 2007/09/20_14:54:34 info: register_with_ha: UUID: 1da8804b-8a93-4145-9d40-1133699fe377 stonithd[16004]: 2007/09/20_14:54:34 info: Signing in with heartbeat. mgmtd[16007]: 2007/09/20_14:54:34 info: G_main_add_SignalHandler: Added signal handler for signal 15 mgmtd[16007]: 2007/09/20_14:54:34 debug: Enabling coredumps mgmtd[16007]: 2007/09/20_14:54:34 info: G_main_add_SignalHandler: Added signal handler for signal 10 mgmtd[16007]: 2007/09/20_14:54:34 info: G_main_add_SignalHandler: Added signal handler for signal 12 stonithd[16004]: 2007/09/20_14:54:34 notice: /usr/lib/heartbeat/stonithd start up successfully. stonithd[16004]: 2007/09/20_14:54:34 info: G_main_add_SignalHandler: Added signal handler for signal 17 mgmtd[16007]: 2007/09/20_14:54:34 info: init_crm ccm[16001]: 2007/09/20_14:54:34 info: G_main_add_SignalHandler: Added signal handler for signal 15 heartbeat[15989]: 2007/09/20_14:54:35 WARN: 1 lost packet(s) for [host-2.awale.qc.ca] [14:16] heartbeat[15989]: 2007/09/20_14:54:35 info: No pkts missing from host-2.awale.qc.ca! cib[16002]: 2007/09/20_14:54:35 info: cib_init: Starting cib mainloop cibmon[16000]: 2007/09/20_14:54:35 info: main: Starting mainloop cib[16002]: 2007/09/20_14:54:35 info: cib_null_callback: Setting cib_diff_notify callbacks for cibmon: on crmd[16006]: 2007/09/20_14:54:35 info: do_cib_control: CIB connection established cib[16002]: 2007/09/20_14:54:35 info: cib_null_callback: Setting cib_refresh_notify callbacks for crmd: on cib[16002]: 2007/09/20_14:54:35 info: cib_null_callback: Setting cib_diff_notify callbacks for mgmtd: on cib[16002]: 2007/09/20_14:54:35 info: cib_client_status_callback: Status update: Client host-1.awale.qc.ca/cib now has status [join] crmd[16006]: 2007/09/20_14:54:35 info: register_with_ha: Hostname: host-1.awale.qc.ca cib[16002]: 2007/09/20_14:54:35 info: cib_client_status_callback: Status update: Client host-2.awale.qc.ca/cib now has status [join] cib[16002]: 2007/09/20_14:54:35 info: cib_client_status_callback: Status update: Client host-1.awale.qc.ca/cib now has status [online] cib[16008]: 2007/09/20_14:54:35 info: write_cib_contents: Wrote version 0.1.1 of the CIB to disk (digest: 9d9b4842b93c6c0bcda28a12cbd73081) cib[16002]: 2007/09/20_14:54:35 info: cib_client_status_callback: Status update: Client host-2.awale.qc.ca/cib now has status [online] crmd[16006]: 2007/09/20_14:54:35 info: register_with_ha: UUID: 1da8804b-8a93-4145-9d40-1133699fe377 mgmtd[16007]: 2007/09/20_14:54:36 debug: main: run the loop... mgmtd[16007]: 2007/09/20_14:54:36 info: Started. crmd[16006]: 2007/09/20_14:54:36 info: populate_cib_nodes: Requesting the list of configured nodes heartbeat[15989]: 2007/09/20_14:54:36 WARN: 1 lost packet(s) for [host-2.awale.qc.ca] [20:22] heartbeat[15989]: 2007/09/20_14:54:36 info: No pkts missing from host-2.awale.qc.ca! crmd[16006]: 2007/09/20_14:54:37 notice: populate_cib_nodes: Node: host-2.awale.qc.ca (uuid: 77c6bcf6-f1e9-4e62-a33e-6ddd3530b92e) crmd[16006]: 2007/09/20_14:54:37 notice: populate_cib_nodes: Node: host-1.awale.qc.ca (uuid: 1da8804b-8a93-4145-9d40-1133699fe377) crmd[16006]: 2007/09/20_14:54:37 info: do_ha_control: Connected to Heartbeat crmd[16006]: 2007/09/20_14:54:37 info: do_ccm_control: CCM connection established... waiting for first callback crmd[16006]: 2007/09/20_14:54:37 info: do_started: Delaying start, CCM (0000000000100000) not connected crmd[16006]: 2007/09/20_14:54:37 info: crmd_init: Starting crmd's mainloop crmd[16006]: 2007/09/20_14:54:37 notice: crmd_client_status_callback: Status update: Client host-1.awale.qc.ca/crmd now has status [online] crmd[16006]: 2007/09/20_14:54:37 notice: crmd_client_status_callback: Status update: Client host-1.awale.qc.ca/crmd now has status [online] cibmon[16000]: 2007/09/20_14:54:37 info: cibmon_diff: [cib_diff_notify] cib_update confirmed cibmon[16000]: 2007/09/20_14:54:38 info: log_cib_diff: cib_update: Local-only Change: 0.1.1 cibmon[16000]: 2007/09/20_14:54:38 info: log_data_element: cib_update: + cibmon[16000]: 2007/09/20_14:54:38 info: log_data_element: cib_update: + cibmon[16000]: 2007/09/20_14:54:38 info: log_data_element: cib_update: + cibmon[16000]: 2007/09/20_14:54:38 info: log_data_element: cib_update: + cibmon[16000]: 2007/09/20_14:54:38 info: log_data_element: cib_update: + cib[16002]: 2007/09/20_14:54:38 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm cib[16002]: 2007/09/20_14:54:38 info: mem_handle_event: instance=2, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4 crmd[16006]: 2007/09/20_14:54:38 notice: crmd_client_status_callback: Status update: Client host-2.awale.qc.ca/crmd now has status [online] cib[16002]: 2007/09/20_14:54:38 info: cib_ccm_msg_callback: PEER: host-2.awale.qc.ca cib[16002]: 2007/09/20_14:54:38 info: cib_ccm_msg_callback: PEER: host-1.awale.qc.ca crmd[16006]: 2007/09/20_14:54:38 info: do_started: Delaying start, CCM (0000000000100000) not connected crmd[16006]: 2007/09/20_14:54:38 notice: cluster_option: Using default value '10s' for cluster option 'dc_deadtime' crmd[16006]: 2007/09/20_14:54:38 notice: cluster_option: Using default value '0' for cluster option 'cluster_recheck_interval' crmd[16006]: 2007/09/20_14:54:38 notice: cluster_option: Using default value '2min' for cluster option 'election_timeout' crmd[16006]: 2007/09/20_14:54:38 notice: cluster_option: Using default value '20min' for cluster option 'shutdown_escalation' crmd[16006]: 2007/09/20_14:54:38 notice: cluster_option: Using default value '3min' for cluster option 'crmd-integration-timeout' cibmon[16000]: 2007/09/20_14:54:38 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[16006]: 2007/09/20_14:54:38 notice: cluster_option: Using default value '10min' for cluster option 'crmd-finalization-timeout' cibmon[16000]: 2007/09/20_14:54:38 info: log_cib_diff: cib_update: Local-only Change: 0.1.1 crmd[16006]: 2007/09/20_14:54:38 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm cibmon[16000]: 2007/09/20_14:54:38 info: log_data_element: cib_update: + crmd[16006]: 2007/09/20_14:54:38 info: mem_handle_event: instance=2, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4 cibmon[16000]: 2007/09/20_14:54:38 info: log_data_element: cib_update: + crmd[16006]: 2007/09/20_14:54:38 info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=2) cibmon[16000]: 2007/09/20_14:54:38 info: log_data_element: cib_update: + crmd[16006]: 2007/09/20_14:54:38 info: ccm_event_detail: NEW MEMBERSHIP: trans=2, nodes=2, new=2, lost=0 n_idx=0, new_idx=0, old_idx=4 cibmon[16000]: 2007/09/20_14:54:38 info: log_data_element: cib_update: + crmd[16006]: 2007/09/20_14:54:38 info: ccm_event_detail: CURRENT: host-2.awale.qc.ca [nodeid=1, born=1] cibmon[16000]: 2007/09/20_14:54:38 info: log_data_element: cib_update: + crmd[16006]: 2007/09/20_14:54:38 info: ccm_event_detail: CURRENT: host-1.awale.qc.ca [nodeid=0, born=2] crmd[16006]: 2007/09/20_14:54:38 info: ccm_event_detail: NEW: host-2.awale.qc.ca [nodeid=1, born=1] crmd[16006]: 2007/09/20_14:54:38 info: ccm_event_detail: NEW: host-1.awale.qc.ca [nodeid=0, born=2] crmd[16006]: 2007/09/20_14:54:38 info: do_started: The local CRM is operational cibmon[16000]: 2007/09/20_14:54:38 info: cibmon_diff: [cib_diff_notify] cib_update confirmed crmd[16006]: 2007/09/20_14:54:38 info: do_state_transition: State transition S_STARTING -> S_PENDING [ input=I_PENDING cause=C_CCM_CALLBACK origin=do_started ] cibmon[16000]: 2007/09/20_14:54:38 info: log_cib_diff: cib_update: Local-only Change: 0.1.1 crmd[16006]: 2007/09/20_14:54:38 info: update_dc: Set DC to () cibmon[16000]: 2007/09/20_14:54:38 info: log_data_element: cib_update: + cibmon[16000]: 2007/09/20_14:54:38 info: log_data_element: cib_update: + cibmon[16000]: 2007/09/20_14:54:38 info: log_data_element: cib_update: + cibmon[16000]: 2007/09/20_14:54:38 info: log_data_element: cib_update: + cibmon[16000]: 2007/09/20_14:54:38 info: log_data_element: cib_update: + cibmon[16000]: 2007/09/20_14:54:38 info: log_data_element: cib_update: + attrd[16005]: 2007/09/20_14:54:40 info: main: Starting mainloop... crmd[16006]: 2007/09/20_14:54:49 info: crm_timer_popped: Election Trigger (I_DC_TIMEOUT) just popped! crmd[16006]: 2007/09/20_14:54:49 WARN: do_log: [[FSA]] Input I_DC_TIMEOUT from crm_timer_popped() received in state (S_PENDING) crmd[16006]: 2007/09/20_14:54:49 info: do_state_transition: State transition S_PENDING -> S_ELECTION [ input=I_DC_TIMEOUT cause=C_TIMER_POPPED origin=crm_timer_popped ] crmd[16006]: 2007/09/20_14:54:49 info: update_dc: Set DC to () crmd[16006]: 2007/09/20_14:54:49 info: do_election_count_vote: Updated voted hash for host-1.awale.qc.ca to vote crmd[16006]: 2007/09/20_14:54:49 info: do_election_count_vote: Election ignore: our vote (host-1.awale.qc.ca) crmd[16006]: 2007/09/20_14:54:49 info: do_election_check: Still waiting on 1 non-votes (2 total) crmd[16006]: 2007/09/20_14:54:50 info: do_election_count_vote: Election check: vote from host-2.awale.qc.ca crmd[16006]: 2007/09/20_14:54:50 info: update_dc: Set DC to () crmd[16006]: 2007/09/20_14:54:50 info: do_election_check: Still waiting on 1 non-votes (2 total) crmd[16006]: 2007/09/20_14:54:50 info: do_state_transition: State transition S_ELECTION -> S_PENDING [ input=I_PENDING cause=C_FSA_INTERNAL origin=do_election_count_vote ] crmd[16006]: 2007/09/20_14:54:50 info: update_dc: Set DC to () crmd[16006]: 2007/09/20_14:54:50 info: do_dc_release: DC role released crmd[16006]: 2007/09/20_14:54:51 info: update_dc: Set DC to host-2.awale.qc.ca (1.0.9) cibmon[16000]: 2007/09/20_14:54:51 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:54:51 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.1 cibmon[16000]: 2007/09/20_14:54:51 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.2 cibmon[16000]: 2007/09/20_14:54:51 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:51 info: log_data_element: cib_apply_diff: + crmd[16006]: 2007/09/20_14:54:52 info: update_dc: Set DC to host-2.awale.qc.ca (1.0.9) crmd[16006]: 2007/09/20_14:54:52 info: do_state_transition: State transition S_PENDING -> S_NOT_DC [ input=I_NOT_DC cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond ] cib[16002]: 2007/09/20_14:54:52 info: cib_replace_notify: Local-only Replace: 0.1.2 from crmd[16006]: 2007/09/20_14:54:52 info: populate_cib_nodes: Requesting the list of configured nodes cibmon[16000]: 2007/09/20_14:54:52 info: cibmon_diff: [cib_diff_notify] cib_replace confirmed cibmon[16000]: 2007/09/20_14:54:52 info: log_cib_diff: cib_replace: Local-only Change: 0.1.2 cibmon[16000]: 2007/09/20_14:54:52 info: log_data_element: cib_replace: + cibmon[16000]: 2007/09/20_14:54:52 info: log_data_element: cib_replace: + cibmon[16000]: 2007/09/20_14:54:52 info: log_data_element: cib_replace: + cibmon[16000]: 2007/09/20_14:54:52 info: log_data_element: cib_replace: + cibmon[16000]: 2007/09/20_14:54:52 info: log_data_element: cib_replace: + cibmon[16000]: 2007/09/20_14:54:52 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:54:52 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.2 cibmon[16000]: 2007/09/20_14:54:52 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.3 cibmon[16000]: 2007/09/20_14:54:52 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:52 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:52 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:54:52 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.3 cibmon[16000]: 2007/09/20_14:54:52 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.4 cibmon[16000]: 2007/09/20_14:54:52 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:52 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:52 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:54:52 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.4 cibmon[16000]: 2007/09/20_14:54:52 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.5 cibmon[16000]: 2007/09/20_14:54:52 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:52 info: log_data_element: cib_apply_diff: + crmd[16006]: 2007/09/20_14:54:52 notice: populate_cib_nodes: Node: host-2.awale.qc.ca (uuid: 77c6bcf6-f1e9-4e62-a33e-6ddd3530b92e) crmd[16006]: 2007/09/20_14:54:53 notice: populate_cib_nodes: Node: host-1.awale.qc.ca (uuid: 1da8804b-8a93-4145-9d40-1133699fe377) crmd[16006]: 2007/09/20_14:54:53 info: do_lrm_rsc_op: Performing op=share-drbd_0:0_monitor_0 key=12:0:686542a3-7c00-48a2-bdd3-0f9aad92cc0b) cibmon[16000]: 2007/09/20_14:54:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:54:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.5 cibmon[16000]: 2007/09/20_14:54:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.6 cibmon[16000]: 2007/09/20_14:54:53 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:53 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:53 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:53 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:53 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:53 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:53 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:53 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:53 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:53 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:53 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:54:53 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.6 cibmon[16000]: 2007/09/20_14:54:53 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.7 cibmon[16000]: 2007/09/20_14:54:53 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:53 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:53 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:53 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:53 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:53 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:53 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:53 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:53 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:53 info: log_data_element: cib_apply_diff: + crmd[16006]: 2007/09/20_14:54:53 info: do_lrm_rsc_op: Performing op=msg_first_monitor_0 key=13:0:686542a3-7c00-48a2-bdd3-0f9aad92cc0b) crmd[16006]: 2007/09/20_14:54:53 info: do_lrm_rsc_op: Performing op=share-FS_monitor_0 key=14:0:686542a3-7c00-48a2-bdd3-0f9aad92cc0b) crmd[16006]: 2007/09/20_14:54:53 info: do_lrm_rsc_op: Performing op=share-drbdlinks_monitor_0 key=15:0:686542a3-7c00-48a2-bdd3-0f9aad92cc0b) crmd[16006]: 2007/09/20_14:54:53 info: do_lrm_rsc_op: Performing op=IPaddr_10_0_0_59_monitor_0 key=16:0:686542a3-7c00-48a2-bdd3-0f9aad92cc0b) crmd[16006]: 2007/09/20_14:54:53 info: do_lrm_rsc_op: Performing op=mysql_monitor_0 key=17:0:686542a3-7c00-48a2-bdd3-0f9aad92cc0b) crmd[16006]: 2007/09/20_14:54:53 info: do_lrm_rsc_op: Performing op=dw-httpd_monitor_0 key=18:0:686542a3-7c00-48a2-bdd3-0f9aad92cc0b) crmd[16006]: 2007/09/20_14:54:53 info: do_lrm_rsc_op: Performing op=msg_last_monitor_0 key=19:0:686542a3-7c00-48a2-bdd3-0f9aad92cc0b) drbd[16011][16039]: 2007/09/20_14:54:53 DEBUG: r0: Calling drbdadm -c /etc/drbd.conf state r0 crmd[16006]: 2007/09/20_14:54:53 info: process_lrm_event: LRM operation share-drbdlinks_monitor_0 (call=5, rc=7) complete drbd[16011][16061]: 2007/09/20_14:54:53 DEBUG: r0: Exit code 0 drbd[16011][16064]: 2007/09/20_14:54:53 DEBUG: r0: Command output: Not configured crmd[16006]: 2007/09/20_14:54:53 info: process_lrm_event: LRM operation msg_first_monitor_0 (call=3, rc=7) complete drbd[16011][16078]: 2007/09/20_14:54:53 DEBUG: r0: Calling drbdadm -c /etc/drbd.conf cstate r0 crmd[16006]: 2007/09/20_14:54:53 info: process_lrm_event: LRM operation share-FS_monitor_0 (call=4, rc=7) complete drbd[16011][16102]: 2007/09/20_14:54:53 DEBUG: r0: Exit code 0 drbd[16011][16103]: 2007/09/20_14:54:53 DEBUG: r0: Command output: Not configured drbd[16011][16104]: 2007/09/20_14:54:54 DEBUG: r0 status: Not configured Not configured Not configured Unconfigured drbd[16011][16105]: 2007/09/20_14:54:54 DEBUG: r0 monitor: resource not configured crmd[16006]: 2007/09/20_14:54:54 info: process_lrm_event: LRM operation share-drbd_0:0_monitor_0 (call=2, rc=7) complete cibmon[16000]: 2007/09/20_14:54:54 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:54:54 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.7 cibmon[16000]: 2007/09/20_14:54:54 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.8 cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:54:54 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.8 cibmon[16000]: 2007/09/20_14:54:54 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.9 cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:54:54 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.9 cibmon[16000]: 2007/09/20_14:54:54 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.10 cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:54:54 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.10 cibmon[16000]: 2007/09/20_14:54:54 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.11 cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + mysql[16107][16141]: 2007/09/20_14:54:54 DEBUG: MySQL is not running crmd[16006]: 2007/09/20_14:54:54 info: process_lrm_event: LRM operation mysql_monitor_0 (call=7, rc=7) complete crmd[16006]: 2007/09/20_14:54:54 info: process_lrm_event: LRM operation IPaddr_10_0_0_59_monitor_0 (call=6, rc=7) complete cibmon[16000]: 2007/09/20_14:54:54 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed crmd[16006]: 2007/09/20_14:54:54 info: process_lrm_event: LRM operation msg_last_monitor_0 (call=9, rc=7) complete cibmon[16000]: 2007/09/20_14:54:54 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.11 cibmon[16000]: 2007/09/20_14:54:54 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.12 cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:54:54 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.12 cibmon[16000]: 2007/09/20_14:54:54 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.13 cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:54:54 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.13 cibmon[16000]: 2007/09/20_14:54:54 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.14 cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + crmd[16006]: 2007/09/20_14:54:54 info: process_lrm_event: LRM operation dw-httpd_monitor_0 (call=8, rc=7) complete daemontools[16110][16167]: 2007/09/20_14:54:54 INFO: daemontools Resource is stopped cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:54:54 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.14 cibmon[16000]: 2007/09/20_14:54:54 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.15 cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:54:54 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.15 cibmon[16000]: 2007/09/20_14:54:54 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.16 cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:54:54 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.16 cibmon[16000]: 2007/09/20_14:54:54 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.17 cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:54:54 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.17 cibmon[16000]: 2007/09/20_14:54:54 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.18 cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:54:54 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.18 cibmon[16000]: 2007/09/20_14:54:54 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.19 cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:54 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:54:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.19 cibmon[16000]: 2007/09/20_14:54:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.20 cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:54:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.20 cibmon[16000]: 2007/09/20_14:54:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.21 cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:54:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.21 cibmon[16000]: 2007/09/20_14:54:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.22 cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:54:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.22 cibmon[16000]: 2007/09/20_14:54:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.23 cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:54:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.23 cibmon[16000]: 2007/09/20_14:54:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.24 cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:54:55 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.24 cibmon[16000]: 2007/09/20_14:54:55 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.25 cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:55 info: log_data_element: cib_apply_diff: + crmd[16006]: 2007/09/20_14:54:55 info: do_lrm_rsc_op: Performing op=share-drbd_0:1_monitor_0 key=5:1:686542a3-7c00-48a2-bdd3-0f9aad92cc0b) drbd[16168][16180]: 2007/09/20_14:54:56 DEBUG: r0: Calling drbdadm -c /etc/drbd.conf state r0 drbd[16168][16187]: 2007/09/20_14:54:56 DEBUG: r0: Exit code 0 drbd[16168][16188]: 2007/09/20_14:54:56 DEBUG: r0: Command output: Not configured cibmon[16000]: 2007/09/20_14:54:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:54:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.25 cibmon[16000]: 2007/09/20_14:54:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.26 cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:54:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.26 cibmon[16000]: 2007/09/20_14:54:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.27 cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:54:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.27 cibmon[16000]: 2007/09/20_14:54:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.28 cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:54:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.28 cibmon[16000]: 2007/09/20_14:54:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.29 cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + drbd[16168][16196]: 2007/09/20_14:54:56 DEBUG: r0: Calling drbdadm -c /etc/drbd.conf cstate r0 drbd[16168][16209]: 2007/09/20_14:54:56 DEBUG: r0: Exit code 0 drbd[16168][16210]: 2007/09/20_14:54:56 DEBUG: r0: Command output: Not configured drbd[16168][16211]: 2007/09/20_14:54:56 DEBUG: r0 status: Not configured Not configured Not configured Unconfigured drbd[16168][16212]: 2007/09/20_14:54:56 DEBUG: r0 monitor: resource not configured crmd[16006]: 2007/09/20_14:54:56 info: process_lrm_event: LRM operation share-drbd_0:1_monitor_0 (call=10, rc=7) complete cibmon[16000]: 2007/09/20_14:54:56 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:54:56 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.29 cibmon[16000]: 2007/09/20_14:54:56 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.30 cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:56 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:57 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:54:57 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.30 cibmon[16000]: 2007/09/20_14:54:57 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.31 cibmon[16000]: 2007/09/20_14:54:57 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:57 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:57 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:57 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:57 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:57 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:57 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:57 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:57 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:57 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:57 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:57 info: log_data_element: cib_apply_diff: + crmd[16006]: 2007/09/20_14:54:58 info: do_lrm_rsc_op: Performing op=share-drbd_0:1_start_0 key=8:2:686542a3-7c00-48a2-bdd3-0f9aad92cc0b) crmd[16006]: 2007/09/20_14:54:58 info: do_lrm_rsc_op: Performing op=msg_first_start_0 key=35:2:686542a3-7c00-48a2-bdd3-0f9aad92cc0b) cibmon[16000]: 2007/09/20_14:54:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:54:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.31 cibmon[16000]: 2007/09/20_14:54:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.32 cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:54:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.32 cibmon[16000]: 2007/09/20_14:54:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.33 cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:54:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.33 cibmon[16000]: 2007/09/20_14:54:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.34 cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:58 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:54:58 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.34 cibmon[16000]: 2007/09/20_14:54:58 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.35 cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:54:58 info: log_data_element: cib_apply_diff: + lrmd[16003]: 2007/09/20_14:54:58 info: RA output: (share-drbd_0:1:start:stdout) r0: ACTION=start drbd[16213][16235]: 2007/09/20_14:54:59 DEBUG: r0: Calling drbdadm -c /etc/drbd.conf state r0 drbd[16213][16249]: 2007/09/20_14:54:59 DEBUG: r0: Exit code 0 drbd[16213][16253]: 2007/09/20_14:54:59 DEBUG: r0: Command output: Not configured msg[16214][16255]: 2007/09/20_14:54:59 INFO Starting to switch to this node. msg[16214][16258]: 2007/09/20_14:54:59 INFO Node: host-1.awale.qc.ca crmd[16006]: 2007/09/20_14:54:59 info: process_lrm_event: LRM operation msg_first_start_0 (call=12, rc=0) complete crmd[16006]: 2007/09/20_14:54:59 info: build_operation_update: Digest for 0:0;35:2:686542a3-7c00-48a2-bdd3-0f9aad92cc0b (msg_first_start_0) was fd931b345f577de4ab73115496330fb5 crmd[16006]: 2007/09/20_14:54:59 info: log_data_element: build_operation_update: digest:source drbd[16213][16270]: 2007/09/20_14:54:59 DEBUG: r0: Calling drbdadm -c /etc/drbd.conf cstate r0 drbd[16213][16283]: 2007/09/20_14:54:59 DEBUG: r0: Exit code 0 drbd[16213][16284]: 2007/09/20_14:54:59 DEBUG: r0: Command output: Not configured drbd[16213][16285]: 2007/09/20_14:54:59 DEBUG: r0 status: Not configured Not configured Not configured Unconfigured drbd[16213][16286]: 2007/09/20_14:54:59 DEBUG: r0: Calling drbdadm -c /etc/drbd.conf up r0 cibmon[16000]: 2007/09/20_14:55:00 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:55:00 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.35 cibmon[16000]: 2007/09/20_14:55:00 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.36 cibmon[16000]: 2007/09/20_14:55:00 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:55:00 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:00 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:00 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:00 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:00 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:00 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:00 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:00 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:00 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:00 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:00 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:00 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:00 info: log_data_element: cib_apply_diff: + crmd[16006]: 2007/09/20_14:55:00 info: do_lrm_rsc_op: Performing op=msg_first_monitor_120000 key=36:2:686542a3-7c00-48a2-bdd3-0f9aad92cc0b) crmd[16006]: 2007/09/20_14:55:00 info: do_lrm_rsc_op: Performing op=share-FS_start_0 key=37:2:686542a3-7c00-48a2-bdd3-0f9aad92cc0b) crmd[16006]: 2007/09/20_14:55:00 info: process_lrm_event: LRM operation msg_first_monitor_120000 (call=13, rc=0) complete Filesystem[16297][16341]: 2007/09/20_14:55:00 INFO: Running start for /dev/drbd0 on /share cibmon[16000]: 2007/09/20_14:55:01 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:55:01 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.36 cibmon[16000]: 2007/09/20_14:55:01 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.37 cibmon[16000]: 2007/09/20_14:55:01 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:55:01 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:01 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:01 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:01 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:01 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:01 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:01 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:01 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:01 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:01 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:01 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:01 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:01 info: log_data_element: cib_apply_diff: + lrmd[16003]: 2007/09/20_14:55:01 info: RA output: (share-FS:start:stderr) mount: block device /dev/drbd0 is write-protected, mounting read-only lrmd[16003]: 2007/09/20_14:55:01 info: RA output: (share-FS:start:stderr) mount: /dev/drbd0 already mounted or /share busy Filesystem[16297][16354]: 2007/09/20_14:55:01 ERROR: Couldn't mount filesystem /dev/drbd0 on /share crmd[16006]: 2007/09/20_14:55:01 ERROR: process_lrm_event: LRM operation share-FS_start_0 (call=14, rc=1) Error unknown error crmd[16006]: 2007/09/20_14:55:01 info: build_operation_update: Digest for 4:1;37:2:686542a3-7c00-48a2-bdd3-0f9aad92cc0b (share-FS_start_0) was 0da34e076c2ca241d96b4d38d98c1ef3 crmd[16006]: 2007/09/20_14:55:01 info: log_data_element: build_operation_update: digest:source cibmon[16000]: 2007/09/20_14:55:03 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:55:03 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.37 cibmon[16000]: 2007/09/20_14:55:03 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.38 cibmon[16000]: 2007/09/20_14:55:03 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:55:03 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:03 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:03 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:03 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:03 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:03 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:03 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:03 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:03 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:03 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:03 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:04 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:55:04 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.38 cibmon[16000]: 2007/09/20_14:55:04 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.39 cibmon[16000]: 2007/09/20_14:55:04 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:55:04 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:04 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:04 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:04 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:04 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:04 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:04 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:04 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:04 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:04 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:04 info: log_data_element: cib_apply_diff: + drbd[16213][16369]: 2007/09/20_14:55:04 DEBUG: r0: Exit code 0 drbd[16213][16370]: 2007/09/20_14:55:04 DEBUG: r0: Command output: lrmd[16003]: 2007/09/20_14:55:04 info: RA output: (share-drbd_0:1:start:stdout) drbd[16213][16372]: 2007/09/20_14:55:04 DEBUG: r0: Calling drbdadm -c /etc/drbd.conf state r0 drbd[16213][16379]: 2007/09/20_14:55:04 DEBUG: r0: Exit code 0 drbd[16213][16380]: 2007/09/20_14:55:04 DEBUG: r0: Command output: Secondary/Unknown drbd[16213][16388]: 2007/09/20_14:55:04 DEBUG: r0: Calling drbdadm -c /etc/drbd.conf cstate r0 drbd[16213][16401]: 2007/09/20_14:55:04 DEBUG: r0: Exit code 0 drbd[16213][16402]: 2007/09/20_14:55:04 DEBUG: r0: Command output: WFConnection drbd[16213][16403]: 2007/09/20_14:55:04 DEBUG: r0 status: Secondary/Unknown Secondary Unknown WFConnection drbd[16213][16404]: 2007/09/20_14:55:04 DEBUG: r0 start: succeeded. crmd[16006]: 2007/09/20_14:55:04 info: process_lrm_event: LRM operation share-drbd_0:1_start_0 (call=11, rc=0) complete crmd[16006]: 2007/09/20_14:55:04 info: build_operation_update: Digest for 0:0;8:2:686542a3-7c00-48a2-bdd3-0f9aad92cc0b (share-drbd_0:1_start_0) was c0e018b73fdf522b6cdd355e125af15e crmd[16006]: 2007/09/20_14:55:04 info: log_data_element: build_operation_update: digest:source crmd[16006]: 2007/09/20_14:55:06 info: do_lrm_rsc_op: Performing op=share-drbd_0:1_notify_0 key=67:2:686542a3-7c00-48a2-bdd3-0f9aad92cc0b) cibmon[16000]: 2007/09/20_14:55:06 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:55:06 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.39 cibmon[16000]: 2007/09/20_14:55:06 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.40 cibmon[16000]: 2007/09/20_14:55:06 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:55:06 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:06 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:06 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:06 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:06 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:06 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:06 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:06 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:06 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:06 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:06 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:06 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:55:06 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.40 cibmon[16000]: 2007/09/20_14:55:06 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.41 cibmon[16000]: 2007/09/20_14:55:06 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:55:06 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:06 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:06 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:06 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:06 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:06 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:06 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:06 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:06 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:06 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:06 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:06 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:06 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:55:06 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.41 cibmon[16000]: 2007/09/20_14:55:06 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.42 cibmon[16000]: 2007/09/20_14:55:06 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:55:06 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:06 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:06 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:06 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:06 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:06 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:06 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:06 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:06 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:06 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:06 info: log_data_element: cib_apply_diff: + lrmd[16003]: 2007/09/20_14:55:06 info: RA output: (share-drbd_0:1:notify:stdout) r0: ACTION=notify drbd[16413][16424]: 2007/09/20_14:55:06 DEBUG: r0 notify: post for start - counts: active 0 - starting 2 - stopping 0 drbd[16413][16426]: 2007/09/20_14:55:06 DEBUG: r0: Calling drbdadm -c /etc/drbd.conf state r0 drbd[16413][16433]: 2007/09/20_14:55:06 DEBUG: r0: Exit code 0 drbd[16413][16434]: 2007/09/20_14:55:06 DEBUG: r0: Command output: Secondary/Secondary drbd[16413][16442]: 2007/09/20_14:55:06 DEBUG: r0: Calling drbdadm -c /etc/drbd.conf cstate r0 drbd[16413][16455]: 2007/09/20_14:55:06 DEBUG: r0: Exit code 0 drbd[16413][16456]: 2007/09/20_14:55:06 DEBUG: r0: Command output: Connected drbd[16413][16457]: 2007/09/20_14:55:06 DEBUG: r0 status: Secondary/Secondary Secondary Secondary Connected drbd[16413][16458]: 2007/09/20_14:55:06 DEBUG: r0: Calling /usr/sbin/crm_master -v 75 -l reboot crm_master[16460]: 2007/09/20_14:55:06 info: Invoked: /usr/sbin/crm_master -v 75 -l reboot cibmon[16000]: 2007/09/20_14:55:08 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:55:08 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.42 cibmon[16000]: 2007/09/20_14:55:08 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.43 cibmon[16000]: 2007/09/20_14:55:08 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:55:08 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:08 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:08 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:08 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:08 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:08 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:08 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:08 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:08 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:08 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:08 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:08 info: log_data_element: cib_apply_diff: + drbd[16413][16461]: 2007/09/20_14:55:08 DEBUG: r0: Exit code 0 drbd[16413][16462]: 2007/09/20_14:55:08 DEBUG: r0: Command output: crm_master[16460]: 2007/09/20_14:55:06 info: Invoked: /usr/sbin/crm_master -v 75 -l reboot lrmd[16003]: 2007/09/20_14:55:08 info: RA output: (share-drbd_0:1:notify:stdout) crm_master[16460]: 2007/09/20_14:55:06 info: Invoked: /usr/sbin/crm_master -v 75 -l reboot crmd[16006]: 2007/09/20_14:55:08 info: process_lrm_event: LRM operation share-drbd_0:1_notify_0 (call=15, rc=0) complete crmd[16006]: 2007/09/20_14:55:09 info: do_lrm_rsc_op: Performing op=share-drbd_0:1_monitor_120000 key=11:3:686542a3-7c00-48a2-bdd3-0f9aad92cc0b) crmd[16006]: 2007/09/20_14:55:09 info: do_lrm_rsc_op: Performing op=share-FS_stop_0 key=2:3:686542a3-7c00-48a2-bdd3-0f9aad92cc0b) cibmon[16000]: 2007/09/20_14:55:09 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:55:09 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.43 cibmon[16000]: 2007/09/20_14:55:09 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.44 cibmon[16000]: 2007/09/20_14:55:09 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:55:09 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:09 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:09 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:09 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:09 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:09 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:09 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:09 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:09 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:09 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:09 info: log_data_element: cib_apply_diff: + drbd[16463][16487]: 2007/09/20_14:55:09 DEBUG: r0: Calling drbdadm -c /etc/drbd.conf state r0 drbd[16463][16502]: 2007/09/20_14:55:09 DEBUG: r0: Exit code 0 drbd[16463][16506]: 2007/09/20_14:55:09 DEBUG: r0: Command output: Secondary/Secondary Filesystem[16464][16519]: 2007/09/20_14:55:09 INFO: Running stop for /dev/drbd0 on /share drbd[16463][16521]: 2007/09/20_14:55:09 DEBUG: r0: Calling drbdadm -c /etc/drbd.conf cstate r0 crmd[16006]: 2007/09/20_14:55:10 info: process_lrm_event: LRM operation share-FS_stop_0 (call=17, rc=0) complete drbd[16463][16542]: 2007/09/20_14:55:10 DEBUG: r0: Exit code 0 drbd[16463][16543]: 2007/09/20_14:55:10 DEBUG: r0: Command output: Connected drbd[16463][16544]: 2007/09/20_14:55:10 DEBUG: r0 status: Secondary/Secondary Secondary Secondary Connected crmd[16006]: 2007/09/20_14:55:10 info: process_lrm_event: LRM operation share-drbd_0:1_monitor_120000 (call=16, rc=0) complete cibmon[16000]: 2007/09/20_14:55:10 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:55:10 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.44 cibmon[16000]: 2007/09/20_14:55:10 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.45 cibmon[16000]: 2007/09/20_14:55:10 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:55:10 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:10 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:10 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:10 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:10 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:10 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:10 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:10 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:10 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:10 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:10 info: log_data_element: cib_apply_diff: + crmd[16006]: 2007/09/20_14:55:11 info: do_lrm_rsc_op: Performing op=msg_first_stop_0 key=36:3:686542a3-7c00-48a2-bdd3-0f9aad92cc0b) cibmon[16000]: 2007/09/20_14:55:11 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:55:11 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.45 cibmon[16000]: 2007/09/20_14:55:11 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.46 cibmon[16000]: 2007/09/20_14:55:11 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:55:11 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:11 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:11 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:11 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:11 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:11 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:11 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:11 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:11 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:11 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:11 info: log_data_element: cib_apply_diff: + msg[16545][16566]: 2007/09/20_14:55:11 INFO Completed switching away from this node. msg[16545][16567]: 2007/09/20_14:55:11 INFO Node: host-1.awale.qc.ca crmd[16006]: 2007/09/20_14:55:11 info: process_lrm_event: LRM operation msg_first_stop_0 (call=18, rc=0) complete cibmon[16000]: 2007/09/20_14:55:11 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:55:11 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.46 cibmon[16000]: 2007/09/20_14:55:11 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.47 cibmon[16000]: 2007/09/20_14:55:11 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:55:11 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:11 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:11 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:11 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:11 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:11 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:11 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:11 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:11 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:11 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:11 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:12 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:55:12 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.47 cibmon[16000]: 2007/09/20_14:55:12 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.48 cibmon[16000]: 2007/09/20_14:55:12 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:55:12 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:55:12 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:55:12 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:55:12 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:55:12 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:55:12 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:55:12 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:55:12 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:55:12 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:55:12 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:55:12 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:55:12 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:55:12 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:13 info: cibmon_diff: [cib_diff_notify] cib_apply_diff confirmed cibmon[16000]: 2007/09/20_14:55:13 info: log_cib_diff: cib_apply_diff: Diff: --- 0.1.48 cibmon[16000]: 2007/09/20_14:55:13 info: log_cib_diff: cib_apply_diff: Diff: +++ 0.1.49 cibmon[16000]: 2007/09/20_14:55:13 info: log_data_element: cib_apply_diff: - cibmon[16000]: 2007/09/20_14:55:13 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:13 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:13 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:13 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:13 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:13 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:13 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:13 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:13 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:13 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:13 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:13 info: log_data_element: cib_apply_diff: + cibmon[16000]: 2007/09/20_14:55:13 info: log_data_element: cib_apply_diff: + drbd[16574][16586]: 2007/09/20_14:57:10 DEBUG: r0: Calling drbdadm -c /etc/drbd.conf state r0 drbd[16574][16593]: 2007/09/20_14:57:10 DEBUG: r0: Exit code 0 drbd[16574][16594]: 2007/09/20_14:57:10 DEBUG: r0: Command output: Secondary/Secondary drbd[16574][16602]: 2007/09/20_14:57:10 DEBUG: r0: Calling drbdadm -c /etc/drbd.conf cstate r0 drbd[16574][16615]: 2007/09/20_14:57:10 DEBUG: r0: Exit code 0 drbd[16574][16616]: 2007/09/20_14:57:10 DEBUG: r0: Command output: Connected drbd[16574][16617]: 2007/09/20_14:57:10 DEBUG: r0 status: Secondary/Secondary Secondary Secondary Connected drbd[16618][16630]: 2007/09/20_14:59:10 DEBUG: r0: Calling drbdadm -c /etc/drbd.conf state r0 drbd[16618][16637]: 2007/09/20_14:59:10 DEBUG: r0: Exit code 0 drbd[16618][16638]: 2007/09/20_14:59:10 DEBUG: r0: Command output: Secondary/Secondary drbd[16618][16646]: 2007/09/20_14:59:10 DEBUG: r0: Calling drbdadm -c /etc/drbd.conf cstate r0 drbd[16618][16659]: 2007/09/20_14:59:10 DEBUG: r0: Exit code 0 drbd[16618][16660]: 2007/09/20_14:59:10 DEBUG: r0: Command output: Connected drbd[16618][16661]: 2007/09/20_14:59:10 DEBUG: r0 status: Secondary/Secondary Secondary Secondary Connected drbd[16674][16686]: 2007/09/20_15:01:11 DEBUG: r0: Calling drbdadm -c /etc/drbd.conf state r0 drbd[16674][16693]: 2007/09/20_15:01:11 DEBUG: r0: Exit code 0 drbd[16674][16694]: 2007/09/20_15:01:11 DEBUG: r0: Command output: Secondary/Secondary drbd[16674][16702]: 2007/09/20_15:01:11 DEBUG: r0: Calling drbdadm -c /etc/drbd.conf cstate r0 drbd[16674][16715]: 2007/09/20_15:01:11 DEBUG: r0: Exit code 0 drbd[16674][16716]: 2007/09/20_15:01:11 DEBUG: r0: Command output: Connected drbd[16674][16717]: 2007/09/20_15:01:11 DEBUG: r0 status: Secondary/Secondary Secondary Secondary Connected