Using Evaluation to Support a Results- Based Management System

15 

Loading....

Loading....

Loading....

Loading....

Loading....

Full text

(1)

Using Evaluation to

Support a

Results-Based Management

System

(2)

The

(3)

Evaluation

Evaluation

Evaluation is the systematic and objective

Evaluation is the systematic and objective

assessment of an ongoing or completed

assessment of an ongoing or completed

project, program or policy, including its

project, program or policy, including its

design, implementation, and results.

(4)

Difference Between Monitoring and Evaluation

Difference Between Monitoring and Evaluation

Monitoring continuously tracks

Monitoring continuously tracks

performance against what was planned by

performance against what was planned by

collecting and analyzing data on the

collecting and analyzing data on the

indicators established for monitoring and

indicators established for monitoring and

evaluation purposes.

evaluation purposes.

Evaluation is a periodic, in

Evaluation is a periodic, in

-

-

depth analysis

depth analysis

of

of

programme

programme

performance. It relies on

performance. It relies on

monitoring data and information generated

monitoring data and information generated

from other sources.

(5)

Characteristics of Monitoring and Evaluation

Characteristics of Monitoring and Evaluation

Monitoring

Monitoring

Evaluation

Evaluation

Timing

Timing

Continuous

Continuous

Periodic; at important milestones,

Periodic; at important milestones,

at the end or substantial period

at the end or substantial period

after implementation

after implementation

Main purpose

Main purpose

Tracks, analyzes and documents

Tracks, analyzes and documents

progress

progress

In

In-

-depth analysis; compares plan

depth analysis; compares plan

with actual achievement

with actual achievement

Focus

Focus

Inputs, activities, outputs,

Inputs, activities, outputs,

processes, likely results at

processes, likely results at

outcome level

outcome level

Outputs in relation to inputs;

Outputs in relation to inputs;

results in relation to cost;

results in relation to cost;

processes used to achieve

processes used to achieve

results; overall relevance; impact

results; overall relevance; impact

and sustainability

and sustainability

Typical questions

Typical questions

answered

answered

What activities were implemented

What activities were implemented

and results achieved

and results achieved

Why and how results were

Why and how results were

achieved

achieved

Managerial use

Managerial use

Alerts managers to problems and

Alerts managers to problems and

provides options for corrective

provides options for corrective

actions

actions

Provides managers with strategy

Provides managers with strategy

and policy options

and policy options

Who conducts

Who conducts

Self-

Self

-assessment by managers,

assessment by managers,

supervisors, community

supervisors, community

stakeholders, and

stakeholders, and funders

funders

Internal and/or external

Internal and/or external

evaluators

(6)

Complemention

Complemention

of Monitoring and Evaluation

of Monitoring and Evaluation

Sequential

Sequential

complementarity

complementarity

Information

Information

complementarity

complementarity

(7)

What is Evaluated?

What is Evaluated?

Process: refers to key aspects of the

Process: refers to key aspects of the

project,

project,

programme

programme

or policy

or policy

implementation

implementation

Results: effects of a project,

Results: effects of a project,

programme

programme

or

or

policy; a describable or measurable

policy; a describable or measurable

change in state that is derived from a

change in state that is derived from a

cause and effect relationship.

(8)

Three Types of Results

Three Types of Results

„

„

Outputs: Products and services that

Outputs: Products and services that

result from the completion of activities of

result from the completion of activities of

an intervention

an intervention

„

„

Outcomes: The intended or achieved

Outcomes: The intended or achieved

short and medium

short and medium

-

-

term effects of an

term effects of an

intervention

intervention

s outputs

s outputs

„

„

Impacts: Long

Impacts: Long

-

-

term positive and negative

term positive and negative

effects on identifiable groups produced

effects on identifiable groups produced

by a development intervention

(9)

Uses of

Evaluation

(10)

Main Purpose of Evaluation

Main Purpose of Evaluation

Compare planned to actual achievements

Compare planned to actual achievements

Determine why intended results were or were

Determine why intended results were or were

not achieved

not achieved

Analyze specific causal contribution of activities

Analyze specific causal contribution of activities

to results

to results

Explore unintended results

Explore unintended results

Highlight significant accomplishments

Highlight significant accomplishments

Distill lessons on what works and what doesn

Distill lessons on what works and what doesn

t

t

(11)

Management Questions Answered by Evaluation

Management Questions Answered by Evaluation

Descriptive

Descriptive

Normative or compliance

Normative or compliance

Correlational

Correlational

Impact or cause and effect

Impact or cause and effect

Program logic

Program logic

Implementation or process

Implementation or process

Performance

Performance

(12)

Pragmatic Uses of Evaluation

Pragmatic Uses of Evaluation

„

„

Making decisions on resource allocation

Making decisions on resource allocation

„

„

Rethinking the causes of a problem

Rethinking the causes of a problem

„

„

Detecting emerging problems

Detecting emerging problems

„

„

Aiding decisions on competing alternatives

Aiding decisions on competing alternatives

„

„

Maintaining support to public sector reform

Maintaining support to public sector reform

and innovation

and innovation

„

„

Building consensus on the causes of a

Building consensus on the causes of a

problem and how to respond

(13)

Summary of Uses of Evaluation

Summary of Uses of Evaluation

„

„

Political strategy and design

Political strategy and design

„

„

Are we doing the right things?

Are we doing the right things?

„

„

Operational and implementation

Operational and implementation

„

„

Are we doing the right things?

Are we doing the right things?

„

„

Learning

Learning

„

(14)

Timing of Evaluation

Timing of Evaluation

„

„

During situation analysis

During situation analysis

„

„

During

During

programme

programme

design

design

„

„

During

During

programme

programme

implementation

implementation

„

(15)

Instances that Warrant Evaluation

Instances that Warrant Evaluation

„

„

Divergence between planned and actual

Divergence between planned and actual

performance

performance

„

„

Contribution of design and implementation

Contribution of design and implementation

outcomes

outcomes

„

„

Competition on allocation of resources

Competition on allocation of resources

„

Figure

Updating...

References

Updating...

Related subjects :