Using Evaluation to
Support a
Results-Based Management
System
The
Evaluation
Evaluation
Evaluation is the systematic and objective
Evaluation is the systematic and objective
assessment of an ongoing or completed
assessment of an ongoing or completed
project, program or policy, including its
project, program or policy, including its
design, implementation, and results.
Difference Between Monitoring and Evaluation
Difference Between Monitoring and Evaluation
Monitoring continuously tracks
Monitoring continuously tracks
performance against what was planned by
performance against what was planned by
collecting and analyzing data on the
collecting and analyzing data on the
indicators established for monitoring and
indicators established for monitoring and
evaluation purposes.
evaluation purposes.
Evaluation is a periodic, in
Evaluation is a periodic, in
-
-
depth analysis
depth analysis
of
of
programme
programme
performance. It relies on
performance. It relies on
monitoring data and information generated
monitoring data and information generated
from other sources.
Characteristics of Monitoring and Evaluation
Characteristics of Monitoring and Evaluation
Monitoring
Monitoring
Evaluation
Evaluation
Timing
Timing
Continuous
Continuous
Periodic; at important milestones,
Periodic; at important milestones,
at the end or substantial period
at the end or substantial period
after implementation
after implementation
Main purpose
Main purpose
Tracks, analyzes and documents
Tracks, analyzes and documents
progress
progress
In
In-
-depth analysis; compares plan
depth analysis; compares plan
with actual achievement
with actual achievement
Focus
Focus
Inputs, activities, outputs,
Inputs, activities, outputs,
processes, likely results at
processes, likely results at
outcome level
outcome level
Outputs in relation to inputs;
Outputs in relation to inputs;
results in relation to cost;
results in relation to cost;
processes used to achieve
processes used to achieve
results; overall relevance; impact
results; overall relevance; impact
and sustainability
and sustainability
Typical questions
Typical questions
answered
answered
What activities were implemented
What activities were implemented
and results achieved
and results achieved
Why and how results were
Why and how results were
achieved
achieved
Managerial use
Managerial use
Alerts managers to problems and
Alerts managers to problems and
provides options for corrective
provides options for corrective
actions
actions
Provides managers with strategy
Provides managers with strategy
and policy options
and policy options
Who conducts
Who conducts
Self-
Self
-assessment by managers,
assessment by managers,
supervisors, community
supervisors, community
stakeholders, and
stakeholders, and funders
funders
Internal and/or external
Internal and/or external
evaluators
Complemention
Complemention
of Monitoring and Evaluation
of Monitoring and Evaluation
•
•
Sequential
Sequential
complementarity
complementarity
•
•
Information
Information
complementarity
complementarity
•
What is Evaluated?
What is Evaluated?
•
•
Process: refers to key aspects of the
Process: refers to key aspects of the
project,
project,
programme
programme
or policy
or policy
implementation
implementation
•
•
Results: effects of a project,
Results: effects of a project,
programme
programme
or
or
policy; a describable or measurable
policy; a describable or measurable
change in state that is derived from a
change in state that is derived from a
cause and effect relationship.
Three Types of Results
Three Types of Results
Outputs: Products and services that
Outputs: Products and services that
result from the completion of activities of
result from the completion of activities of
an intervention
an intervention
Outcomes: The intended or achieved
Outcomes: The intended or achieved
short and medium
short and medium
-
-
term effects of an
term effects of an
intervention
intervention
’
’
s outputs
s outputs
Impacts: Long
Impacts: Long
-
-
term positive and negative
term positive and negative
effects on identifiable groups produced
effects on identifiable groups produced
by a development intervention
Uses of
Evaluation
Main Purpose of Evaluation
Main Purpose of Evaluation
•
•
Compare planned to actual achievements
Compare planned to actual achievements
•
•
Determine why intended results were or were
Determine why intended results were or were
not achieved
not achieved
•
•
Analyze specific causal contribution of activities
Analyze specific causal contribution of activities
to results
to results
•
•
Explore unintended results
Explore unintended results
•
•
Highlight significant accomplishments
Highlight significant accomplishments
•
•
Distill lessons on what works and what doesn
Distill lessons on what works and what doesn
’
’
t
t
•
Management Questions Answered by Evaluation
Management Questions Answered by Evaluation
•
•
Descriptive
Descriptive
•
•
Normative or compliance
Normative or compliance
•
•
Correlational
Correlational
•
•
Impact or cause and effect
Impact or cause and effect
•
•
Program logic
Program logic
•
•
Implementation or process
Implementation or process
•
•
Performance
Performance
•
Pragmatic Uses of Evaluation
Pragmatic Uses of Evaluation
Making decisions on resource allocation
Making decisions on resource allocation
Rethinking the causes of a problem
Rethinking the causes of a problem
Detecting emerging problems
Detecting emerging problems
Aiding decisions on competing alternatives
Aiding decisions on competing alternatives
Maintaining support to public sector reform
Maintaining support to public sector reform
and innovation
and innovation
Building consensus on the causes of a
Building consensus on the causes of a
problem and how to respond
Summary of Uses of Evaluation
Summary of Uses of Evaluation
Political strategy and design
Political strategy and design
Are we doing the right things?
Are we doing the right things?
Operational and implementation
Operational and implementation
Are we doing the right things?
Are we doing the right things?
Learning
Learning
Timing of Evaluation
Timing of Evaluation
During situation analysis
During situation analysis
During
During
programme
programme
design
design
During
During
programme
programme
implementation
implementation
Instances that Warrant Evaluation
Instances that Warrant Evaluation
Divergence between planned and actual
Divergence between planned and actual
performance
performance
Contribution of design and implementation
Contribution of design and implementation
outcomes
outcomes
Competition on allocation of resources
Competition on allocation of resources
