APPRAISING RESULT FRAMEWORK:
Maki I. Tsumagari, PhD; Roshani Bhujel
PRINCIPLES, PROCESS, AND
ANALYSIS
Coverage of the two sessions
2
2. Process
3. Analysis
“Managing for Development Results (MfDR)”
Logics of “Logical Framework”
Through concurrent
Analytical Exercises
1. Principles
Movement into "Managing for Development Results: MfDR"
3
Principles
Criticisms on development aid (1990s- early 2000s)
Overemphasis on funding development inputs
Unclear goals for activities
Fragmented & unsustainable investment
Led to the emergence of focus on results,
and management for development results
Movement into "Managing for Development Results: MfDR"
4
Principles
Asian Development Bank (2012) Managing for development results:
Relevance, responsiveness, and results orientation.
“Align values, culture, policies,
strategies, and practices through well- designed and defined results that
describe its performance.”
Managing for Development Results
“effectively”
Movement into "Managing for Development Results: MfDR"
5
Principles
"an approach focused on development
outcomes throughout the management cycle.”
What MfDR is….
What MfDR does….
"enables informed decision making by integrating a results focus across the four
mutually reinforcing core management
functions.
Movement into "Managing for Development Results: MfDR"
6
Principles
What MfDR does (continued)
“four mutually reinforcing core management functions.
1. defining outcomes and outputs with
measurable indicators and time-bound
targets, and agreeing on associated
activities;
Movement into "Managing for Development Results: MfDR"
7
Principles
What MfDR does (continued)
“four mutually reinforcing core management functions.
2. allocating resources to agreed upon
activities;
Movement into "Managing for Development Results: MfDR"
8
Principles
What MfDR does (continued)
“four mutually reinforcing core management functions.
3. implementing agreed upon activities and monitoring progress and targets;
and
Movement into "Managing for Development Results: MfDR"
9
Principles
What MfDR does (continued)
“four mutually reinforcing core management functions.
4. evaluating performance against targets.
Project Management based on Logic using Logical Framework
10
Process
Logical Framework (4x4 matrix)
Adapted from: NPC (2013) National Monitoring and Evaluation Guidelines.
Narrative
Summary Objectively Verifiable Indicators (OVI)
Means of Verification
(MOV)
Risks and Assumptions Goal:
Objective/
Purpose:
Outputs
Activities: Inputs: Pre-condition:
Project Management based on Logic using Logical Framework
11
Process
Logical Framework: How does it work?
Each column is assigned for a particular logic component
called "block"
12
Project: Improving economic status of farmers of ABC municipality
through Irrigation Project
Example: Logical Framework
Matrix
Project Management based on Logic using Logical Framework
13
Process
Logic Components=Block (cont’ed)
Goal Purpose Outputs
Activities
Project is expected to contribute to achieving this supreme objective
Envisaged achievement target of the Project
Combination of actions that create Outputs
Results that in combination make
the project meet the Purpose
1. Goal
-Economic status of farmers from ABC municipality have improved 2. Purpose/Objective
-Increased agricultural productivity and production of ABC municipality 3. Outputs
-Irrigated land
-Community based irrigation system constructed
4. Activities
-Construction of …km of canals -Constructions of … km of sub- canals
NARRATIVE SUMMARY
VE R TI CL E BLO CK
Project Management based on Logic using Logical Framework
15
Process
Logic Components=Block (cont’ed)
Objectively Verifiable Indicators
(OVI)
Means of Verification
(MOV)
Basis to say if pre-set criteria is achieved
Source of information for
OVI test
Project Management based on Logic using Logical Framework
16
Process
Logic Components=Block (cont’ed)
Inputs
Assumptions Pre-condition
Resources to conduct the Project
Significant external factors that might affect the Project Indispensable factor, without meeting it, the Project will
cannot start.
Objectively Verifiable Indicators (OVI)
Means of Verification
(MoV) Assumptions/Risks
Community participation is obtained
Inputs -Financial -Technical
-Human Resources
Records indicating per- capita income from Municipality profile 20% increase in
agricultural income -Project record
-Field inspection report
Bills and invoices
-
-Proper utilization of irrigation system
-Marketing system works properly
-Timely release of bdget -Availability of techunical and skilled manpower Increased rate of
agricultural income The percentage of farm production increased by 20%
Progress report of project
HORIZONTAL BLOCK
18
Goal Project Objective
Output Activities
Indicators Means of
Verification Assumptions/
Risks
Project Management based on Logic using Logical Framework
Logical Framework: Where is the logic?
Process
Vertical
Horizontal
Diagonal
Chain
Improving economic status of farmers of ABC municipality through Irrigation Project
Narrative Summary Objectively Verifiable Indicators (OVI)
Means of Verification (MoV)
1. Goal
To improve the economic status of farmers of ABC municipality
Increased rate of agricultural income
Community participation is obtained
2. Purpose/Objective -Increased agricultural productivity and
production of ABC municipality
3. Outputs -Irrigated land -Community based irrigation system constructed
4. Activities
-Construction of …km of canals
-Constructions of … km of sub-canals
The percentage of farm production increased by 20%
Progress report of project
Inputs -Financial -Technical
-Human Manpower
Records indicating per-capita income from Municipality profile
20% increase in agricultural income
-Project record -Field inspection report
Bills and invoices
-Proper utilization of irrigation
system
-Marketing system works properly
Timely release of budget
-Availability of technical and skilled manpower
Narrative Summary Objectively Verifiable Indicators (OVI)
Means of
Verification (MoV) Assumptions/Ris ks
1. Goal
-Economic status of farmers from ABC municipality have improved
Increased rate of agricultural income
3. Outputs -Irrigated land -Community based irrigation system constructed
4. Activities
-Construction of …km of canals
-Constructions of … km of sub-canals
The percentage of farm production increased by 20%
Progress report of project
Inputs -Financial -Technical
-Human Manpower
20% increase in agricultural income
-Project record -Field inspection report
1. Goal
-Economic status of farmers from ABC municipality have improved
Increased rate of agricultural income
IF AND
THEN
Diagonal
Project Management based on Logic using Logical Framework
20
Process
Steps of creating Logical Framework
Adapted from: World Bank (2012) Designing a results framework for achieving results: A how-to guide. Washington, DC. (pp. 26-29)
2. Identify and work with stakeholders
3. Define results (Outputs and Outcomes)
1. Establish strategic objective(s) for the
problem(s) to be addressed
Project Management based on Logic using Logical Framework
21
Process
Steps of creating Logical Framework (cont’ed)
5. Review available data sources and specify indicators
6. Assign indicators and data sources
4. Identify critical assumptions and risks
Project Management based on Logic using Logical Framework
22
Process
Typical patterns of Logical Build up with Focus on Output-Outcome linkages
A. Sequential Pattern Outcome Output 3
1. XXXXXXXXXXXX 2. XXXXXXXXXXXX 3. XXXXXXXXXXXX
Output 2
1. XXXXXXXXXXXX 2. XXXXXXXXXXXX 3. XXXXXXXXXXXX
Output 1
1. XXXXXXXXXXXX
…
Project Management based on Logic using Logical Framework
23
Process
Typical patterns of Logical Build up with Focus on Output-Outcome linkages
B. Parallel Pattern
Outcome Output 1
1. XXXXXXXXXXXX 2. XXXXXXXXXXXX 3. XXXXXXXXXXXX
Output 3
1. XXXXXXXXXXXX 2. XXXXXXXXXXXX 3. XXXXXXXXXXXX
Output 2
1. XXXXXXXXXXXX 2. XXXXXXXXXXXX 3. XXXXXXXXXXXX
Project Management based on Logic using Logical Framework
24
Process
Typical patterns of Logical Build up with Focus on Output-Outcome linkages
A. Sequential Pattern B. Parallel Pattern
Analytical Exercise 1 : Which pattern is this
Project (ADB WSS Project)?
Project Management based on Logic using Logical Framework
25
Process
Logical Framework: What's the value?
helps think through and analyze the goals, objectives, outputs, activities and inputs of a project in a systematic and logical manner.
identifies the assumptions and risks that can affect successful implementation of the project.
National Planning Commission (2013)
National Monitoring and Evaluation Guidelines, p. 10.
Project Management based on Logic using Logical Framework
26
Process
Logical Framework: What's the value?
(Cont’ed)
With the help of a log frame, it is possible to identify the
intended results and methods for its measurement at the
very outset of project formulation.
National Planning Commission (2013)
National Monitoring and Evaluation Guidelines, p. 10.
Project Management based on Logic using Logical Framework
27
Process
Logical Framework: What's the need?
mandatory to prepare and attach a logical framework with all new project proposals.
National Planning Commission (2013)
National Monitoring and Evaluation Guidelines, p. 11.
Project Management based on Logic using Logical Framework
28
Process
Importance of indicators in Logical Framework (as measure for if the envisaged development
results are realized) - SMART?
SMART INDICATORS S Simple
M Measurable A Achievable R Reliable
T Time Bound
Analytical Exercise 2 : Are the indicators of
“ADB WSS Project”
SMART?
Project Management based on Logic using Logical Framework
29
Process
Current focus of
NPC with regard to
“Results” Framework
Alignment with
SDGs
Project Management based on Logic using Logical Framework
30
Process
Analytical Exercise 3 : Are the project indicators aligned with SDG indicators?
ADB WSS Project
Nepal SDG6 Indicator Table
Project Management based on Logic using Logical Framework
31
Process
Some issues raised….
Difficulty in applying causal logic
Difficulty in learning
Difficulty in integrating
Difficulty in revising
Any more….?
Endnote
32
Essentially, results framework
should be based on sound logic.
If the argument is (a) not clear, (b) not consistent, (c) has gaps in logic, and/or (d) contradicting, it is called
“logic failure”.
Appraising Results Framework = Checking Building Blocks
33
