Overview of M&E Data Quality
Tools
Workshop on Grant Negotiation and Implementation
of Global Fund TB grants
Geneva, 11 to 14 December 2007
Annette Reinisch,
M&E and DQ Tools: Objectives
The M&E and Data Quality tools were developed to
strengthen national M&E
systems for improved program management and decision making.
The
goal is to:
Better identify capacity gaps and guide investments in strengthening
national M&E systems
Better identify capacity gaps and guide investments in strengthening
national M&E systems
Avoid development of parallel reporting systems
Avoid development of parallel reporting systems
Ensure consistency in building systems (e.g., choice of standard
indicators)
Ensure consistency in building systems (e.g., choice of standard
indicators)
Enable assessment of the reliability of reported data
Enable assessment of the reliability of reported data
Improve the quality of reported data for local use and for reporting,
including of the Global Fund to its partners
Improve the quality of reported data for local use and for reporting,
including of the Global Fund to its partners
M&E and DQ tools
in the Grant Management Framework
Y1 Y2 Y3 Y4 Y5
Grant
Negotiation Phase 1 Phase 2
GRANT LIFECYCLE
Request for
Cntd. Funding ApplicationRCC
Overall Performance Evaluation & Continued Funding Decision
Grant Agreement M&E Framework & Budget Progress Updates 1 Progress Updates 2 Progress Updates 3 Progress Updates 4 Progress Updates 5 Progress Updates 6 Progress Updates 7 Progress Updates 8 Progress Updates 9
M&E Systems Strengthening Tool
Y1 Y2 Y3 Y4 Y5
Grant
Negotiation Phase 1 Phase 2
Grant Agreement
M&E Framework & Budget
OBJECTIVES:
Diagnosis of M&E Systems to help (1)identify capacity gaps;
(2) develop a costed action plan to strengthen M&E; (3)
harmonize systems with partners; and (4) align around national systems
DESCRIPTION:
Three Assessment Areas:
1. Monitoring and Evaluation (M&E) Plan;
2. Program Management Unit (i.e., capacities to collect, analyze and report data related to Program
implementation).
3. Data-collection and Reporting Systems per Program Area (eg. ART, ITN, TB Treatment, …).
http://www.theglobalfund.org/en/performance/monitoring_evaluation
Fu
ll s
es
sio
n c
ov
eri
ng
th
e A
ss
es
sm
en
t T
oo
l
M&E Toolkit
Y1 Y2 Y3 Y4 Y5
Grant
Negotiation Phase 1 Phase 2
Grant Agreement
M&E Framework & Budget
OBJECTIVES:
Help countries understand the Global Fund M&E Framework and select commonly agreed indicators for reporting.
DESCRIPTION:
A resource guide on M&E of HIV, TB and Malaria Programs
2nd Edition, January 2006 (new edition planned for 2008):
– Essential, agreed upon best M&E practices
– Description of the major indicators & how they fit into general M&E
– Common indicators for 9 partners
– References to key materials and resources.
– FAQs
Performance Framework
Y1 Y2 Y3 Y4 Y5
Grant
Negotiation Phase 1 Phase 2
Grant Agreement
M&E Framework & Budget
OBJECTIVES:
Standard disease-specific template to capture Program Goals, Objectives, Indicators and Targets.
DESCRIPTION:
Part of R7 Grant Agreement (former ‘Attachment A’)
Standardized (disease-specific) listing of :
– Goals
– Objectives
– Impact/Outcome measures & targets
– Output measures & targets - By “Service Delivery Area” (interventions and systems).
Targets are reviewed/agreed prior to Grant Signing
Required for complete application
Goals: 1 2
value Year Source
please select… please select… Please Select… please select…
Objective Number
1 2 3
Value Year Source 6 months 12 months
Please Select… please select… Please Select… please select… Please Select… please select…
Targets for year 1 and year 2 Indicator formulation
Please Select…
Objective description
* please specify source of measurement for indicator in case different to baseline source please select…
Program Objectives, Service Delivery Areas and Indicators
Service Delivery Area* Indicator formulation Baseline (if applicable) Baseline
please select…
Impact and outcome Indicators
Please Select…
Program Goal, impact and ouctome indicators
Objective / Indicator Number Country: Disease: Proposal ID: Malaria Attachment A to the proposal Program Details please select…
Fu
ll s
es
sio
n c
ov
eri
ng
th
e P
erf
orm
an
ce
Fr
am
ew
ork
LFA onsite Data Verification
Y1 Y2 Y3 Y4 Y5
Grant
Negotiation Phase 1 Phase 2
LFA onsite
Data Verificati
on #1
LFA onsite Data Verification: yearly and/or ad hoc
OBJECTIVES
:Methodology to verify the quality of programmatic data reported by Programs and capacity strengthening of PR (through recommendations for strengthening measures)
DESCRIPTION:
LFAs perform on-site data verifications at the service delivery points, re-aggregate data from primary records and compare re-counted numbers with results contained in
summary reports up to the national level.
Description of findings and recommendation of strengthening measures
LFA onsite Data Verificati on #2 LFA onsite Data Verificati on #5 LFA onsite Data Verificati on #4 LFA onsite Data Verificati on #3
Data Quality Audit Tool
Y1 Y2 Y3 Y4 Y5
Grant
Negotiation Phase 1 Phase 2
Progress Updates 1 Progress Updates 2 Progress Updates 3 Progress Updates 4 Progress Updates 5 Progress Updates 6 Progress Updates 7 Progress Updates 8 Progress Updates 9
On-Going Progress Reviews & Disbursements
Data Quality Audit (DQA) Tool
Version 0
Rollout Planned in October 2007
-OBJECTIVES
:Methodology to verify the quality of programmatic data reported by Programs (i.e., in depth and independent auditing of reported results
DESCRIPTION:
The DQA Tool is comprised of two components:
1. assessment of data management and reporting systems 2. verification of reported data for key indicators at selected
sites (trace and verify)
Conclusion with identification of follow up action
