ISSUE QUESTIONS PERFORMANCE INDICATORS INFORMATION SOURCES
1.1 To what extent have the CCUPD and SFD
achieved the intended results? 1.1.1 Actual results achieved compared to intended results •
AUCC documentation – project proposals and reports
• Surveys – ILOs, participants,
organizations
1. Development Relevance
1.2 To what extent are the results relevant to the
needs of developing country partner organizations? 1.2.1 Degree of satisfaction of partner organizations with internship/ team projects 1.2.1 Partner organizations’ assessment of changes in capacity
• AUCC documentation – project
proposals and reports
• Surveys – ILOs, participants,
organizations
2.1 To what extent do CCUP and SFD project results contribute to CIDA’s medium and long-term priorities related to governance?
2.1.1 Project objectives compared with Canada Corp objectives and CIDA’s medium to long-term priorities
• Interviews with CIDA managers • Program administrative documents • Canada’s International Policy
Statement – A Role of Pride and Influence in the World: Development (2005)
2.2 To what extent are CCUP and SFD projects coherent with the priorities of the recipient country and CIDA’s programming in that country?
2.2.1 Project objectives compared with CIDA
country program objectives •
Interviews with CIDA managers
• Program administrative documents • Canada’s International Policy
Statement – A Role of Pride and Influence in the World: Development (2005)
• Country program frameworks
2.3 Are the projects’ resources, capacities and selected strategies appropriate and sufficient to achieve intended results?
2.3.1 Human, material and financial resources dedicated to the program
2.3.2 Satisfaction of participating universities, host organizations, students and faculty with resources available
• AUCC annual report • Project financial reports • In-kind contributions leveraged • Surveys – ILOs, participants,
organizations
2. Appropriateness
2.4 To what extent do CCUP and SFD overlap or duplicate other projects/ programs funded by CIDA or other Government departments?
2.4.1 Clear distinction between CUPP/ SFD learning opportunities and other funded programs 2.4.2 Availability of options for student
participation in other AUCC programs 2.4.3 Availability of options for student participation in other international learning activities
• Interviews with CIDA staff/ AUCC
staff
• Document review – other Government
departments, other CIDA branches and programs
ISSUE QUESTIONS PERFORMANCE INDICATORS INFORMATION SOURCES
3.1 What has been the impact of the projects in the areas of:
• good governance • local ownership
• capacity development of the host organizations
3.1.1 Partner organizations’ assessment of benefits in each of the three areas
3.1.2 Demonstrable changes in situation before and after project which are attributable to project activities
• AUCC documentation – project
proposals and reports
• Surveys – ILOs, participants,
organizations
• Interviews – selected ILOs, partner
organizations, participants 3.2 How effective are project activities overall in
meeting the CCUP and SFD purpose? 3.2.1 Aggregation of actual results compared to expected results for CCUP and SFD •
AUCC documentation – project proposals and reports
• Interviews – CIDA staff, AUCC staff
3.3 How has CIDA’s Gender Equality (GE) policy
been integrated in programming? 3.3.1 Coherence of AUCC gender strategy with CIDA strategy 3.3.2 Degree of application of GE strategy in projects
3.3.3 Male/ female ratio among participants. Supervisors
• CIDA’s GE policy
• AUCC GE policy and project
requirements
• Project descriptions and results • Participant profiles
3.4 To what extent have the CCUP and SFD
engaged the Canadian public? 3.4.1 Number and nature of public engagement activities in Canada 3.4.2 Level of interest in program from students, faculty and community.
• Promotional material • Communication strategy • Project reports
• ILO survey
3. Effectiveness
3.5 Were the results achieved cost-effective? 3.5.1 Results achieved compared with program costs (value for money) •
Project reports
• ILO survey • AUCC reports
4. Sustainability
4.1 To what extent are the projects’ results
sustainable? 4.1.1 Integration of internship/ team project with on-going activities of partner organization 4.1.2 Partner organization is sustainable
4.1.3 Funding available to build on project results 4.1.4 Clear intention to build on project results
• Project reports • ILO survey
• Survey/ interviews with selected
partner organizations
5.1 What factors influenced the achievement of
results – in Canada and overseas? 5.1.1 Analysis of enabling factors by participants, project managers •
Project reports
• ILO survey • AUCC reports
• Survey/ interviews with selected
partner organizations
5. Enabling Results
5.2 To what extent were risks assessed and
managed to achieve results? 5.2.1 Analysis of risks by participants, project managers 5.2.2 Mitigating strategies implemented
5.2.3 Actual results compared to expected results
• Project reports • ILO survey • AUCC reports
6.1 Is the program accessible to a broad range of
Canadian post-secondary institutions? 6.1.1 Number, type and location of participating institutions selected compared with applications •
AUCC reports
6.2 Are eligibility requirements and selection
processes consistent? 6.2.1 Eligibility requirements identified by AUCC are consistently applied among participating universities
• Project reports • ILO survey • AUCC reports
6.3 Do eligibility requirements restrict access for
students or faculty? 6.3.1 Number of applicants and area of study •
Project reports
• ILO survey • AUCC reports
6. Accessibility
6.4 Do selection processes ensure that participants have appropriate skills to carry out the project?
6.4.1 Satisfaction of ILOs with participants’ qualifications
6.4.2 Satisfaction of partners with participants’ qualifications
6.4.3 Actual results compared with expected results
• Project reports • ILO survey • AUCC reports
• Survey/ interviews with selected
partner organizations
7.1 To what extent is AUCC able to ensure consistent
quality of project results? 7.1.1 Selection, monitoring and evaluation procedures •
AUCC documentation – guidelines, procedures and reports
7.2 To what extent is AUCC able to adjust the
program to achieve results? 7.2.1 Monitoring and evaluation procedures 7.2.2 Level of risk analysis and number of problems identified
7.2.3 Management response to risk analysis and problems
• AUCC documentation – guidelines,
procedures and reports
• Project reports
7.3 To what extent is AUCC able to capture and
disseminate knowledge from project activities? 7.3.1 Number of project reports received 7.3.2 Level of analysis at central level 7.3.2 Number and range of dissemination activities
7.3.3 Use of material at local level
• Project reports • AUCC reports
• AUCC publications/ Web site use • Interviews with AUCC staff • Interviews with CIDA staff • ILO survey
• Survey/ interviews with selected ILOs/
partner organizations
7. Value Added by AUCC
7.4 What is the value-added by AUCC’s
administration of the projects? 7.4.1 Assessment of AUCC role by participating institutions (ILOs) 7.4.2 Assessment of AUCC role by CIDA staff 7.4.3 AUCC assessment of costs-benefits of administering the CCUP and SFD to the organization
• ILO survey and selected interviews • Interviews with CIDA staff