EVALUATION QUESTIONS PARTICIPANT(S) EVALUATION
METHODS
How often does the curriculum change? Is it sufficient?
Partners Interview
Is the curriculum locally relevant?
Partners Residents
Interview Survey On average, how many cases
does each resident complete in a year?
Partners OR Case log
Has there been an increase in surgical cases since the
beginning of MSI?
Partners OR Case log
Are the residents adequately prepared to do surgeries when
they graduate?
Partners Graduating Residents
Interview Survey
Are the biweekly didactics effective in teaching residents?
Partners Residents
Interview Survey Do the additional skills courses
enhance the learning experience? If so, then how?
Residents Survey
Is there any feedback/evaluative process in place for residents
and surgeons?
Partners Residents
Interview Survey
How can the curriculum be improved?
Partners Residents
Interview Survey
33
2. Every year, recruit new residents into the program.
EVALUATION QUESTIONS PARTICIPANT(S) EVALUATION
METHODS
How do you recruit residents into the program?
Partners Interview
How many interns apply to the program?
Partners Applicant database
Are all of the residents from the Malawi College of Medicine?
Partners Interview
What criteria do you use when choosing residents?
Partners Interview
Do medical students rotating through KCH Surgery help with
recruitment?
Partners Interview
How can the recruitment efforts be improved?
Partners Interview
Are medical students interested in surgery as a career?
MCM Medical students Survey
Are medical students interested in applying to the KCH surgical
training program?
MCM Medical students Survey
What about the program appeals to medical students who plan to
apply to the program?
MCM Medical Students Survey
What are suggestions for improvement in the recruitment
efforts?
34
3. Every year, prepare residents to pass appropriate membership or fellowship
exams designated for certification by COSECSA.
EVALUATION QUESTIONS PARTICIPANT(S) EVALUATION
METHODS
What are ways the program is preparing residents for
COSECSA exams?
Partners Residents
Interview Survey
Are the biweekly didactics effective in preparing residents
for exams?
Partners Residents
Interview Survey
Do in-house exams correlate with COSECSA exams?
Partners FCS Residents
Interview Survey Do residents feel prepared to
pass the COSECSA certification exams?
Residents Survey
What are new ways that the program can prepare residents
for COSECSA exams?
Partners Residents
Interview Survey
4. Every year, allow residents to have access to digital surgical resources.
EVALUATION QUESTIONS PARTICIPANT(S) EVALUATION
METHODS
How often do the residents/surgeons use the
digital library?
Surgeons Residents
Survey
What digital resources do the residents/surgeons use the most? Clinical or Research
resources?
Surgeons Residents
35 Are there any digital resources
residents/surgeons would like to access?
Surgeons Residents
Survey
Long-term Objectives
5. Maintain tri-institutional partnership for long-term.
EVALUATION QUESTIONS PARTICIPANT(S) EVALUATION
METHODS
Do you think this partnership has been effective?
Partners Interview
What role does each partner play within this partnership?
Partners Interview
How can this partnership be improved?
Partners Interview
6. Every 5 years, re-accreditation of the 5-year Fellowship program by COSECSA.
EVALUATION QUESTIONS PARTICIPANT(S) EVALUATION
METHODS
What has changed since the last accreditation?
Partners Open-ended survey
Has the program met all COSECSA requirements?
Partners Survey
Is the program ready for the re- accreditation?
36
7. Maintain financial sustainability for the long-term.
EVALUATION QUESTIONS PARTICIPANT(S) EVALUATION
METHODS
Is the program financially sustainable?
Partners Interview
Will the Ministry of Health be able to cover all residents’
salaries starting in 2015?
Hospital Director/Ministry of Health
Interview
Is the department ready to establish a public-private
model?
Partners Interview
What are some successes to financial sustainability?
Partners Interview
What are some barriers to financial sustainability?
Partners Interview
How do the partners suggest the program maintain financial sustainability for the long-term?
Partners Interview
Goal: Increase and maintain the surgical workforce in Malawi.
Short-term Objectives
8. Every year, increase surgical personnel at Kamuzu Central Hospital.
EVALUATION QUESTIONS PARTICIPANT EVALUATION
METHODS
Has there been an increase in surgical personnel at KCH?
Partners Interview
Do the graduating residents plan to stay at KCH after finishing
residency?
37 Does KCH have the capacity to
have more surgeons?
Partners Interview
How many surgeons would be considered full capacity at
KCH?
Partners Interview
How has the program influenced the community?
Partners Residents
Interview Survey
Long-term Objectives
9. Challenge and prepare residents to become leaders in surgery in the Malawi
setting.
EVALUATION QUESTIONS PARTICIPANT EVALUATION
METHODS
What leadership positions do the residents hold in the
program?
Partners Residents
Interview Survey
Do the graduating residents feel prepared to lead surgical teams
in and outside of KCH?
Graduating residents Survey
Does the curriculum include leadership development?
Partners Residents
38
10.As the surgical workforce increases, enable certified surgeons to build and
develop programs at other central or district hospitals.
EVALUATION QUESTIONS PARTICIPANT EVALUATION
METHODS
Are certified surgeons able to develop programs at other central or district hospitals?
Partners Interview
Are residents interested in working at other central
hospitals?
Residents Survey
Are residents interested in working at district hospitals?
Residents Survey
Goal:Develop global surgical research capacity to benefit all stakeholders.
Short-term Objectives
11.Every year, involve local residents and surgeons in current active research.
EVALUATION QUESTIONS PARTICIPANT EVALUATION
METHODS
How many residents are involved in research?
Partners/Surgeons Resident
Survey
How much time do surgeons/residents spend on research? Surgeons Resident Survey Do residents/surgeons have enough time to do research?
Surgeons Resident
Survey
What role do the residents/surgeons have in
research project(s)?
Surgeons Resident
39 Has the trauma, burns, and HIV
registry been helpful with conducting research?
Surgeons Survey
How can the program improve and maintain the database
registries?
Partners/Surgeons Resident
Interview Survey
12.Every year, teach research methodology and how to apply for international
research grants.
EVALUATION QUESTIONS PARTICIPANT EVALUATION
METHODS
Is research methodology taught within the curriculum?
Partners/Surgeons Residents
Survey
Have you applied for international research grants?
Surgeons Residents
Survey
Have surgeons/residents help submit for IRB approval for a
project?
Surgeons Residents
Survey
How was UNC residents’/medical students’ experience doing research at
KCH?
UNC Residents/medical students
Survey
How can the program improve in involving faculty surgeons
and residents in research projects at KCH? Partners/Surgeons Residents UNC Residents/medical students Survey
40
13.In one year, residents and surgeons produce original research and first author