ONLINE SURVEY DOCUMENT
1. The purpose of this research is to understand how international NGOs are incorporating mobile technologies into their monitoring and evaluation (M&E) systems in health programming. There are 35 questions. Most are multiple choice. Depending on how much your organization has used mobile technology and how much you want to tell me about the subject; this survey may take between 15-25 minutes.There are no foreseeable risks or discomforts to participating in this research. One possible benefit of participating in the research is that you can receive an advance copy of the findings and your voice and contribution may have an impact on how mobile technology is incorporated into M&E systems. All results will be reported at the aggregate level and NO NAMES OF
ORGANIZATIONS will be used in the publicly disseminated findings. Results will be presented in such a way that there should be a minimum number of respondents at each level of reporting and it should not be possible to identify any respondent organizations or individuals.
Your participation in this research is voluntary and refusal to participate will involve no penalty or loss of access to the findings. You may discontinue your participation at any time.
This survey is one part of a research study that will be used for a DrPH
dissertation. Should you have any questions about this research you may contact me Kerry Bruce ([email protected]) or Skype ID kerrybruce. You may also
contact Dr. John E. Paul (Associate Professor, Health Policy and Management, Gillings School of Global Public Health) at +1 9199667373
or [email protected]. This research has been reviewed and approved by the Institutional Review Board at UNC, Chapel Hill. You may also contact them at +1 9199663113 or email [email protected] with any issues or concerns. Do you consent to participate in this research?
(this is a required question)
1 Yes
2 No (if no skip to end)
2. What organization do you work for? If you do not see the name of your organization, please select Other and type the name in the Other response box. If you prefer not to responded, please select Choose Not to Respond at the bottom of the list. (This is a required question.)
(Pre-populated list)
3. Which office do you work for and what is your role? (Responses 1-2 answer questions for Track A questions.) (Responses 3-4 answer questions for Track B questions.) (Questionnaire remerges at Question 15)
1. HQ or Regional office – M&E 2. HQ or Regional Office – Not M&E (health, IT, programs, Management, etc…) 3. Country or Field Office – M&E 4. Country or Field Office 4. Mobile Technology Experience
These questions are about your organization's previous experience with using mobile technology. For the purposes of this survey, the following definitions apply. Mobile technology: the use of mobile phones, tablets or personal digital assistants (PDAs). Mobile technology may encompass service delivery, data collection, logistics or the monitoring and evaluation of programs.
Monitoring and Evaluation (M&E) systems: the broad system your organization uses to know that its programs are proceeding on target and achieving their goals (monitoring) and the systems you are using to collect information to
measure your progress towards your goals and or your impact (evaluation). 4A. Has your organization ever used mobile technology to support M&E systems? 4B. Has your workplace ever used mobile technology to support your M&E systems?
1. Yes 2. No
3. Don’t Know
5A. How convinced are you that using mobile technology would make your organization’s M&E system…
5B. How convinced are you that using mobile technology would make your workplace’s M&E system …
VERY
CONVINCED CONVINCED NEUTRAL CONVINCED NOT VERY NOT AT ALL CONVINCED NOT SURE
More efficient? More Effective? More Cost Effective?
6A. Does your organization intend to use mobile technology to collect data, provide services or support M&E systems in the next year?
6B. Does your workplace intend to use mobile technology to collect data, provide services or support your M&E system in the next year?
1. Yes 2. No
3. Don’t Know
7A. What platforms has your organization ever used or tried? (check all that apply) 7B. What platform has your workplace ever used or tried? (check all that apply)
Have not used one yet FieldCenter mSwali
Acquee.com FormHub OpenDataKit
ChildCount+ FrontlineSMS RapidSMS
DataWinners iFormBuilder TexttoChange
Dimagi – CommCare Interactive Sales Solutions ViewWorld
DoForms.com Jana Voxiva
eCollect Magpi / Episurveyor Other
EMIT Mobenzi Researcher
Other (please specify) _____________________
8A. What program areas does your organization work in and in which areas have you used mobile technology? (check all that apply)
8B. What program areas do your project(s) work in and in which areas have you used mobile technology? (check all that apply)
CURRENT PROGRAM AREA MOBILE TECHNOLOGY USED
HIV /AIDS Health Financing
Human Resources for Health Primary Health Care
Maternal and Child Health
Reproductive Health / Family Planning Infectious / Communicable Disease Non-Communicable Disease Neglected Tropical Diseases
Emergency / Relief Health Care Services Nutrition Services
Orphans and Vulnerable Children Pharmaceutical Support
Supply Chain Management Social Marketing
Health Information Systems Monitoring and Evaluation Systems Survey Data Collection
Capacity Building / health System Strengthening Wash Sanitation and Hygiene Programs
Non Health Area Other
Other (please specify) _____________________
9A. For your organization’s current project (s) that use mobile technology for M&E systems, does mobile technology…
9B. For your workplace’s current project(s) that use mobile technology for M&E systems, does mobile technology…
VERY
FREQUENTLY FREQUENTLY OCCASIONALLY RARELY RARELY VERY NEVER NA
Improve the precision of health measurements?
Contribute to better health outcomes for program beneficiaries Improve data quality?
Lead to better use of data for decision making?
10A. Do you think that the current mobile technology platforms have sufficient features and functions to meet the M&E systems needs for your organization? 10B. Do you think that the current mobile technology platforms have sufficient features and functions to meet the M&E systems needs for your workplace?
1. Yes, sufficient 2. No 3. Unsure /
Undecided What additional features or functions do you feel you need (please specify) __________________ 11A. Do you think that mobile technology providers offer sufficient training
materials to meet you organization’s needs?
11B. Do you think that mobile technology providers offer sufficient training materials to meet your workplace needs?
1. Yes, sufficient 2. No 3. Unsure /
Undecided What additional training should they offer? (please specify) __________________
12A. Does your organization have a specific project or data collection need right now, where mobile technology might be the best answer, but is not being used? 12B. Does your workplace have a specific project or data collection need right now, where mobile technology might be the best answer, but is not being used?
1. Yes 2. No 3. Not Sure If Yes, Specify ___________________________
13A. How does your organization perceive the risk of integrating mobile technology into M&E systems?
13B. How does your workplace perceive the risk of integrating mobile technology into M&E systems?
1. High Risk 2. Medium Risk 3. Low Risk 4. No Risk 5. Not Sure What are the risks the organization might face? ___________________________
14A. Are mobile technologies compatible with your organization’s current data collection and storage systems?
14B. Are mobile technologies compatible with your workplace’s current data collection and storage systems?
1. Yes 2. No 3. Not Sure 15. Your organization Use of Mobile Technology
In this section, I am looking for information about centralized actions your organization is taking to implement or adopt
mobile technology. By organization I mean your entire organization, meaning all of your country offices, your field offices and your HQ office
together.
Does your overall organization have a written policy or strategy paper on the integration of mobile technology into your systems and practice?
1. Yes 2. No
16. Do staff at all levels in your organization understand how they might use mobile technology to improve their M&E systems?
1. Yes at all levels 2. Yes at most levels 3. No, most do not know 4. No I don’t think anyone knows Is there a specific level of staff that understands more than others? ________________________ 17. Readiness for Mobile Technology in M&E Systemsv
Please select the response that best reflects what you think is your organizational position on the implementation of mobile technology into M&E systems.
In each question, "We" refers to your global organization. I am trying to understand the readiness of your entire global organization to implement mobile technology.
For example, We (as an organization) are committed to implementing mobile technology for M&E. for Mobile Technology in M&E Systems
DISAGREE SOMEWHAT
DISAGREE NEITHER AGREE NOR DISAGREE SOMEWHAT AGREE AGREE We know what steps are
involved in implementing mobile technology for M&E systems We know what we need to do to implement mobile technology for M&E
We know what resources we will need to implement mobile technology for M&E
We can manage the politics of implementing mobile
technology for M&E
We can coordinate tasks so that implementation of mobile technology in M&E systems goes smoothly.
We want to implement mobile technology for M&E.
We are motivated to implement mobile technology for M&E We can keep the momentum going in implementing mobile technology for M&E
v
Note: The statements were randomized for each respondent to reduce missing data on specific questions and to avoid question bias.
We can support staff as they adjust to implementing mobile technology for M&E
We believe that implementing mobile technology for M&E will benefit our systems and our beneficiaries
We have the skills to implement mobile technology for M&E We need to implement mobile technology for M&E
We are committed to implementing mobile technology for M&E We are determined to
implement mobile technology for M&E
We have the staff to implement mobile technology for M&E We can get staff invested in implementing mobile technology for M&E We can keep track of our progress of implementing mobile technology.
We can handle the challenges that might arise in implementing mobile technology for M&E.
18. From your perspective, how ready is your global organization to implement the use of mobile technology into M&E systems?
1. Not at all ready 2. A little ready 3. More ready than not ready 4. Ready 5. Very Ready 19. Are there people in your organization who help link you with others (ex:
platform providers, technical assistance, training or other people or organization with experience) so you can use mobile technology in M&E systems?
1. Yes 2. No 3. Not Sure If Yes, are the people from HQ or the Country Office who provide links? ______________________ 20. In your organization, are there more supporters or detractors for the
inclusion of mobile technology into M&E systems?
1. More supporters 2. More detractors 3. About equal 4. Not sure
21. Which department(s) in your organization is/are involved in integrating mobile technology use into M&E systems (check all that apply)
Monitoring and Evaluation Unit Information Technology / Management Information System Unit
Technical / Program Unit Specific ICT Unit
Country Offices as individual Units Administrative / Financial Unit
Leadership / Executive Team Other ______________________________ 22. Does your organization use either overhead or unrestricted funding (i.e. non-project specific
funding) to support the use of mobile technology for M&E systems? If so, how? (check all that apply)
Yes – dedicated personnel time Yes –equipment (phones, tablets, chargers) Yes – subscriptions to provider services/
platforms
Yes – training
Yes – help desks Yes – discussion boards or working groups
No – Nothing Not sure
23. Has your organization conducted any formal or informal evaluations of the use of mobile technology in M&E systems?
1. Yes, more than one evaluation
2. Yes, only one evaluation 3. No
4. Not sure 24. From your perspective, is the senior leadership of your
organization supportive of using mobile technology for M&E systems?
1. Yes 2. No 3. Not Sure 25. Has your organization set specific targets for the inclusion of
mobile technology into your M&E systems?
1. Yes 2. No 3. Not Sure 26. Have you observed that other organizations like yours are using
mobile technology as part of their M&E systems?
1. Yes 2. No 3. Not Sure 27. Is gender a barrier to the adoption of mobile technologies into
M&E systems?
1. Yes 2. No 3. Not Sure Why? ____________________________________________
28. What role will data security play in your organization’s adoption of mobile technology into your M&E systems?
1. Very important 2. Important 3. Moderately important 4. Of little importance 5. Unimportant 6. Not Applicable What role will data security play in the adoption of mobile technology?
29. What role have donors played in the adoption of mobile technology into your M&E systems?
1. Very important 2. Important 3. Moderately important 4. Of little importance 5. Unimportant 6. Not Applicable Please explain _____________________________________________________________________ 30. What are the major barriers to integrating mobile technology into M&E systems in health
programs?
__________________________________________________________________________________ __________________________________________________________________________________ 31. What are the facilitators that will help people to integrate mobile technology into M&E systems
in health programs?
______________________________________________________________________________ ______________________________________________________________________________
32. What is your age? 1. <25 years old
2. 25-35 years old 3. 36-45 years old 4. 46-55 years old 5. 56-65 years old 6. >65 years old
33. Are you male or female? 1. Male
2. Female
34. What country are you based in? (Drop down, pre-
populated list) 35. Would you describe yourself as a person
who likes to try new innovation or someone who likes to wait until the evidence is in before trying something?
1. I am always the first person to try new things, especially with technology.
2. I am sometimes the first person to try new things, especially with technology.
3. I am not usually the first person to try new things, I prefer to see the evidence of efficacy. 4. I definitely want to see the evidence before I
try new things, especially with technology. The survey is now complete. I appreciate the time you took to fill in this survey.
Please feel free to forward the survey link to other INGO staff working in health programming. If you would like an advance copy of the findings from this research, please put your email address in the box below or send me an email at [email protected]. Your email address will not be linked with your responses and will be held in confidence.