Use of Tablet Computers to Implement
the Local Governance Performance
Index (LGPI) in Tunisia
Lindsay J. Benstead - Assistant Professor of Political Science, Portland State University
Kristen Kao - Research Fellow, The Program on Governance and Local Development, University of Gothenburg Pierre F. Landry - Professor of Political Science, Director of Global China Studies, New York University - Shanghai
Ellen M. Lust - Professor of Political Science, University of Gothenburg, Director of the Program on Governance and Local Development Dhafer Malouche - Associate Professor of Statistics, University of Carthage
-‐
What are the poten+al benefits and drawbacks
to CAPI?
-‐
Drawn from Experience with Local Governance
Performance Index (LGPI) in Tunisia, 2015
-‐
Examine Opportuni+es, Challenges and
Recommenda+ons across the Survey Process.
Inspired by Public Administra+on Performance Index (PAPI), Vietnam
Designed to:
-‐ Provide a catalyst for policy-‐relevant research on governance and local development
-‐ Develop a database of consistent measurement tools to tap into varia+on at na+onal and sub-‐na+onal levels
-‐ Answer key theore+cal and substan+ve ques+ons regarding governance and development
-‐ Disseminate findings through academic publica+ons and on-‐the-‐ ground workshops and websites, through local partnerships
Measures dimensions of local performance:
-‐ Poli+cal Par+cipa+on, Corrup+on, Ver+cal Accountability, Service Delivery -‐-‐ Security, Health, Educa+on
Sampling
Process:
-‐
6 of 24 governorates
-‐
Households randomly sampled using PPS
-‐
Points of light data used as a proxy for local popula=on
density
Sampling
Opportuni+es:
-‐
Random selec=on of the respondent (the “Kish grid”) greatly
-‐
Can determine if the interviewers went to the correct
loca=on
Challenges:
-‐
Does not fully solve the challenge of sampling manipula=on
by interviewers
Recommenda+ons:
-‐
Time-‐stamps should be used to aid in data forensics.
-‐
Do not allow survey to go backwards and redo the Kish table.
-‐
Program the =mer to stop when interviews are suspended
and to note when cases are closed and reopened
The Tool and the Technology
-‐ Import tablets into the country or purchase locally
-‐ Research the benefits of alterna+ve survey programs
-‐ Consider specific needs (language capabili+es), before
purchasing
Ques+onnaire Development and Programming
Opportuni+es:
-‐ The development and implementa=on of complex ques=onnaires
-‐ Capabili=es for randomiza=on of ques=ons and response order
-‐ Embedding of color photos, audio clips and QxQs
-‐ Interviewer instruc=ons and rules for answering ques=ons are easy
Challenges:
-‐ Mistakes can be easily made in programming complex surveys
-‐ Steep learning curve in implemen=ng surveys by tablet
Recommenda+ons:
-‐ Budget =me for learning the capabili=es and limita=ons of the soSware
-‐ Program the survey directly into the tablets
-‐ Create standardized scheme for coding; implement early on
-‐ Think through how earlier randomiza=on procedures may affect later
ones
Pre-‐Tes+ng and Pilo+ng
Opportuni+es:
-‐
Maximum benefit from a field pilot because the data
is coded immediately
-‐
Easier and less conspicuous use of recording focus
groups, behavior coding, and cogni=ve interviewing
Challenges:
-‐
Programming must be verified to avoid costly errors
-‐
Pre-‐tes=ng and pilo=ng is both about programming
and ques=on wording and should be done on tablets
Recommenda+ons:
-‐
Run pre-‐tests mul=ple =mes and pilot a few weeks
before you want to field
-‐
Write the costs of using these techniques into grants
and contracts
Field Material Prepara+on
Opportuni+es:
-‐
Tablets allow for easy revisions to the survey, even as
fielding approaches
Challenges:
-‐
Tablets require addi=onal considera=ons to ensure that
researchers are not in the field without appropriate
survey instruments
Recommenda+ons:
-‐
Implemen=ng surveys with tablets requires adjustments
in field material prepara=on
Interviewer Recruitment and Training
Opportuni+es:
-‐
Interviewers appeared to generally enjoy and prefer working with
tablets
Challenges:
-‐
Enumerators must learn how to use the tablets
-‐
Requires beYer prepara=on of field materials
-‐
Enumerators could be targets for theS.
Recommenda+ons:
-‐
Hire interviewers who are comfortable with technology
-‐
Create a system for locking and storing tablets
Conduc+ng Interviews
Opportuni+es:
-‐ Cuts out hassle of paper-‐based surveys
-‐ Less poten=al for interviewer error in using showcards or other tools
-‐ Assures addi=onal data collected is linked to the correct interviews
Challenges:
-‐ Interviewers need to remember to charge tablets, upload surveys, etc.
-‐ Poor connec=vity makes uploading new survey versions difficult
-‐ Changing previous responses can disrupt randomiza=on paYerns
-‐ Difficul=es for supervisors to review the survey and track quality
Recommenda+ons:
-‐ Implement measures to assure the technology works
-‐ Find ways to help supervisors review the survey
-‐ Be strategic about where it is possible to go backwards in the survey
Quality-‐Control and Data Forensics
Opportuni+es:
-‐ Reviewing data every night allows for early iden=fica=on of need for more training or possible chea=ng
-‐ Recording interviews may be a way to validate data -‐ Detec=on of errors before survey is complete
-‐ Reduces chance that human error affects the data collec=on process
Challenges:
-‐ Data uploading for review in the field due to lack of connec=vity -‐ Labeling and cleaning variables can be =me consuming
Recommenda+ons:
-‐ Use tablet features in data forensics, par=cularly =me stamps.
-‐ Require supervisors to approve surveys before they enter the database -‐ Upload data as soon as possible to the servers
-‐ Check the background of survey firm and have strict protocols in place should data falsifica=on occur
-‐ Download all versions of collected data that are available
Addi+onal Considera+ons
General infrastructure issues/environments:
-‐ While tablets do not require a permanent connec=on to the internet, it is
advisable to ensure that country or region where the study is conducted has a basic public service infrastructure
Ethical considera+ons:
-‐ Tablets streamline data collec=on, boost interviewer professionalism, and may
offer respondents an increased sense of confiden=ality, ul=mately increasing par=cipa=on and item response rates. Yet, the technology also presents new risks to poten=al par=cipants.
Future Research
-‐
Mode studies (e.g. face-‐to-‐face vs. tablet interviews)
should be implemented to assess how the use of
tablet computers affects par+cipa+on rates, item
response rates, and data quality, especially for
sensi+ve ques+ons
-‐
Tablets offer unprecedented opportuni+es for
survey experiments, which can include audio or
video recordings, photos, or standard text, offering
different frames, ques+on wordings, or visual s+muli
