Social and Behavioral
Research and the Internet
Advances in Applied Methods and Research Strategies
Edited by
Marcel Das
CentERdata andTilburg School of Economics and Management Tilburg University, the Netherlands
Peter Ester
Rotterdam University, the Netherlands
Lars Kaczmirek
CESIS - Leibniz Institute for the Social Sciences Mannheim, Germany
О Routledge
| д к Taylor &. Francis Group
Preface xi
Chapter 1 Introduction 1
Marcel Das, Peter Ester, and Lars Kaczmirek
References 7
Part I Methodology in Internet Survey Research Chapter 2 Internet Survey Methods: A Review of
Strengths, Weaknesses, and Innovations 11
Jolene D. Smyth and Jennie E. Pearson
2.1 Introduction 11 2.2 A Brief History of Internet Surveys 12
2.3 Strengths and Weaknesses of Internet Surveys 14
2.4 Conclusions 37
References 39
Chapter 3 Internet Surveys as Part of a Mixed-Mode Design 45
Edith D. de Leeuw and Joop J. Hox
3.1 Introduction 45 3.2 Available Data Collection Methods 49
3.3 A Review of Empirical Evidence of
Mode Equivalence 53 3.4 Consequences of Mixed-Mode Design for
Questionnaire Development 61
3.5 Conclusions 65
References 72
Chapter 4 "True" Longitudinal and Probability-Based Internet
Panels: Evidence From the Netherlands 77
Annette C. Scherpenzeel and Marcel Das
4.1 Introduction 77 4.2 Longitudinal Panel Surveys 78
vi • Contents
4.3 New Developments in Survey Research 84
4.4 The LISS Panel 87 4.5 Conclusions 101
References 103
Chapter 5 How Representative Are Online Panels? Problems
of Coverage and Selection and Possible Solutions 105
Annette C. Scherpenzeel and Jelke G. Bethlehem
5.1 Introduction 105 5.2 Problems in Online Panels 107
5.3 Can We Correct the Bias? Weighting Adjustment.... 114
5.4 A Better Online Panel? 118
5.5 Conclusions 126
References 129
Chapter 6 Ethical Considerations in Internet Surveys 133
Eleanor Singer and Mick P. Couper
6.1 Introduction 133 6.2 Basic Ethical Principles: Confidentiality and
Informed Consent '. 134 6.3 Obtaining Consent for the Collection of Paradata:
Report of an Experiment 149
6.4 Conclusions 158
References 160
Part II Advanced Methods and Applications Chapter 7 How Visual Design Affects the Interpretability of
Survey Questions 165
Vera Toepoel and Don A. Dillman
7.1 Introduction 165 7.2 How Visual Information Is Processed 166
7.3 Research on How Visual Layout Influences
7.4 Needed Research on Which Visual Layout
Considerations Are Most Important 183
7.5 Conclusions 186
References 187
Chapter 8 Attention and Usability in Internet Surveys:
Effects of Visual Feedback in Grid Questions 191
Lars Kaczmirek
8.1 Introduction 191 8.2 Background 192 8.3 Hypotheses, Design, and Implementation 196
8.4 Results 199 8.5 Conclusions 207
References 211
Chapter 9 Using Interactive Features to Motivate and
Probe Responses to Open-Ended Questions 215
Marije Oudejans and Leah Melani Christian
9.1 Introduction 215 9.2 Theoretical Background and Hypotheses 216
9.3 Methods 222 9.4 Results 229 9.5 Conclusions 241 References 243
Chapter 10 Measuring Attitudes Toward Controversial Issues
in Internet Surveys: Order Effects of Open and
Closed Questioning 245
Peter Ester and Henk Vinken
10.1 Introduction 245 10.2 Background 247 10.3 Design and Implementation 251
10.4 Results 253 10.5 Conclusions 263
viii • Contents
Part III Data Quality: Problems and Solutions Chapter 11 Challenges in Reaching Hard-to-Reach Groups in
Internet Panel Research 271
Corrie M. Vis and Miquelle A. G. Marchand
11.1 Introduction 271 11.2 Hard-to-Reach Groups in Internet Panel Research...272
11.3 Hard-to-Reach Groups and the Recruitment of
the LISS Panel 274 11.4 Hard-to-Reach Groups Participating in the
LISS Panel 277 11.5 Response Rates in the LISS Panel 282
11.6 Conclusions 285
References 288
Chapter 12 Mode and Context Effects in Measuring
Household Assets 291
Arthur van Soest and Arie Kapteyn
12.1 Introduction 291 12.2 The HRS Internet Experiment 295
12.3 Asset Ownership 302 12.4 Amounts Held 308 12.5 Regression Models for Ownership and
Amounts Held 314 12.6 Conclusions 321 References 322
Chapter 13 Internet Survey Paradata 325
Dirk Heerwegh
13.1 Introduction 325 13.2 Types of Internet Survey Paradata 326
13.3 Potential Uses of Internet Survey Paradata 330 13.4 Collecting Internet Survey Paradata 334 13.5 Data Preparation and Analysis 335
13.6 Example Study: Use of Paradata to Assist in the
Development of Theory 336
13.7 Conclusions 342
Disclaimer 344 References 344
Chapter 14 Use of Eye Tracking for Studying Survey
Response Processes 349
Mirta Galesic and Ting Yan
14.1 Introduction 349 14.2 What Is Eye Tracking? 351
14.3 What Can Eye Tracking Do? 354 14.4 What Can Eye Tracking Do That the Other
Methods Cannot? 356 14.5 What Has Been Done With Eye Tracking? 357
14.6 Conclusions 366
References 368
Chapter 15 Can Biomarkers Be Collected in an Internet Survey?
A Pilot Study in the LISS Panel 371
Mauricio Avendano, Annette C. Scherpenzeel, and Johan P. Mackenbach
15.1 Introduction 371 15.2 Rationale for the Collection of Biomarker Data 373
15.3 The LISS Panel Biomarker Pilot 381
15.4 Results 388 15.5 Conclusions 403
References 409
Chapter 16 Discussion and Conclusions 413
Marcel Das, Peter Ester, and Lars Kaczmirek
Author Index 419 Subject Index 427
