Psychology 594L
Quantitative Behavioral Methods Missing Data T/R 3:40 – 5:00 Lago W-0272
1
Instructor Todd Abraham Email [email protected]
Office W-053 Lagomarcino Hall Phone 515-294-4948
Office Hours (1/12-3/27) M 10-12; T 5-6 (3/30-5/08): M 9-12
Prerequisites
Psych 501 or equivalent
Course Goals
As social science researchers, each of you will eventually encounter problems with missing data. While modern data collection methods can limit missingness, participants must always have the option of non- response to particular items. Problems with missing data are further compounded in longitudinal research where missingness within assessments and missingness across assessments are both likely to occur. Given the complexities involved with missing data, no single optimal solution that applies to all situations exists. Rather, my goal in this course is to establish concepts related to missing data
mechanisms, develop a foundation in both traditional and modern methods to handle missing data, and introduce tools available to handle missing data in your own research.
Recommended Text
Muthén, L.K., & Muthén, B. O. (1998-2012). Mplus User’s Guide (7th Ed.). Los Angeles, CA: Muthén
& Muthén. http://www.statmodel.com/ugexcerpts.shtml
Companion/Supplemental Readings
Little, R. J. A., & Rubin, D. B. (2002). Statistical analysis with missing data (2nd ed.). Hoboken, NJ:
John Wiley & Sons, Inc.
Students with Disabilities
Iowa State University is committed to assuring that all educational activities are free from discrimination and harassment based on disability status. All students requesting accommodations are required to meet with staff in Student Disability Resources (SDR) to establish eligibility. A Student Academic
Accommodation Request (SAAR) form will be provided to eligible students. The provision of
reasonable accommodations in this course will be arranged after timely delivery of the SAAR form to the instructor. Students are encouraged to deliver completed SAAR forms as early in the semester as possible. SDR, a unit in the Dean of Students Office, is located in room 1076, Student Services Building or online at www.dso.iastate.edu/dr/. Contact SDR by e-mail at [email protected] or by phone at 515-294-7220 for additional information.
2
Assessment Assignments
Assignments will require independent analysis, interpretation, and reporting of statistical results using the methods we cover in class and various statistical analysis software packages (e.g., SPSS, SAS, Mplus, etc.), as well as published literature. I will provide any empirical data necessary for assignments that you will have one week to complete.
Assignments: 80 points (4 assignments @ 20 points each) See Schedule for Dates Course Project
For the course project, you will develop a strategy and conduct analyses to deal with missing data in your own research area. If you do not have data to use for the project, please see me as early as possible so that we can obtain/produce data that will suit your needs.
Project Proposal: 10 points Friday 02/27/15
The project requires a short proposal (1-2 pp.) describing the data you intend to use, the missing data problem(s) in those data, and the analysis/analyses you plan to conduct. Your proposal can include supporting figures.
Course Project: 110 points Monday 03/30/15
Your completed project should include a short introduction to the research question/hypotheses, description of the methods/measures, a detailed description of your approach to handling the missing data, a summary of the analysis plan/results, and a short discussion of what your analyses reveal.
Final Course Grades
Course grades will be determined based on the total number of points earned on the assignments, project proposal, and course project based on the scale below.
Points Grade Points Grade Points Grade
186-200 A 166-171 B 144-149 C
178-185 A- 156-165 B- 139-143 C-
172-177 B+ 150-155 C+ < 138 D
Delivery and Format
Assignments, project proposals, and final projects can be submitted via electronic or paper copy (your choice). I assume most of you come from social science areas where APA format is dominant but strict adherence to APA style is not required. My only request regarding format involves use of tables or figures as supporting materials. Where tables/figures are included, please insert them at their point of relevance (inline), rather than adding tables/figures to the end of your document.
Tentative Course Schedule
3
Week Topics Required Readings and Assignments
1 02/17 02/19
Course Introduction Types of Missing Data
Missing Data Mechanisms
Schafer, J. L., & Graham, J. W. (2002). Missing data: Out view of the state of the art. Psychological Methods, 7, 147-177. doi: 10.1037//1082-989X.7.2.147
Graham, J. W. (2009). Missing data analysis: Making it work in the real world. Annual Review of Psychology, 60, 549-576. doi: 10.1146/annurev.psych.58.110405.085530
Jeličić, H., Phelps, E., & Lerner, R. M. (2009). Use of missing data methods in longitudinal studies:
The persistence of bad practices in developmental psychology. Developmental Psychology, 45, 1195-1199. doi: 10.1037/a0015665
Schlomer, G. L., Bauman, S., & Card, N. A. (2010). Best practices for missing data management in counseling psychology. Journal of Counseling Psychology, 57, 1-10. doi: 10.1037/a0018082
Assignment #1 - Literature Evaluation Due Tuesday 2/24/15 Project Proposal Due by Friday 02/27/15
2 02/24 02/26
Traditional Methods Single-Imputation
Methods
Engels, J. M., & Diehr, P. (2003). Imputation of missing longitudinal data: A comparison of methods.
Journal of Clinical Epidemiology, 56, 968-976. doi: 10.1016/S0895-4356(03)00170-7
Hedeker, D., Mermelstein, R. J., & Demirtas, H. (2007). Analysis of binary outcomes with missing data: Missing = smoking, last observation carried forward, and a little multiple imputation.
Addiction, 102, 1564-1573. doi:10.1111/j.1360-0443.2007.01946.x Tuesday: Assignment #1 (Literature Evaluation) Due
Thursday: Receive Assignment #2 – Single Imputation Methods Due Thursday 3/05/15 Friday: Project Proposal Due
4
Week Topics Required Readings and Assignments
3 03/03 03/05
Model-Based Approaches ML Methods
Enders, C. K. (2001). A primer on maximum likelihood algorithms available for use with missing data. Structural Equation Modeling: A Multidisciplinary Journal, 8, 128-141. doi:
10.1207/S15328007SEM0801_7
Acock, A. C. (2012). What to do about missing values. In H. Cooper, P. M. Camic, D. L. Long, A. T.
Panter, D. Rindskopf, & K. J. Sher (Eds.), APA handbook of research methods in psychology, Vol. 3: Data Analysis and research publication (pp. 27-50). Washington, DC: APA. doi:
10.1037/13621-002
Graham, J. W. (2003). Adding missing-data-relevant variables to FIML-based structural equation models. Structural Equation Modeling: A Multidisciplinary Journal, 10, 80-100. doi:
10.1207/S15328007SEM1001_4
Thursday: Receive Assignment #3: FIML Methods Due Thursday 3/12/15 Assignment #2 (Single Imputation Methods) Due
4 03/10 03/12
ML Methods (cont.) NMAR Problems Possible Solutions
Enders, C. K., Baraldi, A. N., & Cham, H. (2014). Estimating interaction effects with incomplete predictor variables. Psychological Methods, 19, 39-55. doi: 10.1037/a0035314
Hedeker, D., & Gibbons, R. D. (1997). Application of random-effects pattern-mixture models for missing data in longitudinal studies. Psychological Methods, 2, 64-78. doi: 10.1037/1082- 989X.2.1.64
Enders, C. K. (2011). Missing not at random models for latent growth curve analyses. Psychological Methods, 16, 1-16. doi: 10.1037/a0022640
Thursday: Receive Assignment #4: MI and NMAR Applications Due Thursday 3/26/15 Assignment #3 (FIML Methods) Due
5
Week Topics Required Readings and Assignments
5 03/17 03/19
No Class Meetings SPRING BREAK
6 03/24 03/26
Planned Missingness Interesting Problems
Graham, J. W., Taylor, B. J., Olchowski, A. E., & Cumsille, P. E. (2006). Planned missing data designs in psychological research. Psychological Methods, 11, 323-343. DOI: 10.1037/1082- 989X.11.4.323
Rhemtulla, M., Jia, F., Wu, W., & Little, T. D. (2014). Planned missing data designs to optimize the efficiency of latent growth parameter estimates. International Journal of Behavior Development, 38, 423-434. doi: 10.1177/0165025413514324 [Blackboard]
Thursday: Assignment #4 (MI & NMAR) Due
FINAL PROJECT PAPER DUE MONDAY 03/30/15