Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Standardized Mean Differences Between the Head Start and Comparison Groups on All Covariates Before and After Propensity Score Weighting
Figure 7
Moderation of the Head Start Effect on Children’s Literacy Skills in the Spring of Kindergarten by CLASS Emotional Support
REFERENCES
Abbott-Shim, M., Lambert, R., & McCarty, F. (2003). A comparison of school readiness
outcomes for children randomly assigned to a Head Start program and the program’s wait list. Journal of Education for Students Placed at Risk, 8(2), 191–214.
doi:10.1207/S15327671ESPR0802_2
Achenbach, T. M., & Rescorla, L. A. (2000). Manual for the ASEBA Preschool Forms and Profiles. Burlington, VT: University of Vermont, Research Center for Children, Youth, and Families.
Aikens, N., Bush, C., Gleason, P., Malone, L., & Tarullo, L. (2016). Tracking quality in Head Start Classrooms: FACES 2006 to FACES 2014. OPRE Report #2016-82. Retrieved from https://www.mathematica-mpr.com/our-publications-and-
findings/publications/tracking-quality-in-head-start-classrooms-faces-2006-to-faces-2014 Albrecht, D. E., Albrecht, C. M., & Albrecht, S. L. (2000). Poverty in nonmetropolitian America:
Impacts of industrial, employment, and family structure variables. Rural Sociology, 65(1), 87–103. doi:10.1111/j.1549-0831.2000.tb00344.x
Allard, S. (2008). Rethinking the safety net: Gaps and instability in help for the working poor.
Focus, 26(1), 27–32. Retrieved from
http://www.irp.wisc.edu/publications/focus/pdfs/foc261d.pdf
Ansari, A., & Pianta, R. C. (2018a). The role of elementary school quality in the persistence of preschool effects. Children and Youth Services Review, 86(1), 120–127.
doi:10.1016/j.childyouth.2018.01.025
Ansari, A., & Pianta, R. C. (2018b). Variation in the long-term benefits of child care: The role of classroom quality in elementary school. Developmental Psychology, 54(10), 1854–1867. doi:10.1037/dev0000513
Austin, P. C. (2009). Balance diagnostics for comparing the distribution of baseline covariates between treatment groups in propensity-score matched samples. Statistics in Medicine, 28(25), 3083–3107. doi:10.1002/sim.3697
Austin, P. C., & Stuart, E. A. (2015). Moving towards best practice when using inverse
probability of treatment weighting (IPTW) using the propensity score to estimate causal treatment effects in observational studies. Statistics in Medicine, 34(28), 3661–3679. doi:10.1002/sim.6607
Bailey, D. H., Duncan, G. J., Odgers, C. L., & Yu, W. (2016). Persistence and fadeout in the impacts of child and adolescent interventions. Journal of Research on Educational Effectiveness, 10(1), 7–39. doi:10.1080/19345747.2016.1232459
Bailey, D. H., Jenkins, J. M., & Alvarez-Vargas, D. (2019). Complementarities between early educational intervention and later educational quality? A systematic review of the
sustaining environments hypothesis. EdWorkingPaper: 19–99. Retrieved from Annenberg Institute at Brown University: http://www.edworkingpapers.com/ai19-99 Barbarin, O. A., Early, D., Clifford, R., Bryant, D., Frome, P., Burchinal, M., . . . Pianta, R.
(2008). Parental conceptions of school readiness: Relation to ethnicity, socioeconomic status, and children's skills. Early Education & Development, 19(5), 671–701.
doi:10.1080/10409280802375257
Barnett, W. S. (1995). Long-term effects of early childhood programs on cognitive and school outcomes. The Future of Children, 5(3), 25–50. doi:10.2307/1602366
Barnett, W. S. (2011). Four reasons the United States should offer every child a preschool education. In E. Zigler, W. S. Gilliam, & W. S. Barnett (Eds.), The pre-k debates: Current controversies and issues (pp. 34–39). Balimore, MD: Brookes Publishing Company.
Barnett, W. S., Epstein, D. J., Friedman, A. H., Sansanelli, R. A., & Hustedt, J. T. (2009). The state of preschool 2009: State preschool yearbook. Retrieved from http://nieer.org/state- preschool-yearbooks/the-state-of-preschool-2009:
Barnett, W. S., & Friedman-Krauss, A. H. (2016). The state(s) of Head Start. Retrieved from http://nieer.org/headstart:
Barnett, W. S., Friedman-Krauss, A. H., Gomez, R., Horowitz, M., Weisenfeld, G. G., Clarke Brown, K., & Squires, J. H. (2015). The state of preschool 2015: State preschool yearbook. Retrieved from http://nieer.org/sites/nieer/files/2015%20Yearbook.pdf: Barnett, W. S., Jung, K., Friedman-Krauss, A., Frede, E. C., Nores, M., Hustedt, J. T., . . .
Daniel-Echols, M. (2018). State prekindergarten effects on early learning at kindergarten entry: An analysis of eight state programs. AERA Open, 4(2), 1–16.
doi:10.1177/2332858418766291
Barnett, W. S., Robin, K. B., Hustedt, J. T., & Schulman, K. L. (2003). The state of preschool 2003: State preschool yearbook. Retrieved from http://nieer.org/state-preschool- yearbooks/state-preschool-2003:
Bassok, D. (2010). Three essays on early childhood education policy. Stanford, CA: Stanford University.
Bassok, D. (2012). Competition or collaboration? Head Start enrollment during the rapid expansion of state pre-kindergarten. Educational Policy, 26(1), 96–116.
doi:10.1177/0895904811428973
Bassok, D., Fitzpatrick, M., Greenberg, E., & Loeb, S. (2016). Within- and between-sector quality differences in early childhood education and care. Child Development, 87(5), 1627–1645. doi:10.1111/cdev.12551
Bassok, D., Gibbs, C. R., & Latham, S. (2018). Preschool and children’s outcomes in elementary school: Have patterns changed nationwide between 1998 and 2010? Child Development, 00(0), 1–23. doi:10.1111/cdev.13067
Bassok, D., Latham, S., & Rorem, A. (2016). Is Kindergarten the new First Grade? AERA Open, 2(1), 1–31. doi:10.1177/2332858415616358
Belanger, K., & Stone, W. (2008). The social service divide: Service availability and
accessibility in rural versus urban counties and impact on child welfare outcomes. Child Welfare, 87(4), 101–124. Retrieved from
https://www.ncbi.nlm.nih.gov/pubmed/19391469
Bender, S. L., Fedor, M. C., & Carlson, J. S. (2011). Examining protective factors and risk factors in urban and rural head start preschoolers. Journal of Community Psychology, 39(8), 908–921.
Bierman, K. L., Nix, R. L., Heinrichs, B. S., Domitrovich, C. E., Gest, S. D., Welsh, J. A., & Gill, S. (2014). Effects of Head Start REDI on children’s outcomes 1 year later in different kindergarten contexts. Child Development, 85(1), 140–159.
doi:10.1111/cdev.12117
Bogard, K., & Takanishi, R. (2005). PK-3: An aligned and coordinated approach to education for children 3 to 8 years old. Social Policy Report, 19(3), 1–24. Retrieved from
https://www.fcd-us.org/pk-3-an-aligned-and-coordinated-approach-to-education-for- children-3-to-8-years-old/
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009). Introduction to meta- analysis. Chichester, England: John Wiley & Songs, Ltd.
Bowman, B. T., Burns, M. S., & Donovan, S. (Eds.). (2001). Eager to learn: Educating our preschoolers. Washington, DC: National Academy Press.
Bradley, R. H., McKelvey, L. M., & Whiteside-Mansell, L. (2011). Does the quality of
stimulation and support in the home environment moderate the effect of early education programs? Child Development, 82(6), 2110–2122. doi:10.1111/j.1467-
8624.2011.01659.x
Broekhuizen, M. L., Mokrova, I. L., Burchinal, M. R., Garrett-Peters, P. T., & The FLP Key Investigators. (2016). Classroom quality at pre-kindergarten and kindergarten and children’s social skills and behavior problems. Early Childhood Research Quarterly, 36(1), 212–222. doi:10.1016/j.ecresq.2016.01.005
Bronfenbrenner, U. (1979). The ecology of human development: Experiements by nature and design. Cambridge, MA: Harvard University Press.
Bronfenbrenner, U., & Morris, P. A. (1998). The ecology of developmental processes. In W. Damon & R. M. Lerner (Eds.), Handbook of child psychology: Theoretical models of
human development, Volume 1, 5th ed. (pp. 993–1028). Hoboken, NJ: John Wiley & Sons Inc.
Bronfenbrenner, U., & Morris, P. A. (2006). The bioecological model of human development. In W. Damon & R. M. Lerner (Eds.), Handbook of child psychology, Vol. 1: Theoretical models of human development (6th ed., pp. 793–828). Hoboken, NJ: Wiley.
Brooks-Gunn, J., & Markman, L. B. (2005). The contribution of parenting to ethnic and racial gaps in school readiness. The Future of Children, 15(1), 139–168.
Bruer, J. T. (2001). A critical and sensitive period primer. In D. B. Bailey, J. T. Bruer, F. J. Symons, & J. W. Lichtman (Eds.), Critical thinking about critical periods. (pp. 3–26). Baltimore, MD, US: Paul H Brookes Publishing.
Burchinal, M. R., Carr, R. C., Vernon-Feagans, L., Blair, C., Cox, M., & The Family Life Project Key Investigators. (2018). Depth, persistence, and timing of poverty and the development of school readiness skills in rural low-income regions: Results from the Family Life Project. Early Childhood Research Quarterly, 4(45), 115–130.
doi:https://doi.org/10.1016/j.ecresq.2018.07.002
Burchinal, M. R., Foster, T. J., Bezdek, K. G., Bratsch-Hines, M., Blair, C., & Vernon-Feagans, L. (2020). School-entry skills predicting school-age academic and social–emotional trajectories. Early Childhood Research Quarterly, 51, 67–80.
doi:10.1016/j.ecresq.2019.08.004
Burchinal, M. R., Magnuson, K. A., Powell, D., & Soliday Hong, S. (2016). Early childcare and education. In R. M. Lerner, M. H. Bornstein, & T. Leventhal (Eds.), Handbook of child psychology and developmental science (7th ed., pp. 223–267). Hoboken, NJ: Wiley. Burchinal, M. R., Vernon-Feagans, L., Vitiello, V., Greenberg, M., & The FLP Key
Investigators. (2014). Thresholds in the association between child care quality and child outcomes in rural preschool children. Early Childhood Research Quarterly, 29(1), 41–51. doi:http://dx.doi.org/10.1016/j.ecresq.2013.09.004
Caldwell, B. M., & Bradley, R. H. (1984). Home Observation for Measurement of the Environment. Little Rock, AR: University of Arkansas at Little Rock.
Camilli, G., Vargas, S., Ryan, S., & Barnett, W. S. (2010). Meta-analysis of the effects of early education interventions on cognitive and social development. The Teachers College Record, 112(3), 579–620. Retrieved from
http://www.gregorycamilli.info/papers/early%20education%20interventions.pdf Campbell, F. A., Ramey, C. T., Pungello, E., Sparling, J., & Miller-Johnson, S. (2002). Early
childhood education: Young adult outcomes from the Abecedarian Project. Applied Developmental Science, 6(1), 42–57. doi:10.1207/S1532480XADS0601_05
literacy, and mathematics skills. Early Childhood Research Quarterly, 47(2), 218–228. doi:https://doi.org/10.1016/j.ecresq.2018.12.010
Carrow-Woolfolk, E. (1995). Oral and Written Language Scales (OWLS). Circle Pines, MN: American Guidance Service.
Center for Law and Social Policy. (2010). Head Start by the Numbers: 2009 PIR Profile. Retrieved from https://files.eric.ed.gov/fulltext/ED537509.pdf
Chaudry, A., Morrissey, T., Weiland, C., & Yoshikawa, H. (2017). Cradle to kindergarten: A new plan to combat inequality. New York, NY: Russell Sage Foundation.
Chertow, D. S. (1968). Project Head Start, the urban and rural challenge: Final report submitted to Office of Economic Opportunity. Doctoral dissertation, Retrieved from Syracuse University.
Cheung, M. W.-L. (2015). metaSEM: An R package for meta-analysis using structural equation modeling. Frontiers in Psychology, 5(1521), 1–7. Retrieved from
https://doi.org/10.3389/fpsyg.2014.01521
Cheung, M. W.-L. (2019). A guide to conducting a meta-analysis with non-independent effect sizes. Neuropsychology Review, 29(4), 387–396. doi:10.1007/s11065-019-09415-6 Cicchinelli, L. F., & Beesley, A. D. (2017). Introduction: Current state of the science in rural
education research. In G. C. Nugent, G. M. Kunz, S. M. Sheridan, T. A. Glover, & L. L. Knoche (Eds.), Rural education research in the United States: State of the science and emerging directions (pp. 1–14). doi:10.1007/978-3-319-42940-3_1
Claessens, A., Duncan, G., & Engel, M. (2009). Kindergarten skills and fifth-grade achievement: Evidence from the ECLS-K. Economics of Education Review, 28(4), 415–427.
doi:http://dx.doi.org/10.1016/j.econedurev.2008.09.003
Claessens, A., Engel, M., & Curran, F. C. (2014). Academic content, student learning, and the persistence of preschool effects. American Educational Research Journal, 51(2), 403– 434. doi:10.3102/0002831213513634
Clements, D. H., Sarama, J., Farran, D., Lipsey, M., Hofer, K. G., & Bilbrey, C. (2011). An examination of the building blocks math curriculum: Results of a longitudinal scale-up study. Society for Research on Educational Effectiveness.
Clifford, R. M., Barbarin, O., Chang, F., Early, D., Bryant, D., Howes, C., . . . Pianta, R. C. (2005). What is pre-kindergarten? Characteristics of public pre-kindergarten programs.
Applied Developmental Science, 9(3), 126–143. doi:10.1207/s1532480xads0903_1 Cole, S. R., & Hernán, M. A. (2008). Constructing inverse probability weights for marginal
structural models. American Journal of Epidemiology, 168(6), 656–664. doi:10.1093/aje/kwn164
Conger, R. D. (2013). Commentary: Rural children at risk. In L. Vernon-Feagans, M. Cox, & The FLP Key Investigators (Eds.), The Family Life Project: An epidemiological and developmental study of young children living in poor rural communities (pp. 127–138): The Society for Research in Child Development.
Cunha, F., Heckman, J., Lochner, L., & Masterov, D. V. (2006). Interpreting the evidence of life cycle skill formation. In F. Hanushek & F. Welch (Eds.), Handbook of the economics of education. North Holland, Amsterdam: Elsevier.
Cunningham, A. E., & Stanovich, K. E. (1997). Early reading acquisition and its relation to reading experience and ability 10 years later. Developmental Psychology, 33(6), 934– 945. doi:10.1037/0012-1649.33.6.934
Curby, T. W., Rimm-Kaufman, S. E., & Cameron Ponitz, C. (2009). Teacher–child interactions and children’s achievement trajectories across kindergarten and first grade. Journal of Educational Psychology, 101(4), 912–925. doi:10.1037/a0016647
Curenton, S. M., Dong, N., & Shen, X. (2015). Does aggregate school-wide achievement mediate fifth grade outcomes for former early childhood education participants?
Developmental Psychology, 51(7), 921–934. doi:10.1037/a0039295
Currie, J., & Thomas, D. (2000). School quality and the longer-term effects of Head Start. The Journal of Human Resources, 35(4), 755–774. doi:10.3386/w6362
Denham, S. A. (2006). Social-emotional competence as support for school readiness: What is it and how do we assess it? Early Education & Development, 17(1), 57-89.
doi:10.1207/s15566935eed1701_4
DeParle, J. (2019, February 4). Cleaner classrooms and rising scores: With tighter oversight, Head Start shows gains. The New York Times. Retrieved from
https://www.nytimes.com/2019/02/04/us/politics/head-start-preschool.html Desai, S., Chase-Lansdale, P. L., & Michael, R. T. (1989). Mother or market? Effects of
maternal employment on the intellectual ability of 4-year-old children. Demography, 26(4), 545–561. doi:10.2307/2061257
DeVries, R., & Kohlberg, L. (1987). Programs of early education: The constructivist view. White Plains, NY: Longman.
Dill, B. T. (1999). Poverty in the rural U.S.: Implications for children, families, and communities. New York, NY: The Annie E. Casey Foundation.
Dowsett, C. J., Huston, A. C., Imes, A. E., & Gennetian, L. (2008). Structural and process features in three types of child care for children from high and low income families.
Early Childhood Research Quarterly, 23(1), 69–93. doi:http://dx.doi.org/10.1016/j.ecresq.2007.06.003
DuGoff, E. H., Schuler, M., & Stuart, E. A. (2014). Generalizing observational study results: Applying propensity score methods to complex surveys. Health Services Research, 49(1), 284–303. doi:10.1111/1475-6773.12090
Duncan, G. J., Dowsett, C. J., Claessens, A., Magnuson, K., Huston, A. C., Klebanov, P., . . . Japel, C. (2007). School readiness and later achievement. Developmental Psychology, 43(6), 1428–1446. doi:10.1037/0012-1649.43.6.1428.supp
Duncan, G. J., & Magnuson, K. (2011). The nature and impact of early achievement skills, attention skills, and behavior problems. In G. J. Duncan & R. J. Murnane (Eds.), Whither opportunity? Rising inequality, schools, and children's life chances (pp. 47–69).
Duncan, S. E., & De Avila, E. A. (1998). Pre-LAS 2000. Monterey, CA: CTB/McGraw-Hill. Dunn, L. M., & Dunn, D. M. (2007). Peabody picture vocabulary test (4th ed.). Minneapolis,
MN: Pearson Assessments.
Dunn, L. M., & Dunn, L. M. (1997). Peabody Picture Vocabulary Test–Revised (3rd ed.). Circle Pines, MN: American Guidance Services.
Eccles, J. S., & Roeser, R. W. (2010). An ecological view of schools and development. In J. S. Eccles & J. L. Meece (Eds.), Handbook of research on schools, schooling, and human development (pp. 6–21). New York, NY: Routledge.
Entwisle, Doris R., Alexander, Karl L., & Olson, Linda S. (2005). First grade and educational attainment by age 22: A new story. American Journal of Sociology, 110(5), 1458–1502. doi:10.1086/428444
Ezpeleta, L., Granero, R., la Osa, N. d., Penelo, E., & Domènech, J. M. (2013). Psychometric properties of the Strengths and Difficulties Questionnaire in 3-year-old preschoolers.
Comprehensive Psychiatry, 54(3), 282–291.
doi:https://doi.org/10.1016/j.comppsych.2012.07.009
Feller, A., Grindal, T., Miratrix, L., & Page, L. C. (2016). Compared to what? Variation in the impacts of early childhood education by alternative care type. The Annals of Applied Statistics, 10(3), 1245–1285. doi:10.1214/16-aoas910
Fernald, A., Marchman, V. A., & Weisleder, A. (2013). SES differences in language processing skill and vocabulary are evident at 18 months. Developmental Science, 16(2), 234–248. doi:http://dx.doi.org/10.1111/desc.12019
Friedman-Krauss, A. H., Barnett, S. W., Garver, K. A., Hodges, K. S., Weisenfeld, G. G., & DiCrecchio, N. (2019). The state of preschool 2018: State preschool yearbook. Retrieved from http://nieer.org:
Friedman-Krauss, A. H., Barnett, S. W., Weisenfeld, G. G., Kasmin, R., DiCrecchio, N., & Horowitz, M. (2018). The state of preschool 2017: State preschool yearbook. Retrieved from http://nieer.org/state-preschool-yearbooks/yearbook2017:
Gibbs, C., Ludwig, J., & Miller, D. (2013). Head Start origins and impacts. In The War on Poverty: A 50-year retrospective (pp. 39-65). New York, NY: Russell Sage Foundation. Goodman, R. (1997). The Strengths and Difficulties Questionnaire: A research note. Journal of
Child Psychology and Psychiatry, 38(5), 581–586. doi:10.1111/j.1469- 7610.1997.tb01545.x
Gormley, W. T., Gayer, T., Phillips, D., & Dawson, B. (2005). The effects of universal pre-k on cognitive development. Developmental Psychology, 41(6), 872–884. doi:10.1037/0012- 1649.41.6.872
Gormley, W. T., Phillips, D., Adelstein, S., & Shaw, C. (2010). Head Start's comparative advantage: Myth or reality? Policy Studies Journal, 38(3), 397–418. doi:10.1111/j.1541- 0072.2010.00367.x
Gormley, W. T., Phillips, D., & Gayer, T. (2008). Preschool programs can boost school readiness. Science, 320(5884), 1723–1724. doi:10.1126/science.1156019
Gormley, W. T., Phillips, D. A., Newmark, K., Welti, K., & Adelstein, S. (2011). Social- emotional effects of early childhood education programs in Tulsa. Child Development, 82(6), 2095–2109. doi:10.1111/j.1467-8624.2011.01648.x
Grace, C., Shores, E. F., Zaslow, M., Brown, B., Aufseeser, D., & Bell, L. (2006). Rural disparities in baseline data of the Early Childhood Longitudinal Study: A chartbook Rural Early Childhood Report No. 3. Mississippi State, MS: National Center for Rural Early Childhood Learning Initiatives, Mississippi State University Early Childhood Institute.
Gresham, F., & Elliott, S. N. (2008). Social Skills Improvement System (SSIS) rating scales. Bloomington, MN: Pearson Assessments.
Grissmer, D., Grimm, K. J., Aiyer, S. M., Murrah, W. M., & Steele, J. S. (2010). Fine motor skills and early comprehension of the world: Two new school readiness indicators.
Developmental Psychology, 46(5), 1008–1017. doi:http://dx.doi.org/10.1037/a0020104 Halle, T., Forry, N., Hair, E., Perper, K., Wandner, L., Wessel, J., & Vick, J. (2009). Disparities
in early learning and development: Lessons from the Early Childhood Longitudinal Study-Birth Cohort (ECLS-B). Retrieved from https://www.childtrends.org/wp- content/uploads/2013/05/2009-52DisparitiesELExecSumm.pdf
Hamre, B. K. (2018, November 27). How the opportunity gap in K-3 teaching is failing our students [Blog post]. Retrieved from https://info.teachstone.com/blog/how-the- opportunity-gap-in-k-3-teaching-is-failing-our-students
Hamre, B. K., & Pianta, R. C. (2010). Classroom environments and developmental processes: Conceptualization and measurement. In J. S. Eccles & J. L. Meece (Eds.), Handbook of research on schools, schooling, and human development (pp. 25–41). New York, NY:
Hamre, B. K., Pianta, R. C., Burchinal, M., Field, S., LoCasale-Crouch, J., Downer, J. T., . . . Scott-Little, C. (2012). A course on effective teacher-child interactions: Effects on teacher beliefs, knowledge, and observed practice. American Educational Research Journal, 49(1), 88–123. doi:10.3102/0002831211434596
Hamre, B. K., Pianta, R. C., Downer, J. T., DeCoster, J., Mashburn, A. J., Jones, S. M., . . . Hamagami, A. (2013). Teaching through interactions: Testing a developmental framework of teacher effectiveness in over 4,000 classrooms. The Elementary School Journal, 113(4), 461–487. doi:10.1086/669616
Harder, V. S., Stuart, E. A., & Anthony, J. C. (2010). Propensity score techniques and the assessment of measured covariate balance to test causal associations in psychological research. Psychological Methods, 15(3), 234–249.
doi:http://dx.doi.org/10.1037/a0019623
Harms, T., & Clifford, R. M. (1980). Early Childhood Environment Rating Scale. New York: Teacher's College Press.
Haskins, R., & Barnett, W. S. (2010). New directions for America’s early childhood policies. In R. Haskins & W. S. Barnett (Eds.), Investing in young children: New directions in federal preschool and early childhood policy (pp. 1–28.). Washington, DC: Brookings
Institution.
Haukoos, J. S., & Lewis, R. J. (2015). The propensity score. Journal of the American Medical