Ready for Fall? Near-Term Effects of Voluntary Summer Learning Programs on Low-Income Students' Learning Opportunities and Outcomes
Open accessAbstract
The Wallace Foundation's National Summer Learning Study, conducted by RAND and launched in 2011, offers the first assessment of district-run voluntary summer programs over the short and long run. This report, the second of five that will result from the study, looks at how summer programs affected student performance on math, reading, and social and emotional assessments in fall 2013.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Estimates of the magnitude of summer learning loss vary widely between studies, from 0.06 to 0.6 of a standard deviation in skills for a 12-week closure.
“However, estimates of the magnitude of the loss vary widely between studies, from 0.06 to 0.6 of a standard deviation in skills for a 12-week closure (Kuhfeld et al. 2020a, Cooper et al. 1996, McCombs et al. 2014).”
From Educational Inequality* (2022) · cites this paper as McCombs et al. 2014
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482 · see citing works
Bootstrap-Based Improvements for Inference With Clustered Errors
Cameron, A. C., Gelbach, J. B., & Miller, D. L. (2008) · Review of Economics and Statistics · doi:10.1162/rest.90.3.414 · Cited by 4,417 · see citing works
(2011) · Issue Lab (Candid) · Cited by 1,167 · see citing works
The Effects of Summer Vacation on Achievement Test Scores: A Narrative and Meta-Analytic Review
Cooper, H., Nye, B., Charlton, K., Lindsay, J., & Greathouse, S. (1996) · Review of Educational Research · doi:10.3102/00346543066003227 · Cited by 991 · see citing works
Bootstrap-Based Improvements for Inference with Clustered ErrorsPreprint
Cameron, A. C., Gelbach, J. B., & Miller, D. L. (2007) · SSRN Electronic Journal · doi:10.2139/ssrn.956890 · Cited by 923 · see citing works
Cutting, L. E., & Scarborough, H. S. (2006) · Scientific Studies of Reading · doi:10.1207/s1532799xssr1003_5 · Cited by 678 · see citing works
Keenan, J. M., Betjemann, R. S., & Olson, R. K. (2008) · Scientific Studies of Reading · doi:10.1080/10888430802132279 · Cited by 667 · see citing works
Research-based implications from extensive early reading interventions
Wanzek, J., & Vaughn, S. (2007) · School Psychology Review · doi:10.1080/02796015.2007.12087917 · Cited by 424 · see citing works
(2012) · TigerPrints (Clemson University) · Cited by 402 · see citing works
Making the most of summer school: a meta-analytic and narrative review.
Cooper, H., Charlton, K., Valentine, J. C., & Muhlenbruck, L. (2000) · PubMed · Cited by 317 · see citing works
Extensive Reading Interventions for Students With Reading Difficulties After Grade 3
Wanzek, J., Vaughn, S. R., Scammacca, N. K., Metz, K. L., Murray, C. S., Roberts, G., & Danielson, L. C. (2013) · Review of Educational Research · doi:10.3102/0034654313477212 · Cited by 285 · see citing works
Addressing Summer Reading Setback Among Economically Disadvantaged Elementary Students
Allington, R. L., McGill-Franzen, A., Camilli, G., Williams, L., Graff, J., Zeig, J., Zmach, C., & Nowak, R. (2010) · Reading Psychology · doi:10.1080/02702711.2010.505165 · Cited by 256 · see citing works
Assessment matters: Issues in the measurement of reading comprehension
Cain, K., & Oakhill, J. V. (2006) · British Journal of Educational Psychology · doi:10.1348/000709905x69807 · Cited by 181 · see citing works
Mandatory summer school and student achievement
Matsudaira, J. D. (2007) · Journal of Econometrics · doi:10.1016/j.jeconom.2007.05.015 · Cited by 169 · see citing works
Scaffolding Voluntary Summer Reading for Children in Grades 3 to 5: An Experimental Study
Kim, J. S., & White, T. G. (2008) · Scientific Studies of Reading · doi:10.1080/10888430701746849 · Cited by 141 · see citing works
Kim, J. S. (2006) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737028004335 · Cited by 130 · see citing works
Summer Reading and the Ethnic Achievement Gap
Kim, J. (2004) · Journal of Education for Students Placed at Risk (JESPAR) · doi:10.1207/s15327671espr0902_5 · Cited by 125 · see citing works
Families, Schools, and Summer Learning
Borman, G. D., Benson, J., & Overman, L. (2005) · The Elementary School Journal · doi:10.1086/499195 · Cited by 98 · see citing works
Kim, J. S., & Guryan, J. (2010) · Journal of Educational Psychology · doi:10.1037/a0017270 · Cited by 90 · see citing works
Schacter, J., & Jo, B. (2005) · Journal of Research in Reading · doi:10.1111/j.1467-9817.2005.00260.x · Cited by 89 · see citing works
Making Summer Count: How Summer Programs Can Boost Children's Learning
McCombs, J. S., Augustine, C. H., Schwartz, H. L., Bodilly, S. J., McInnis, B. J., Lichter, D. S., & Cross, A. B. (2011) · PsycEXTRA Dataset · doi:10.1037/e525802012-001 · Cited by 82 · see citing works
Self-citationHalting the Summer Achievement Slide: A Randomized Field Trial of the KindergARTen Summer Camp
Borman, G. D., Goetz, M. E., & Dowling, N. M. (2009) · Journal of Education for Students Placed at Risk (JESPAR) · doi:10.1080/10824660802427652 · Cited by 66 · see citing works
Pendry, P., Carr, A. M., Smith, A. N., & Roeter, S. M. (2014) · The Journal of Primary Prevention · doi:10.1007/s10935-014-0350-7 · Cited by 60 · see citing works
White, T. G., Kim, J. S., Kingston, H. C., & Foster, L. (2013) · Reading Research Quarterly · doi:10.1002/rrq.62 · Cited by 53 · see citing works
Chaplin, D., & Capizzano, J. (2006) · RePEc: Research Papers in Economics · Cited by 53 · see citing works
The Academic Effects of Summer Instruction and Retention in New York City
Mariano, L. T., & Martorell, P. (2012) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373712454327 · Cited by 46 · see citing works
Self-citationChoice of Reading Comprehension Test Influences the Outcomes of Genetic Analyses
Betjemann, R. S., Keenan, J. M., Olson, R. K., & DeFries, J. C. (2011) · Scientific Studies of Reading · doi:10.1080/10888438.2010.493965 · Cited by 41 · see citing works
Ending Social Promotion Without Leaving Children Behind: The Case of New York City
McCombs, J. S., Kirby, S. N., Mariano, L. T., Crego, A., Gershwin, D., Ikemoto, G. S., Le, V.-N., Marsh, J. A., Naftel, S., Setodji, C. M., et al. (2009) · RAND Corporation eBooks · doi:10.7249/mg894 · Cited by 38 · see citing works
Self-citationPendry, P., & Roeter, S. M. (2013) · PsycEXTRA Dataset · doi:10.1037/e565452013-002 · Cited by 34 · see citing works
Pendry, P., & Roeter, S. M. (2013) · Human-animal interaction bulletin · doi:10.1079/hai.2013.0004 · Cited by 22 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
When the Great Equalizer Shuts Down: Schools, Peers, and Parents in Pandemic TimesPreprint
Agostinelli, F., Doepke, M., Sorrenti, G., & Zilibotti, F. (2020) · SSRN Electronic Journal · doi:10.1016/j.jpubeco.2021.104574 · Cited by 228 · see citing works
When the Great Equalizer Shuts Down: Schools, Peers, and Parents in Pandemic Times
Agostinelli, F., Doepke, M., Sorrenti, G., & Zilibotti, F. (2020) · doi:10.3386/w28264 · Cited by 97 · see citing works
The Value of Out-of-School Time Programs
McCombs, J. S., Whitaker, A. A., & Yoo, P. (2017) · RAND Corporation eBooks · doi:10.7249/pe267 · Cited by 56 · see citing works
Self-citationEffectiveness of Structured Teacher Adaptations to an Evidence‐Based Summer Literacy Program
Kim, J. S., Burkhauser, M., Quinn, D. M., Guryan, J., Kingston, H. C., & Aleman, K. (2017) · Reading Research Quarterly · doi:10.1002/rrq.178 · Cited by 55 · see citing works
Blanden, J., Doepke, M., & Stuhler, J. (2022) · National Bureau of Economic Research · doi:10.3386/w29979 · Cited by 47 · see citing works
Slade, T. S., Piper, B., Kaunda, Z., King, S. J., & Ibrahim, H. (2017) · Research in Comparative and International Education · doi:10.1177/1745499917740657 · Cited by 39 · see citing works
Blanden, J., Doepke, M., & Stuhler, J. L. (2023) · Handbook of the economics of education · doi:10.1016/bs.hesedu.2022.11.003 · Cited by 45 · see citing works
The Impact of Summer Programs on Student Mathematics Achievement: A Meta-Analysis
Lynch, K., An, L., & Mancenido, Z. (2022) · Review of Educational Research · doi:10.3102/00346543221105543 · Cited by 34 · see citing works
Macaruso, P., Wilkes, S., Franzén, S., & Schechter, R. L. (2019) · Computers in the Schools · doi:10.1080/07380569.2018.1558884 · Cited by 21 · see citing works
Assessing Learning Outcomes in Higher Education: From Practice to Systematization
Alyasin, A., Nasser, R. N., Hajj, M. E., & Harb, H. (2023) · TEM Journal · doi:10.18421/tem123-41 · Cited by 16 · see citing works
Every Summer Counts: A Longitudinal Analysis of Outcomes from the National Summer Learning Project
McCombs, J. S., Augustine, C. H., Pane, J. F., & Schweig, J. D. (2020) · RAND Corporation eBooks · doi:10.7249/rr3201 · Cited by 14 · see citing works
Self-citationSchweig, J. D., & Pane, J. F. (2016) · International Journal of Research & Method in Education · doi:10.1080/1743727x.2016.1170800 · Cited by 13 · see citing works
Self-citationEducational InequalityPreprint
Blanden, J., Doepke, M., & Stuhler, J. L. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4114801 · Cited by 14 · see citing works
Summer Learning Programs: Investigating Strengths and Challenges
Hall, G. S., Poston, K. F., & Dennehy, J. (2017) · SpringerBriefs in psychology · doi:10.1007/978-3-319-59141-4_1 · Cited by 9 · see citing works
Healthy Summer Learners: An explanatory mixed methods study and process evaluation
von Klinggraeff, L., Dugger, R., Brazendale, K., Hunt, E. T., Moore, J. B., Turner‐McGrievy, G. M., Vogler, K. E., Beets, M. W., Armstrong, B., & Weaver, R. G. (2022) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2022.102070 · Cited by 8 · see citing works
Effect of a summer school on formative and summative assessment in accounting education
Opdecam, E., & Everaert, P. C. (2022) · Journal of Accounting Education · doi:10.1016/j.jaccedu.2022.100769 · Cited by 7 · see citing works
A Quasi-Experimental Study of the Impacts of the Kids Read Now Summer Reading Program
Borman, G. D., Yang, H., & Xie, X. (2020) · Journal of Education for Students Placed at Risk (JESPAR) · doi:10.1080/10824669.2020.1855985 · Cited by 6 · see citing works
Lynch, K., An, L., & Mancenido, Z. (2021) · Brown Digital Repository · doi:10.26300/da7r-4z83 · Cited by 6 · see citing works
Summer School as a Learning Loss Recovery Strategy After COVID-19: Evidence from Summer 2022
Callen, I., Carbonari, M. V., DeArmond, M., Dewey, D., Dizon-Ross, E., Goldhaber, D. D., Isaacs, J., Kane, T. J., Kuhfeld, M. R., McDonald, A. L., et al. (2025) · American Educational Research Journal · doi:10.3102/00028312251355990 · Cited by 6 · see citing works
Making Summer Last: Integrating Summer Programming into Core District Priorities and Operations
Augustine, C. H., & Thompson, L. (2017) · RAND Corporation eBooks · doi:10.7249/rr2038 · Cited by 5 · see citing works
Self-citationThe Impact of the COVID-19 Pandemic on Education Learning
Sanz, I., & Tena, J. D. (2023) · Springer eBooks · doi:10.1007/978-3-031-45802-6_2 · Cited by 4 · see citing works
Multivariate summer school effects
Zvoch, K., & Robertson, M. (2017) · Studies In Educational Evaluation · doi:10.1016/j.stueduc.2017.10.003 · Cited by 4 · see citing works
Investigation of the long term effect of a summer literacy program on student reading performance
Zvoch, K. (2019) · Studies In Educational Evaluation · doi:10.1016/j.stueduc.2019.05.005 · Cited by 4 · see citing works
Augustine, C. H., McCombs, J. S., & Baker, G. (2021) · RAND Corporation eBooks · doi:10.7249/rr-a205-1 · Cited by 2 · see citing works
Self-citationSummer Program Effects on Geometry Achievement
Pittard, C. M. (2019) · American Educational Research Association Annual Meeting (AERA) · doi:10.3102/1438920 · Cited by 1 · see citing works
Impacts of Academic Recovery Interventions on Student Achievement in 2022 to 2023
Carbonari, M. V., DeArmond, M., Dewey, D., Dizon-Ross, E., Goldhaber, D., Kane, T. J., McDonald, A., McEachin, A., Morton, E., Muroga, A., et al. (2026) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737251400377
Getting to Work on Summer Learning: Recommended Practices for Success, 2nd Ed. — Executive Summary
Schwartz, H. L., McCombs, J. S., Augustine, C. H., & Leschitz, J. T. (2021) · RAND Corporation eBooks · doi:10.7249/rra205-3
Self-citationGuryan, J. (2015) · AEA Randomized Controlled Trials · doi:10.1257/rct.970-1.0
Guryan, J. (2015) · AEA Randomized Controlled Trials · doi:10.1257/rct.970-2.0
Considerations in the Design of High-Impact Policy-Relevant Research
Woodward, T., Quinn, A., Lilly, S., & Youngs, P. A. (2020) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-64802-249-420251007
- Authors
- McCombs, J., Pane, J., Augustine, C., Schwartz, H., Martorell, P., & Zakaras, L.
- ORCID
- Pane, John
- Venue
- RAND Corporation eBooks
- Publisher
- RAND Corporation
- Published
- 2014
- OpenAlex
- W2899131790
- Cited by
- 28
- References
- 30
- Citations by year
- 2026: 1 · 2025: 1 · 2023: 3 · 2022: 6 · 2021: 3 · 2020: 4 · 2019: 3 · 2017: 6 · 2016: 1
- FWCI
- 4.90
- Type
- book
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- RAND Corporation eBooks (publishedVersion)
- Issue Lab (Candid) (submittedVersion)
- Topics
- Social Sciences › Safety Research › Youth Development and Social Support
- Social Sciences › Education › School Choice and Performance
- Social Sciences › Education › Early Childhood Education and Development
- Keywords
- summer learning loss, low-income students, mathematics achievement, reading achievement, socioemotional skills, student performance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
