A meta-analysis of the impact of COVID-19 on student achievement
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The study's results are similar to what systematic reviews are finding.
“Interestingly, our results are similar to what systematic reviews are finding learning16–20,44,45.”
From COVID-19, school closures, and student learning outcomes. New global evidence from PISA (2025) · cites this paper as [45]
Cites
Wickham, H., Averick, M., Bryan, J., Chang, W., McGowan, L., François, R., Grolemund, G., Hayes, A., Henry, L., Hester, J., et al. (2019) · Journal of Open Source Software · doi:10.21105/joss.01686 · Cited by 22,138 · see citing works
Conducting Meta-Analyses in <i>R</i> with the <b>metafor</b> Package
Viechtbauer, W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i03 · Cited by 20,464 · see citing works
ggplot2: Elegant Graphics for Data Analysis
Ginestet, C. E. (2011) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/j.1467-985x.2010.00676_9.x · Cited by 14,484 · see citing works
(2000) · Cited by 9,198 · see citing works
A basic introduction to fixed-effect and random-effects models for meta-analysis
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.12 · Cited by 6,793 · see citing works
Primary, Secondary, and Meta-Analysis of Research
GLASS, G. V. (1976) · Educational Researcher · doi:10.3102/0013189x005010003 · Cited by 4,890 · see citing works
dplyr: A Grammar of Data Manipulation
Wickham, H., François, R., Henry, L., Müller, K., & Vaughan, D. (2014) · doi:10.32614/cran.package.dplyr · Cited by 3,457 · see citing works
The Split-Apply-Combine Strategy for Data Analysis
Wickham, H. (2011) · Journal of Statistical Software · doi:10.18637/jss.v040.i01 · Cited by 2,901 · see citing works
Robust variance estimation in meta‐regression with dependent effect size estimates
Hedges, L. V., Tipton, E., & Johnson, M. C. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.5 · Cited by 2,086 · see citing works
Learning loss due to school closures during the COVID-19 pandemic
Engzell, P., Frey, A., & Verhagen, M. D. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2022376118 · Cited by 1,848 · see citing works
Learning loss due to school closures during the COVID-19 pandemic
Engzell, P., Frey, A., & Verhagen, M. D. (2020) · doi:10.31235/osf.io/ve4z7 · Cited by 1,739 · see citing works
The effect of COVID-19 on youth mental health
Liang, L., Ren, H., Cao, R., Hu, Y., Qin, Z., Li, C., & Mei, S. (2020) · Psychiatric Quarterly · doi:10.1007/s11126-020-09744-3 · Cited by 971 · see citing works
Best evidence synthesis: An intelligent alternative to meta-analysis
Slavin, R. E. (1995) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(94)00097-a · Cited by 951 · see citing works
Systematic reviews and meta-analysis: Understanding the best evidence in primary healthcare
Ganeshkumar, P., & Gopalakrishnan, S. (2013) · Journal of Family Medicine and Primary Care · doi:10.4103/2249-4863.109934 · Cited by 743 · see citing works
Effect Sizes in Cluster-Randomized Designs
Hedges, L. (2007) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998606298043 · Cited by 605 · see citing works
Giorgio, D. P., Federico, B., Costa, P., Karpiński, Z., & Mazza, J. (2020) · RePEc: Research Papers in Economics · doi:10.2760/126686 · Cited by 534 · see citing works
The effect of school closures on standardised student test outcomes
Maldonado, J. E., & De Witte, K. (2022) · British Educational Research Journal · doi:10.1002/berj.3754 · Cited by 499 · see citing works
Terrin, N. C., Schmid, C. H., & Lau, J. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.01.006 · Cited by 493 · see citing works
Effects of COVID-19-Related School Closures on Student Achievement-A Systematic Review
Hammerstein, S., König, C., Dreisörner, T., & Frey, A. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.746289 · Cited by 461 · see citing works
Social Vulnerability and Racial Inequality in COVID-19 Deaths in Chicago
Kim, S. J., & Bostwick, W. B. (2020) · Health Education & Behavior · doi:10.1177/1090198120929677 · Cited by 460 · see citing works
Learning loss during Covid-19: An early systematic review
Donnelly, R., & Patrinos, H. A. (2022) · PROSPECTS · doi:10.1007/s11125-021-09582-6 · Cited by 445 · see citing works
Wickham, H., & Bryan, J. (2015) · doi:10.32614/cran.package.readxl · Cited by 445 · see citing works
Tomasik, M. J., Helbling, L. A., & Moser, U. (2021) · International Journal of Psychology · doi:10.1002/ijop.12728 · Cited by 378 · see citing works
Modeling Publication Selection Effects in Meta-Analysis
Hedges, L. V. (1992) · Statistical Science · doi:10.1214/ss/1177011364 · Cited by 359 · see citing works
Fortuna, L. R., Tolou‐Shams, M., Robles-Ramamurthy, B., & Porche, M. V. M. (2020) · Psychological Trauma Theory Research Practice and Policy · doi:10.1037/tra0000889 · Cited by 358 · see citing works
Kaffenberger, M. (2021) · International Journal of Educational Development · doi:10.1016/j.ijedudev.2020.102326 · Cited by 308 · see citing works
Effective Programs in Middle and High School Mathematics: A Best-Evidence Synthesis
Slavin, R. E., Lake, C., & Groff, C. (2009) · Review of Educational Research · doi:10.3102/0034654308330968 · Cited by 282 · see citing works
Schult, J., Mahler, N., Fauth, B., & Lindner, M. A. (2021) · doi:10.31234/osf.io/pqtgf · Cited by 262 · see citing works
Schult, J., Mahler, N., Fauth, B., & Lindner, M. A. (2022) · School Effectiveness and School Improvement · doi:10.1080/09243453.2022.2061014 · Cited by 262 · see citing works
The impact of COVID-19 on student learning in New South Wales primary schools: an empirical study
Gore, J., Fray, L., Miller, A., Harris, J., & Taggart, W. (2021) · The Australian Educational Researcher · doi:10.1007/s13384-021-00436-w · Cited by 201 · see citing works
janitor: Simple Tools for Examining and Cleaning Dirty Data
Firke, S. (2016) · doi:10.32614/cran.package.janitor · Cited by 175 · see citing works
Spitzer, M. W. H., & Musslick, S. (2021) · PLOS ONE · doi:10.1371/journal.pone.0255629 · Cited by 138 · see citing works
flextable: Functions for Tabular Reporting
Gohel, D., & Skintzos, P. (2017) · doi:10.32614/cran.package.flextable · Cited by 118 · see citing works
A Synthesis of Quantitative Research on Reading Programs for Secondary Students
Baye, A., Neitzel, A. J., Lake, C., & Slavin, R. E. (2018) · Reading Research Quarterly · doi:10.1002/rrq.229 · Cited by 102 · see citing works
A Synthesis of Quantitative Research on Programs for Struggling Readers in Elementary Schools
Neitzel, A. J., Lake, C., Pellegrini, M., & Slavin, R. E. (2021) · Reading Research Quarterly · doi:10.1002/rrq.379 · Cited by 102 · see citing works
Johnson-Ahorlu, R. N. (2012) · Race Ethnicity and Education · doi:10.1080/13613324.2011.645566 · Cited by 97 · see citing works
Adapting to COVID-19 disruptions: student engagement in online learning of accounting
Ali, I., Narayan, A. K., & Sharma, U. (2020) · Accounting Research Journal · doi:10.1108/arj-09-2020-0293 · Cited by 92 · see citing works
Meeter, M. (2021) · Trends in Neuroscience and Education · doi:10.1016/j.tine.2021.100163 · Cited by 85 · see citing works
Build back better: Avoid the learning loss trap
Zhao, Y. (2021) · Prospects · doi:10.1007/s11125-021-09544-y · Cited by 62 · see citing works
weightr: Estimating Weight-Function Models for Publication Bias
Coburn, K. M., & Vevea, J. L. (2016) · doi:10.32614/cran.package.weightr · Cited by 61 · see citing works
van der Velde, M., Sense, F., Spijkers, R., Meeter, M., & van Rijn, H. (2021) · doi:10.31234/osf.io/fr2v8 · Cited by 57 · see citing works
van der Velde, M., Sense, F., Spijkers, R., Meeter, M., & van Rijn, H. (2021) · Frontiers in Education · doi:10.3389/feduc.2021.712987 · Cited by 57 · see citing works
Kompetenzstände Hamburger Schüler*innen vor und während der Corona-Pandemie
Depping, D., Lücken, M., Musekamp, F., & Thonke, F. (2021) · Schule während der Corona-Pandemie. Neue Ergebnisse und Überblick über ein dynamisches Forschungsfeld · doi:10.31244/9783830993315.03 · Cited by 46 · see citing works
An analysis of school absences in England during the COVID-19 pandemic
Southall, E., Holmes, A., Hill, E. M., Atkins, B. D., Leng, T., Thompson, R. N., Dyson, L., Keeling, M. J., & Tildesley, M. J. (2021) · BMC Medicine · doi:10.1186/s12916-021-01990-x · Cited by 26 · see citing works
Synchronous teaching and asynchronous trauma: Exploring teacher trauma in the wake of Covid-19
Etchells, M. J., Brannen, L., Donop, J., Bielefeldt, J., Singer, E. A., Moorhead, E., & Walderon, T. (2021) · Social Sciences & Humanities Open · doi:10.1016/j.ssaho.2021.100197 · Cited by 24 · see citing works
FOX, A. M., Lee, J. S., Sorensen, L. C., & Martin, E. G. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.17267 · Cited by 19 · see citing works
The Not So Subtle Inequity of Remote Learning
Tienken, C. H. (2020) · Kappa Delta Pi Record · doi:10.1080/00228958.2020.1813502 · Cited by 18 · see citing works
Impacts of COVID-19 in Racialized Communities
Allen, U., Collins, T., Dei, G. J. S., Henry, F., Ibrahim, A., James, C., Jean‐Pierre, J., Kobayashi, A., Lewis, K., McKenzie, K. J., et al. (2021) · cIRcle (University of British Columbia) · doi:10.14288/1.0398437 · Cited by 11 · see citing works
Improving Distance Education in the Early Grades.
Cottingham, B. W. (2020) · Policy Analysis for California Education, PACE · Cited by 2 · see citing works
Flagged first, then by citations
5 of the 54 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
COVID-19, school closures, and student learning outcomes. New global evidence from PISA
Jakubowski, M., Gajderowicz, T., & Patrinos, H. A. (2025) · npj Science of Learning · doi:10.1038/s41539-025-00297-3 · Cited by 39 · see citing works
Felix, E. D., & Green, J. G. (2025) · Current Psychiatry Reports · doi:10.1007/s11920-025-01642-4 · Cited by 8 · see citing works
Ludewig, U., Strietholt, R., & McElvany, N. (2025) · Learning and Instruction · doi:10.1016/j.learninstruc.2025.102150 · Cited by 5 · see citing works
Martsenkovskyi, D., Bakermans‐Kranenburg, M. J., & van IJzendoorn, M. H. (2026) · Cambridge University Press eBooks · doi:10.1017/9781009667098 · Cited by 3 · see citing works
Bub, K. L., Neuharth-Pritchett, S. M., Smolinski, E., & Hirt, S. (2025) · Early Childhood Education Journal · doi:10.1007/s10643-025-01919-6 · Cited by 1 · see citing works
Learning disruptions and academic outcomes
Banerjee, R., & Bharati, T. (2025) · Economics of Education Review · doi:10.1016/j.econedurev.2025.102650 · Cited by 1 · see citing works
Golle, J., Lösche, P., Beißert, H. M., Wieland, A.-K., Rieber, R., Schult, J., Hasselhorn, M., Nagengast, B., & Trautwein, U. (2026) · npj Science of Learning · doi:10.1038/s41539-026-00439-1
Lee, S., & Ahn, J. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4941090
Primary and secondary school students’ academic achievement trajectories before and during COVID-19
Chaffee, K. E., Martineau, M. D., Plante, I., & Charland, P. (2026) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2026.102487
Remote instruction during the COVID-19 pandemic and school suspensions
Quast, T. C., Anthony, T., Kim, E., Suldo, S. M., Rote, W. M., Barbre, S., & Storch, E. A. (2025) · Education Economics · doi:10.1080/09645292.2025.2556059
Thompson, E., Sofo, S. S., Tomchuk, D., Schneider, K. R., Ramos, A. R., & Chung, S. (2025) · Injury · doi:10.1016/j.injury.2025.112929
Impact of the Covid-19 pandemic on writing performance: a statewide longitudinal study
Keller-Margulis, M. A., Matta, M., Yagi, K., Messerli, M. C., Navarro, S., Spillman, M. M., & Hut, A. R. (2025) · Reading and Writing · doi:10.1007/s11145-025-10734-9
Summer learning loss: a scoping review (2014–2023)
Pastore, S., Passalacqua, F., & Sbravati, G. (2026) · Educational Research for Policy and Practice · doi:10.1007/s10671-025-09409-7
Post-COVID learning loss and the collapse of the education-economy link in Bulgaria
Rusinov, S., & Sokolova, N. (2026) · Society and Economy · doi:10.14267/1588970x.2026.011
Vu, H. N. V., Korte, S.-M., Keskitalo, P., & Turunen, T. (2026) · Scandinavian Journal of Educational Research · doi:10.1080/00313831.2026.2700570
University teaching and stress recognition: an experimental intervention to improve student grades
Cohle, Z., Jaber, K., Konsor, K. J., & Meyer, K. (2026) · The Journal of Economic Education · doi:10.1080/00220485.2026.2696947
Qiu, X., Yuan, J., Wu, J., Li, W., Guo, J., & Leung, F. K. S. (2026) · Educational Psychology · doi:10.1080/01443410.2026.2742894
- Authors
- Storey, N., & Zhang, Q.
- Affiliations
- Johns Hopkins University (US)
- National University of Singapore (SG)
- Corresponding author
- Zhang, Qiyang
- Venue
- Educational Research Review
- Publisher
- Elsevier BV
- Published
- 2024-08
- Volume
- 44
- Pages
- 100624
- ISSN
- 1747-938X (ISSN-L)
- OpenAlex
- W4401052909
- Semantic Scholar
- f1ebdbf79db6ec6e230d334fb57a09b88f2a5e1f
- Cited by
- 18
- References
- 54
- Citations by year
- 2026: 9 · 2025: 8 · 2024: 1
- FWCI
- 2.34
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- Educational Research Review (publishedVersion)
- Topics
- Social Sciences › Education › Education during COVID-19 pandemic
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › COVID-19 Pandemic Impacts
- Health Sciences › Medicine › Oncology › COVID-19 and healthcare impacts
- Keywords
- COVID-19 pandemic, learning loss, academic performance, school closures, reading achievement, mathematics achievement, education policy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review