Cited by 42Education during COVID-19 pandemicCOVID-19 Pandemic ImpactsPoverty, Education, and Child Welfare

An Analysis of COVID-19 Student Learning Loss

Patrinos, Harry, Vegas, Emiliana, Carter-Rau, Rohan·2023·Oxford Research Encyclopedia of Economics and Finance

Abstract

The coronavirus disease 2019 (COVID-19) pandemic led to school closures around the world, affecting almost 1.6 billion students. This caused significant disruption to the global education system. Even short interruptions in a child’s schooling have significant negative effects on their learning and can be long lasting. The capacities of education systems to respond to the crisis by delivering remote learning and support to children and families have been diverse and uneven. In response to this disruption, education researchers are beginning to analyze the impact of these school closures on student learning loss. The term learning loss is commonly used in the literature to describe declines in student knowledge and skills. Early reviews of the first wave of lockdowns and school closures suggested significant learning loss in a few countries. A more recent and thorough analysis of recorded learning loss evidence documented since the beginning of the school closures between March 2020 and March 2022 found even more evidence of learning loss. In 36 identified robust studies, the majority identified learning losses that amount to, on average, 0.17 of a standard deviation (SD), equivalent to roughly a one-half school year’s worth of learning. This confirms that learning loss is real and significant and has continued to grow after the first year of the COVID-19 pandemic. Most studies observed increases in inequality where certain demographics of students experienced more significant learning losses than others. The longer the schools remained closed, the greater were the learning losses. For the 19 countries for which there are robust learning loss data, average school closures were 15 weeks, leading to average learning losses of 0.18 SD. Put another way, for every week that schools were closed, learning declined by an average of 0.01 SD. However, there are also outliers—countries that managed to limit the amount of loss. In Nara City, Japan, for example, the initial closures had brought down test scores, but responsive policies largely overcame this decline. In addition, a decreased summer vacation helped. In Denmark, children received good home support and their reading behavior improved significantly. In Sweden, where primary schools did not close during the pandemic, there were no reported learning losses. Further work is needed to increase the quantity of studies produced, particularly in low- and middle-income countries, and to ascertain the reasons for learning loss. Finally, the few cases where learning loss was mitigated should be further investigated to inform continued and future pandemic responses.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1093/acrefore/9780190625979.013.893

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Systematic reviews and meta-analyses suggest an average learning loss attributable to COVID-19 school closures of 0.17 of a standard deviation, at least one-third of a year's worth of learning.

    “Nevertheless, there are several systematic reviews and meta-analyses, and these suggest an average learning loss attributable to COVID-19 school closures of 0.17 of a standard deviation—that is, at least one-third of a year’s worth of learning16–20.”
  • The study's results are similar to what systematic reviews are finding.

    “Interestingly, our results are similar to what systematic reviews are finding learning16–20,44,45.”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 41

  1. Agostinelli, F., Doepke, M., Sorrenti, G., Zilibotti, F. (2022). When the great equalizer shuts down: Schools, peers, and parents in pandemic times. Journal of Public Economics 206 104574. https://doi.org/10.1016/j.jpubeco.2021.104574 · DOI
  2. Amelia, R., G. Kadarisma, N. Fitriani and Y. Ahmadi. (2020). The effect of online mathematics learning on junior high school mathematic resilience during covid-19 pandemic. Journal of Physics. Conf. Ser. 1657 012011 https://iopscience.iop.org/article/10.1088/17426596/1657/1/012011 · DOI
  3. Ardington, C, Willis, G., Kotze, J. (2021). COVID-19 Learning Losses: Early Grade Reading in South Africa. International Journal of Educational Development. https://www.sciencedirect.com/science/article/pii/S0738059321001334 https://www.sciencedirect.com/science/article/pii/S0738059321001334
  4. Azevedo, J.P., Hasan, A., Goldemberg, D., Geven, K. and Iqbal, S.A., 2021. Simulating the potential impacts of COVID-19 school closures on schooling and learning outcomes: A set of global estimates. The World Bank Research Observer , 36 (1), pp.1-40.
  5. Borgonovi, F. and A. Ferrara. (2022). A Longitudinal Perspective on the Effects of COVID-19 on Students' Resilience. The Effect of the Pandemic on the Reading and Mathematics Achievement of 8 th and 5 th Graders in Italy. Available at: http://dx.doi.org/10.2139/ssrn.4025865 · DOI
  6. Casalone, G., A. Michelangeli and U. Turk. (2021). The Effect of Lockdown on Students' Performance: A comparative study between Sweden, Italy and Turkey. Center for European Studies. Paper Series 473. https://www.researchgate.net/publication/353582241\_The\_Effect\_of\_Lockdown\_on\_Students% 27\_Performance\_A\_comparative\_study\_between\_Sweden\_Italy\_and\_Turkey https://www.researchgate.net/publication/353582241_The_Effect_of_Lockdown_on_Students%27_Performance_A_comparative_study_between_Sweden_Italy_and_Turkey
  7. Chaban T.Yu., Rameeva R.S., Denisov I.S., Kersha Yu.D., Zvyagintsev R.S. (2022) Rossiyskaya shkola v period pandemii COVID-19: effekty pervykh dvukh voln i kachestvo obrazovaniya [Russian Schools during the COVID-19 Pandemic: Impact of the First Two Waves on the Quality of Education]. Voprosy obrazovaniya/Educational Studies Moscow, no 1, pp. 160-188. https://doi.org/10.17323/1814-9545-2022-1-160-188 · DOI
  8. 2022/02/DSC, Available at SSRN: https://ssrn.com/abstract=4001431 or http://dx.doi.org/10.2139/ssrn.4001431 · DOI
  9. Chetty, R., Friedman, J.N., Rockoff, J.E. (2014). Measuring the impacts of teachers II: Teacher value-added and student outcomes in adulthood. American Economic Review 104: 2633-2679. https://www.aeaweb.org/articles?id=10.1257/aer.104.9.2633 · DOI · Paper page
  10. Clark, A.E., Nong, H., Zhu, H. and Zhu, R. (2021). Compensating for academic loss: Online learning and student performance during the COVID-19 pandemic. China Economic Review 68, p.101629. https://halshs.archives-ouvertes.fr/halshs-02901505/document
  11. Currie, J., Thomas, D. (2001). Early test scores, school quality and SES: Longrun effects on wage and employment outcomes. Research in Labor Economics 20: 103-132. https://www.emerald.com/insight/content/doi/10.1016/S0147-9121(01)20039-9/full/html https://www.emerald.com/insight/content/doi/10.1016/S0147-9121(0120039-9/full/html) · DOI
  12. Depping, D., Lücken, M., Musekamp, F., & Thonke, F. (2021). Kompetenzstände Hamburger Schüler* innen vor und während der Corona-Pandemie [Alternative pupils' competence measurement in Hamburg during the Corona pandemic]. In D. Fickermann & B. Edelstein (Eds.), Schule während der Corona-Pandemie. Neue Ergebnisse und Überblick über ein dynamisches Forschungsfeld (pp. 51-79). Waxmann. https://doi.org/10.31244/9783830993315.03 https://doi.org/10.31244/9783830993315.03 · DOI · Paper page
  13. Donnelly, R., Patrinos, H.A. (2021). Learning loss during Covid-19: An early systematic review. Prospects https://doi.org/10.1007/s11125-021-09582-6 · DOI · Paper page
  14. Engzell, P., A. Frey and M. Verhagen. (2021). Learning loss due to school closures during the COVID-19 pandemic. Proceedings of the National Academy of Sciences 118(17). https://www.pnas.org/content/118/17/e2022376118
  15. Georgiou, G. (2021). Covid-19's Impact on Children's Reading Scores: Data Trends and Complementary Interview. The Reading League Journal 2(2): 3-33. https://www.researchgate.net/publication/352546252\_Covid- https://www.researchgate.net/publication/352546252_Covid-19%27s_Impact_on_Children%27s_Reading_Scores_Data_Trends_and_Complementary_Interview
  16. 19%27s\_Impact\_on\_Children%27s\_Reading\_Scores\_Data\_Trends\_and\_Complementary\_Intervi ew Gonzalez, T., M.A. de la Rubia, K.P. Hincz, M. Comas-Lopez, L. Subirats, S. Fort an G.M. Sacha. (2020). Influence of COVID-19 confinement on students' performance in higher education. PloS One. https://doi.org/10.1371/journal.pone.0239490 · DOI · Paper page
  17. Gore, J., L. Fray, A. Miller, J. Harris and W. Taggart. (2021). The impact of COVID-19 on student learning in New South Wales primary schools: an empirical study. Aust. Educ. Res. 48, 605-637. https://doi.org/10.1007/s13384-021-00436-w · DOI · Paper page
  18. Haelermans, C., R. Korthals, M. Jacobs, S. de Leeuw, S. Vermeulen, L. van Vugt, B. Aarts, T. Breuer, R. van der Velden, S. van Wetten and I. de Wolf. (2021). Sharp increase in inequality in education in times of the COVID-19-pandemic. ROA. ROA Research Memoranda No. 010 https://doi.org/10.26481/umaror.2021010 · DOI
  19. Hammerstein, S., C. König, T. Dreisörner and A. Frey. (2021). Effects of COVID-19-Related School Closures on Student Achievement-A Systematic Review. Frontiers in Psychology. https://www.frontiersin.org/articles/10.3389/fpsyg.2021.746289/full · DOI
  20. Hevia, F.J., S. Vergara-Lope Tristan, A. Velásquez-Durán and D. Calderón Martín del Campo. (2021). Estimation of the fundamental learning loss and learning poverty related to COVID-19 pandemic in Mexico, International Journal of Educational Development. https://www.sciencedirect.com/science/article/pii/S0738059321001681
  21. Kim, Dl, H.J. Lee, Y. Lin, Y.J. Kang. (2021). Changes in academic performance in the online, integrated system-based curriculum implemented due to the COVID-19 pandemic in a medical school in Korea J Educ Eval Health Prof. 18:24. https://doi.org/10.3352/jeehp.2021.18.24 · DOI
  22. Kuhfeld, M., Ruzek, E., Johnson, A., Tarasawa, B., Lewis, K. (2020). Technical appendix for: Learning during COVID-19. Initial Findings on Students' Reading and Math Achievement and Growth. NWEA. 2020. Available online: https://www.nwea.org/content/uploads/2020/04/COVID-technical-appendix\_2020.04.08.pdf Lichand, G, Dória, C., Onício Leal Neto et al. (2021). The Impacts of Remote Learning in Secondary Education: Evidence from Brazil during the Pandemic, 03 June 2021, PREPRINT (Version 1) available at Research Square. https://doi.org/10.21203/rs.3.rs-568605/v1 · DOI
  23. Ludewig, Ulrich, Ruben Kleinkorres, Rahim Schaufelberger, Theresa Schlitter, Ramona Lorenz, Christoph Koenig, Andreas Frey, Nele McElvany. (2022). COVID-19 Pandemic and Student Reading Achievement - Findings from a School Panel Study. PIRLS. 10.31234/osf.io/hrzae · DOI
  24. Maldonado, J.E. and De Witte, K., 2022. The effect of school closures on standardised student test outcomes. British Educational Research Journal , 48 (1), pp.49-94. Meeter M. (2021).
  25. Moscoviz, L. and D.K. Evans. 2022. Learning Loss and Student Dropouts during the COVID-19 Pandemic: A Review of the Evidence Two Years after Schools Shut Down. CGD Working Paper 609. Washington, DC: Center for Global Development.
  26. Oktariani, F., Fionasari, R., Ramdha, T. (2022). The Impact of Learning Loss due to Family Income Factors on Students' Achievement during the COVID-19 Pandemic. Edunesia: Jurnal Ilmiah Pendidikan 3(1): 12-20. https://www.edunesia.org/index.php/edu/article/view/203
  27. Psacharopoulos, G., V. Collis, H.A. Patrinos and E. Vegas. (2021). The COVID-19 Cost of School Closures in Earnings and Income across the World. Comparative Education Review 65(2): 271-287.
  28. Rahman, A. (2021). The Impact of Covid-19 Pandemic on Students' Learning Outcome in Higher Education. Al-Ishlah: Jurnal Pendidikan 13(2): 1425-1431. http://journal.staihubbulwathan.id/index.php/alishlah/article/viewFile/974/435 http://journal.staihubbulwathan.id/index.php/alishlah/article/viewFile/974/435
  29. Reimer, D., E. Smith, I.G. Andersen, B. Sortkær. (2021). What happens when schools shut down? Investigating inequality in students' reading behavior during Covid-19 in Denmark. Research in Social Stratification and Mobility 71. https://doi.org/10.1016/j.rssm.2020.100568. · DOI
  30. Sabates, R, Carter, E., Stern, J. (2021). Using educational transitions to estimate learning loss due to COVID-19 school closures: The case of Complementary Basic Education in Ghana, International Journal of Educational Development, 82, 102377. https://doi.org/10.1016/j.ijedudev.2021.102377 · DOI
  31. Sayeejan, P., Nithlavarnan A. (2018). Learning Loss and Learning Difficulties of Junior Hindu College, Neervely. The Sri Lanka Journal of South Asian Studies 4(1): 21-38.
  32. Schult, J., Mahler, N., Fauth, B., Lindner, M. (2021). Did students learn less during the COVID19 pandemic? Reading and math competencies before and after the first pandemic wave. https://doi.org/10.31234/osf.io/pqtgf Schuurman, TM., Henrichs, LF, Schuurman, NK, Polderdijk, S., Hornstra, L. (2021). Learning Loss in Vulnerable Student Populations After the First Covid-19 School Closure in the Netherlands, Scandinavian Journal of Educational Research, DOI: · DOI · Paper page
  33. Skar, G.B.U., Graham, S., Huebner, A. (2021). Learning Loss During the COVID-19 Pandemic and the Impact of Emergency Remote Instruction on First Grade Students' Writing: A Natural Experiment. Journal of Educational Psychology. Advance online publication. http://dx.doi.org/10.1037/edu0000701 http://dx.doi.org/10.1037/edu0000701 · DOI
  34. Spitzer, M., Musslick, S. (2020). Academic Performance of K-12 Students in an Online-learning Environment for Mathematics Increased During the Shutdown of Schools in Wake of the Covid19 Pandemic. EdArXiv. https://edarxiv.org/jncwt/
  35. Storey, N., Zhang, Q. (2021). A Meta-analysis of COVID Learning Loss. EdArXiv. https://doi.org/10.35542/osf.io/qekw2 https://doi.org/10.35542/osf.io/qekw2 · DOI
  36. Suroyo, B., Ibrahim, B., Yanuar. (2021). The Effect of Learning Loss on Student's Cognitive Development During Pandemic of COVID-19. https://www.researchgate.net/publication/357577206\_THE\_EFFECT\_OF\_LEARNING\_LOSS\_ ON\_STUDENT'S\_COGNITIVE\_DEVELOPMENT\_DURING\_PANDEMIC\_OF\_COVID-19 https://www.researchgate.net/publication/357577206_THE_EFFECT_OF_LEARNING_LOSS_ON_STUDENT'S_COGNITIVE_DEVELOPMENT_DURING_PANDEMIC_OF_COVID-19
  37. Thorn, W., Vincent-Lancrin, S. (2021), Schooling During a Pandemic: The Experience and Outcomes of Schoolchildren During the First Round of COVID-19 Lockdowns, OECD Publishing, Paris, https://doi.org/10.1787/1c78681e-en · DOI
  38. Tomasik, M., Helbling, L., Moser, U. (2020). Educational gains of in-person vs. distance learning in primary and secondary schools: a natural experiment during the COVID-19 pandemic school closures in Switzerland. International Journal of Psychology. https://doi.org/10.1002/ijop.12728 · DOI · Paper page
  39. van der Velde, M, Florian, S., Rinske, S., Meeter, M, van Rijn Hedderik. (2021). Lockdown Learning: Changes in Online Foreign-Language Study Activity and Performance of Dutch Secondary School Students During the COVID-19 Pandemic. Frontiers in Education 6. https://www.frontiersin.org/article/10.3389/feduc.2021.712987 · DOI
  40. Widodo, A., Umar, U. (2021). Literacy in the Midst of the Pandemic: How are Students' Literacy Skills? Primary: Jurnal Pendidikan Guru Sekolah Dasar 10 (5): 1199-1206. http://dx.doi.org/10.33578/jpfkip.v10i5.8506 · DOI
  41. Wolf, S, Aurino, E, Suntheimer, N, Avornyo, E, Tsinigo, E, Jordan, J, Samanhyia, S, Aber, JL, Behrman, JR. (2021). Learning in the Time of a Pandemic and Implications for Returning to School: Effects of COVID-19 in Ghana. https://repository.upenn.edu/cgi/viewcontent.cgi?article=1027&context=cpre\_workingpapers Zierer, K. (2021). Effects of Pandemic-Related School Closures on Pupils' Performance and Learning in Selected Countries: A Rapid Review. Education Sciences 11(6): 252. https://doi.org/10.3390/educsci11060252 https://doi.org/10.3390/educsci11060252 · DOI · Paper page

Cited by

Sorted by citations

Authors
Patrinos, H., Vegas, E., & Carter-Rau, R.
Affiliations
  • World Bank (US)
  • Harvard University (US)
  • Brookings Institution (US)
Venue
Oxford Research Encyclopedia of Economics and Finance
Published
2023-08-23
OpenAlex
W4386040336
Cited by
42
References
0
Citations by year
2026: 4 · 2025: 6 · 2024: 8 · 2023: 14 · 2022: 10
Type
reference entry
Language
en
Open access
closed
Locations
  • Oxford Research Encyclopedia of Economics and Finance (publishedVersion)
  • RePEc: Research Papers in Economics (submittedVersion)
Topics
  • Social Sciences › Education › Education during COVID-19 pandemic
  • Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › COVID-19 Pandemic Impacts
  • Social Sciences › Safety Research › Poverty, Education, and Child Welfare
Keywords
COVID-19 pandemic, school closures, learning loss, distance education, educational inequality, academic performance, pandemic response policy, summer vacation, low- and middle-income countries

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review