COVID-19, School Closures, and Student Learning Outcomes: New Global Evidence from PISA
Open accessAbstract
The COVID-19 pandemic resulted in significant disruption in schooling worldwide. This paper uses global test score data to estimate learning losses. It models the effect of school closures on achievement by predicting the deviation of the most recent results from a linear trend using data from all rounds of the Programme for International Student Assessment. Scores declined by an average of 14 percent of a standard deviation, roughly equal to seven months of learning. Losses were greater for students in schools that faced relatively longer closures, boys, immigrants, and disadvantaged students. Educational losses may translate into significant national income losses over time.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Jakubowski et al. (2024) found that in schools with average to very short closures, the highest achievers lost the least ground across content areas.
“in schools with average to very short closures, the highest achieving students lost the least ground in terms of academic achievement across all content areas.”
From Unequal Learning Loss: How the COVID-19 Pandemic Influenced the Academic Growth of Learners at the Tails of the Achievement Distribution (2025) · cites this paper as Jakubowski et al. (2024)
The indexed repository passage for the cited paper (no section or page given) says losses were greater in schools with relatively longer closures, supporting the shorter-closure comparison. It does not report that the highest achievers lost the least ground in schools with average-to-very-short closures, or that this held across all content areas. A nearby passage about lower-achieving students belongs to a separately listed publication, not the cited paper. (LLM, conf=0.73)
Experimental — accuracy not yet measuredJakubowski et al. found that in schools with long or very long closures, the most advanced students lost more than average or low-scoring peers.
“this relationship flipped in schools that experienced long of very long closures-the most-advanced students lost more in terms of academic achievement than their average or even low-scoring peers.”
From Unequal Learning Loss: How the COVID-19 Pandemic Influenced the Academic Growth of Learners at the Tails of the Achievement Distribution (2025) · cites this paper as Jakubowski et al. (2024)
The indexed passages are from the repository listing (no paper section or page is available), rather than the paper’s results. Searches for long or very long closures and comparisons between high- and low-scoring students found no passage from the cited paper establishing which group lost more. The decisive part of the paper may be missing from our indexed copy. (LLM, conf=0.68)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
(2022) · doi:10.1787/53f23881-en · Cited by 1,507 · see citing works
World Development Report 2018: Learning to Realize Education's Promise
Bank, W. (2017) · World Bank, Washington, DC eBooks · doi:10.1596/978-1-4648-1096-1 · Cited by 1,310 · see citing works
A systematic review and meta-analysis of the evidence on learning during the COVID-19 pandemic
Betthäuser, B. A., Bach-Mortensen, A. M., & Engzell, P. (2023) · Nature Human Behaviour · doi:10.1038/s41562-022-01506-4 · Cited by 568 · see citing works
The effect of school closures on standardised student test outcomes
Maldonado, J. E., & De Witte, K. (2022) · British Educational Research Journal · doi:10.1002/berj.3754 · Cited by 499 · see citing works
Learning loss during Covid-19: An early systematic review
Donnelly, R., & Patrinos, H. A. (2022) · PROSPECTS · doi:10.1007/s11125-021-09582-6 · Cited by 445 · see citing works
Self-citationMeasuring human capital using global learning data
Angrist, N., Djankov, S., Goldberg, P. K., & Patrinos, H. A. (2021) · Nature · doi:10.1038/s41586-021-03323-7 · Cited by 328 · see citing works
Self-citationThe High Cost of Low Educational Performance
OECD (2010) · Programme for international student assessment/Internationale Schulleistungsstudie · doi:10.1787/9789264077485-en · Cited by 184 · see citing works
Bank, W. (2015) · World Bank, Washington, DC eBooks · doi:10.1596/978-1-4648-0484-7_world_bank_research · Cited by 127 · see citing works
Zierer, K. (2021) · Education Sciences · doi:10.3390/educsci11060252 · Cited by 118 · see citing works
Experimental evidence on learning using low-tech when school is out
Angrist, N., Bergman, P., & Matsheng, M. (2022) · Nature Human Behaviour · doi:10.1038/s41562-022-01381-z · Cited by 105 · see citing works
Pandemic Schooling Mode and Student Test Scores: Evidence from US School Districts
Jack, R., Halloran, C., Okun, J., & Oster, E. (2023) · American Economic Review: Insights · doi:10.1257/aeri.20210748 · Cited by 103 · see citing works
The COVID-19 Cost of School Closures in Earnings and Income across the World
Psacharopoulos, G., Collis, V., Patrinos, H. A., & Vegas, E. (2021) · Comparative Education Review · doi:10.1086/713540 · Cited by 98 · see citing works
Self-citationSchuurman, T. M., Henrichs, L. F., Schuurman, N. K., Polderdijk, S., & Hornstra, L. (2021) · Scandinavian Journal of Educational Research · doi:10.1080/00313831.2021.2006307 · Cited by 67 · see citing works
COVID-19, school closures, and outcomes.
Jack, R., & Oster, E. (2023) · Journal of Economic Perspectives · doi:10.1257/jep.37.4.51 · Cited by 57 · see citing works
The Educational Consequences of Remote and Hybrid Instruction during the Pandemic
Goldhaber, D., Kane, T. J., McEachin, A., Morton, E., Patterson, T., & Staiger, D. O. (2023) · American Economic Review: Insights · doi:10.1257/aeri.20220180 · Cited by 49 · see citing works
An Analysis of COVID-19 Student Learning Loss
Patrinos, H., Vegas, E., & Carter-Rau, R. (2023) · Oxford Research Encyclopedia of Economics and Finance · doi:10.1093/acrefore/9780190625979.013.893 · Cited by 42 · see citing works
Self-citationThe Longer Students Were Out of School, the Less They Learned
Patrinos, H. A. (2023) · Journal of School Choice · doi:10.1080/15582159.2023.2210941 · Cited by 35 · see citing works
Self-citationGambi, L., & Witte, K. D. (2023) · Lirias · Cited by 3 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Learning loss and recovery from the COVID-19 pandemic: A systematic review of evidence
Cruz, N. A. D., Adona, A. J., Molato-Gayares, R., & Park, A. F. (2025) · International Journal of Educational Development · doi:10.1016/j.ijedudev.2025.103271 · Cited by 21 · see citing works
Peters, S. J., Langi, M., Kuhfeld, M., & Lewis, K. (2025) · Journal for the Education of the Gifted · doi:10.1177/01623532241301079 · Cited by 15 · see citing works
The Effect of the Covid‐19 Pandemic on Inequality
Meyer, P. B., Piacentini, J., Frazis, H., Schultz, M., & Sveikauskas, L. (2024) · Review of Income and Wealth · doi:10.1111/roiw.12707 · Cited by 10 · see citing works
Teen social interactions and well-being during the COVID-19 pandemic
Kalenkoski, C. M., & Pabilonia, S. W. (2024) · Review of Economics of the Household · doi:10.1007/s11150-024-09712-x · Cited by 7 · see citing works
Walsh, S. D., Elgar, F. J., Craig, W., Cosma, A. P., Donnelly, P., Harel‐Fisch, Y., Molcho, M., Malinowska-Cieślik, M., Ng, K., & Pickett, W. (2025) · International Journal of Bullying Prevention · doi:10.1007/s42380-025-00296-3 · Cited by 6 · see citing works
Anders, J., Jerrim, J., Rodríguez, M. L. D. G., & Gutiérrez, Ó. D. M. (2025) · Educational Assessment Evaluation and Accountability · doi:10.1007/s11092-025-09470-z · Cited by 5 · see citing works
Kastorff, T., & Heine, J.-H. (2025) · Large-scale Assessments in Education · doi:10.1186/s40536-025-00273-8 · Cited by 4 · see citing works
PIRLS 2021 and PISA 2022 Statistics Show How Serious the Pandemic Losses Are
Crato, N., & Patrinos, H. A. (2024) · Evaluating education: Normative systems and institutional practices · doi:10.1007/978-3-031-69284-0_1 · Cited by 3 · see citing works
Self-citationGomendio, M. (2024) · Evaluating education: Normative systems and institutional practices · doi:10.1007/978-3-031-69284-0_12 · Cited by 1 · see citing works
Ciaschi, M., Fajardo-González, J., & Viollaz, M. (2024) · Review of Economics of the Household · doi:10.1007/s11150-024-09741-6 · Cited by 1 · see citing works
Introduction to Volume 18: A School Choice Revolution?
Maranto, R. (2024) · Journal of School Choice · doi:10.1080/15582159.2024.2308947 · Cited by 1 · see citing works
Strategies for effective CBL implementation: from company selection to course evaluation
López, V. V., Millan-Ramos, M., & Maldonado-Carrillo, R. (2024) · Frontiers in Education · doi:10.3389/feduc.2024.1413974 · Cited by 1 · see citing works
Castellano, K. E., McCaffrey, D. F., Xi, N., Jia, Y., & Hamilton, L. S. (2025) · Large-scale Assessments in Education · doi:10.1186/s40536-025-00242-1 · Cited by 1 · see citing works
Kirsch, C. (2024) · Zeitschrift für Grundschulforschung · doi:10.1007/s42278-024-00209-1 · Cited by 1 · see citing works
Cygan‐Rehm, K. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4944885 · Cited by 1 · see citing works
The Case of the Boiling Frogs: Provincial Indifference to Declining Education OutcomesPreprint
Richards, J. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5193571 · Cited by 1 · see citing works
(España), U. D. L. L., Marrero, G. A., Sicilia, G., (España), U. D. L. L., Bethencourt, C., Rodríguez, L. J. C., (España), U. D. L. L., Pérez, C. N., Marrero, Á. S., & Bianchi, D. (2024) · doi:10.25145/r.2024.01
Ciaschi, M., Fajardo-González, J., & Viollaz, M. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4824718
Colvin, M. K., Reesman, J. L., & Glen, T. (2024) · doi:10.1093/9780197762660.003.0004
Bussink, H., Vervliet, T., & ter Weel, B. (2025) · Empirical Economics · doi:10.1007/s00181-025-02798-x
Singh, R. K., Panda, A. R., Padhi, S. K., & Md., N. (2025) · Research Review Journal of Indian Knowledge Systems. · doi:10.31305/rrjiks.2025.v2.n1.016
Contextualizing private troubles and public issues
Northcut, T. B., & Kumaria, S. (2025) · doi:10.1093/9780197508404.003.0001
COVID-19 school closures, learning losses and intergenerational mobility
Cojocaru, A., Azevedo, J. P., Narayan, A., & Talledo, V. S. M. (2026) · Humanities and Social Sciences Communications · doi:10.1057/s41599-026-06967-w
Harnessing Administrative Data for Policy Evaluation in Labour, Education and Health Economics
Crato, N., Novi, C. D., & Meroni, E. C. (2026) · Professional practice in governance and public organizations · doi:10.1007/978-3-031-99032-8_30
- Authors
- Jakubowski, M., Gajderowicz, T., & Patrinos, H.
- Venue
- World Bank, Washington, DC eBooks
- Publisher
- World Bank, Washington, DC
- Published
- 2024-01-22
- OpenAlex
- W4391151200
- Cited by
- 25
- References
- 18
- Citations by year
- 2026: 3 · 2025: 9 · 2024: 13
- Type
- report
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- World Bank, Washington, DC eBooks (publishedVersion, cc-by)
- The World Bank Open Knowledge Repository (World Bank) (submittedVersion, cc-by)
- Topics
- Social Sciences › Education › Education during COVID-19 pandemic
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › COVID-19 Pandemic Impacts
- Social Sciences › Education › School Choice and Performance
- Keywords
- COVID-19 pandemic, school closures, learning loss, academic performance, PISA, test scores, educational disruption, immigrant students, disadvantaged students, gender differences in learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review