A systematic review and meta-analysis of the evidence on learning during the COVID-19 pandemic
Open accessPublished version of a preprint
Abstract
To what extent has the learning progress of school-aged children slowed down during the COVID-19 pandemic? A growing number of studies address this question, but findings vary depending on context. Here we conduct a pre-registered systematic review, quality appraisal and meta-analysis of 42 studies across 15 countries to assess the magnitude of learning deficits during the pandemic. We find a substantial overall learning deficit (Cohen's d = -0.14, 95% confidence interval -0.17 to -0.10), which arose early in the pandemic and persists over time. Learning deficits are particularly large among children from low socio-economic backgrounds. They are also larger in maths than in reading and in middle-income countries relative to high-income countries. There is a lack of evidence on learning progress during the pandemic in low-income countries. Future research should address this evidence gap and avoid the common risks of bias that we identify.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
12 of 30 cited sources checked · 8 supported · 0 flagged · accuracy not yet measured
- Premisecitation
Under normal circumstances, students improve their performance by around 0.4 standard deviations per school year.
“Under normal circumstances, students generally improve their performance by around 0.4 standard deviations per school year [10][11][12] .”
Quote in the paperSubstantial claim1 of 3 sources checked- cites [10] Azevedo, J. P., Hasan, A., Goldemberg, D., Iqbal, S. A. & Geven, K. Simulating the Potential Impacts of COVID-19 School Closures on Schooling and Learning Outcomes: A Set of Global Estimates (World Bank, 2020). source
The Empirical methodology (p. 15) assumes gains of 0.2–0.5 standard deviations per grade, and Annex A.1 (p. 44) uses 40 PISA points—about 0.4 standard deviations—as a baseline for upper-middle-income countries. The paper does not present 0.4 as a general annual gain for all students; it says gains vary by country income and cautions that differences between grades cannot automatically be equated with students’ progress over a school year. (LLM, conf=0.86)
Experimental — accuracy not yet measured - cites [11] Bloom, H. S., Hill, C. J., Black, A. R. & Lipsey, M. W. Performance trajectories and performance gaps as achievement effect-size benchmarks for educational interventions. J. Res. Educ. Effectiveness 1, 289–328 (2008). source
- cites [12] Hill, C. J., Bloom, H. S., Black, A. R. & Lipsey, M. W. Empirical benchmarks for interpreting effect sizes in research. Child Dev. Perspect. 2, 172–177 (2008). source
- Findingown data
The three largest estimates of learning deficits in the sample were from middle-income countries.
“In fact, the three largest estimates of learning deficits in our sample are from middle-income countries (Fig. 3) [36][37][38] .”
Quote in the paperNot a substantial claim2 of 3 sources checked- cites [36] Ardington, C., Wills, G. & Kotze, J. COVID-19 learning losses: early grade reading in South Africa. Int. J. Educ. Dev. 86, 102480 (2021). source
- cites [37] Hevia, F. J., Vergara-Lope, S., Velásquez-Durán, A. & Calderón, D. Estimation of the fundamental learning loss and learning poverty related to COVID-19 pandemic in Mexico. Int. J. Educ. Dev. 88, 102515 (2022). source
- cites [38] Lichand, G., Doria, C. A., Leal-Neto, O. & Fernandes, J. P. C. The impacts of remote learning in secondary education during the pandemic in Brazil. Nat. Hum. Behav. 6, 1079–1086 (2022). source
- Premisecitation
Existing research on summer vacations, the Ebola outbreak, and the 2005 earthquake shows that suspension of face-to-face teaching can increase educational inequality between children from different socio-economic backgrounds.
“Existing research on the development of learning gaps during summer vacations 17,18 , disruptions to schooling during the Ebola outbreak in Sierra Leone and Guinea 19 , and the 2005 earthquake in Pakistan 20 shows that the suspension of face-to-face teaching can increase educational inequality between children from different socio-economic backgrounds.”
Quote in the paperSubstantial claim1 of 3 sources checked- cites [17] Cooper, H., Nye, B., Charlton, K., Lindsay, J. & Greathouse, S. The effects of summer vacation on achievement test scores: a narrative and meta-analytic review. Rev. Educ. Res. 66, 227–268 (1996). source
- cites [18] Allington, R. L. et al. Addressing summer reading setback among economically disadvantaged elementary students. Read. Psychol. 31, 411–427 (2010). source
- cites [19] Smith, W. C. Consequences of school closure on access to education: lessons from the 2013–2016 Ebola pandemic. Int. Rev. Educ. 67, 53–78 (2021). source
- Premisecitation
Available research on summer learning deficits, student absenteeism, and extreme weather events suggests that learning progress in mathematics is more dependent on formal instruction than in reading.
“Available research on summer learning deficits 17,25 , student absenteeism 26,27 and extreme weather events 28 suggests that learning progress in mathematics is more dependent on formal instruction than in reading.”
Quote in the paperSubstantial claim2 of 3 sources checked- cites [17] Cooper, H., Nye, B., Charlton, K., Lindsay, J. & Greathouse, S. The effects of summer vacation on achievement test scores: a narrative and meta-analytic review. Rev. Educ. Res. 66, 227–268 (1996). source
- cites [25] Alexander, K. L., Entwisle, D. R. & Olson, L. S. Schools, achievement, and inequality: a seasonal perspective. Educ. Eval. Policy Anal. 23, 171–191 (2001). source
- cites [26] Aucejo, E. M. & Romano, T. F. Assessing the effect of school days and absences on test score performance. Econ. Educ. Rev. 55, 70–87 (2016). source
- Premisecitation
Low- and middle-income countries were already struggling with a learning crisis before the pandemic.
“Low-and middle-income countries were already struggling with a learning crisis before the pandemic.”
Quote in the paperNot a substantial claim1 of 3 sources checked- cites [30] Angrist, N., Djankov, S., Goldberg, P. K. & Patrinos, H. A. Measuring human capital using global learning data. Nature 592, 403–408 (2021). source
- cites [31] Torche, F. in Social Mobility in Developing Countries: Concepts, Methods, and Determinants (eds Iversen, V., Krishna, A. & Sen, K.) 139–171 (Oxford Univ. Press, 2021). source
- cites [32] World Development Report 2018: Learning to Realize Education’s Promise (World Bank, 2018).
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
Sending SMS messages with numeracy problems accompanied by short phone calls led to substantial learning gains in numeracy in Botswana.
“sending SMS messages with numeracy problems accompanied by short phone calls was found to lead to substantial learning gains in numeracy in Botswana 47 .”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [47] Angrist, N., Bergman, P. & Matsheng, M. Experimental evidence on learning using low-tech when school is out. Nat. Hum. Behav. 6, 941–950 (2022). source
- Interpretationreasoning
The pandemic has exacerbated educational inequalities between children from different socio-economic backgrounds.
“It suggests that the pandemic has exacerbated educational inequalities between children from different socio-economic backgrounds, which were already large before the pandemic 43,44 .”
Quote in the paperSubstantial claim1 of 2 sources checked- cites [43] Attewell, P. & Newman, K. S. Growing Gaps: Educational Inequality around the World (Oxford Univ. Press, 2010). source
- cites [44] Betthäuser, B. A., Kaiser, C. & Trinh, N. A. Regional variation in inequality of educational opportunity across europe. Socius https://doi.org/10.1177/23780231211019890 (2021). source
The Figure 1 note (p. 1) uses data collected from 2002 to 2018 and shows educational-attainment differences by parents’ education, supporting the sentence’s point that inequalities existed before the pandemic. The paper does not examine the pandemic or whether it exacerbated those inequalities. (LLM, conf=0.87)
Experimental — accuracy not yet measured
- Findingown data
The meta-analysis found a pooled learning deficit of d = -0.14, with a 95% confidence interval from -0.17 to -0.10.
“The pooled effect size across all studies is d = -0.14, t(41) = -7.30,two-tailed P = 0.000, 95% confidence interval (CI) -0.17 to -0.10.”
- Also stated in: § Abstract · plain
“We find a substantial overall learning deficit (Cohen's d = -0.14, 95% confidence interval -0.17 to -0.10)”
Quote in the paperSubstantial claim - Also stated in: § Abstract · plain
- Findingown data
A large majority of estimates indicate an increase in educational inequality between children from different socio-economic backgrounds during the pandemic.
“A large majority of estimates indicate an increase in educational inequality between children from different socio-economic backgrounds.”
Quote in the paperSubstantial claim - Findingown data
The available data on school closures lack sufficient depth to meaningfully examine the association between school closure variation and learning deficits.
“the available data on school closures lack sufficient depth with respect to variation of school closures within countries, across grade levels and with respect to different modes of instruction, to meaningfully examine this association.”
Quote in the paperSubstantial claim - Findingnone given
Studies at risk of confounding typically compared only two timepoints without accounting for longer time trends in learning progress.
“Studies rated at risk of confounding typically compared only two timepoints, without accounting for longer time trends in learning progress.”
Quote in the paperNot a substantial claim - Findingown data
Publication bias does not appear to be a major concern.
“Publication bias thus does not appear to be a major concern.”
Quote in the paperNot a substantial claim - Findingown data
There was no evidence of variation in learning deficits across grade levels, with a mean difference of δ = -0.01, 95% CI -0.06 to 0.03, and P = 0.556.
“Our analysis yields no evidence of variation in learning deficits across grade levels (mean difference δ = -0.01,t(41) = -0.59,two-tailed P = 0.556, 95% CI -0.06 to 0.03).”
Quote in the paperSubstantial claim - Findingown data
Learning deficits were larger in maths than in reading, with a mean difference of δ = -0.07, 95% CI -0.11 to -0.04, and P = 0.000.
“the estimated learning deficits during the COVID-19 pandemic are larger for maths than for reading (mean difference δ = -0.07,t(41) = -4.02,two-tailed P = 0.000, 95% CI -0.11 to -0.04).”
- Also stated in: § Abstract · plain
“They are also larger in maths than in reading”
Quote in the paperSubstantial claim - Also stated in: § Abstract · plain
- Findingown data
Learning deficits were larger for children from low socio-economic backgrounds.
“Learning deficits are particularly large among children from low socio-economic backgrounds.”
- Also stated in: § Discussion · hedged
“Most studies that we identify find that learning deficits have been largest for children from disadvantaged socio-economic backgrounds.”
Quote in the paperSubstantial claim - Also stated in: § Discussion · hedged
- Findingown data
The large majority of identified studies do not provide evidence on learning deficits separately by gender.
“the large majority of the identified studies do not provide evidence on learning deficits separately by gender.”
- Also stated in: § Discussion · plain
“The large majority of the studies that we identify do not examine learning deficits separately by gender.”
Quote in the paperSubstantial claim - Also stated in: § Discussion · plain
- Findingown data
There is a lack of evidence on learning progress during the pandemic in low-income countries.
“There is a lack of evidence on learning progress during the pandemic in low-income countries.”
- Also stated in: § The geographic reach of evidence is limited · plain
“no studies from low-income countries.”
Quote in the paperSubstantial claim - Also stated in: § The geographic reach of evidence is limited · plain
- Findingown data
Learning deficits were larger in middle-income countries than in high-income countries, with a mean difference of δ = -0.29, 95% CI -0.50 to -0.08, and P = 0.008.
“The learning deficit is appreciably larger in middle-income countries than in high-income countries (mean difference δ = -0.29,t(41) = -2.78,two-tailed P = 0.008, 95% CI -0.50 to -0.08).”
- Also stated in: § Abstract · plain
“and in middle-income countries relative to high-income countries.”
Quote in the paperSubstantial claim - Also stated in: § Abstract · plain
- Findingown data
The systematic review identified 42 studies on learning progress during the COVID-19 pandemic that met the inclusion criteria.
“Our systematic review identified 42 studies on learning progress during the COVID-19 pandemic that met our inclusion criteria.”
- Also stated in: § Results · plain
“resulting in a total of 42 studies.”
Quote in the paperSubstantial claim - Also stated in: § Results · plain
- Findingown data
The association between date of measurement and magnitude of learning deficit was not statistically significant, with β months = -0.00, 95% CI -0.01 to 0.00, and P = 0.097.
“We find no evidence that the slope coefficient is different from zero (β months = -0.00,t(41) = -7.30,two-tailed P = 0.097, 95% CI -0.01 to 0.00).”
Quote in the paperSubstantial claim - Findingown data
About half of the identified studies are rated as having a serious or critical risk of bias.
“A further limitation is that about half of the studies that we identify are rated as having a serious or critical risk of bias.”
Quote in the paperSubstantial claim - Findingown data
Among the estimates of COVID-19 learning deficits, reading estimates have a median of -0.09 (interquartile range -0.15 to -0.02).
“a, Learning subject (reading versus maths).Median: reading -0.09, maths -0.18.Interquartile range: reading -0.15 to -0.02, maths -0.23 to -0.09.”
Quote in the paperNot a substantial claim - Findingown data
Among the estimates of COVID-19 learning deficits, secondary-level estimates have a median of -0.12 (interquartile range -0.21 to -0.06).
“b, Level of education (primary versus secondary).Median: primary -0.12, secondary -0.12.Interquartile range: primary -0.19 to -0.05, secondary -0.21 to -0.06.”
Quote in the paperNot a substantial claim - Findingown data
Among the estimates of COVID-19 learning deficits, estimates from middle-income countries have a median of -0.37 (interquartile range -0.65 to -0.30).
“c, Country income level (high versus middle).Median: high -0.12,middle -0.37.Interquartile range: high -0.20 to -0.05, middle -0.65 to -0.30.”
Quote in the paperNot a substantial claim - Findingown data
Among the estimates of COVID-19 learning deficits, estimates from high-income countries have a median of -0.12 (interquartile range -0.20 to -0.05).
“c, Country income level (high versus middle).Median: high -0.12,middle -0.37.Interquartile range: high -0.20 to -0.05, middle -0.65 to -0.30.”
Quote in the paperNot a substantial claim - Findingown data
Among the estimates of COVID-19 learning deficits, maths estimates have a median of -0.18 (interquartile range -0.23 to -0.09).
“a, Learning subject (reading versus maths).Median: reading -0.09, maths -0.18.Interquartile range: reading -0.15 to -0.02, maths -0.23 to -0.09.”
Quote in the paperNot a substantial claim - Findingnone given
The study is a systematic review and meta-analysis of all existing studies of changes in learning progress of school-aged children during the COVID-19 pandemic that use test scores standardizable across studies with Cohen's d.
“Our study provides a systematic review and meta-analysis of all existing studies of changes in learning progress of school-aged children during the COVID-19 pandemic, which use test scores that can be standardized across studies using Cohen's d.”
Quote in the paperSubstantial claim - Findingnone given
Estimates of learning deficits are based on distinct samples of students.
“However, it is important to note that estimates of learning deficits are based on distinct samples of students.”
Quote in the paperNot a substantial claim - Findingown data
Among the estimates of COVID-19 learning deficits, primary-level estimates have a median of -0.12 (interquartile range -0.19 to -0.05).
“b, Level of education (primary versus secondary).Median: primary -0.12, secondary -0.12.Interquartile range: primary -0.19 to -0.05, secondary -0.21 to -0.06.”
Quote in the paperNot a substantial claim - Findingown data
The pattern of persistent learning deficits also emerges within the United States, the UK, and the Netherlands.
“the pattern of persistent learning deficits also emerges within each of the three countries for which we have a relatively large number of estimates at different timepoints: the United States, the UK and the Netherlands.”
Quote in the paperSubstantial claim - Findingown data
The evidence base includes 15 countries: Australia, Belgium, Brazil, Colombia, Denmark, Germany, Italy, Mexico, the Netherlands, South Africa, Spain, Sweden, Switzerland, the UK, and the United States.
“grouped by the 15 countries represented: Australia, Belgium, Brazil, Colombia, Denmark, Germany, Italy, Mexico, the Netherlands, South Africa, Spain, Sweden, Switzerland, the UK and the United States.”
Quote in the paperSubstantial claim - Interpretationown data
The study could not be certain whether learning deficits differ between primary and secondary students because of the limited number of available estimates.
“Due to the limited number of available estimates of learning deficits, we cannot be certain about whether learning deficits differ between primary and secondary students or not.”
Quote in the paperSubstantial claim - Premisecitation
Sending motivational text messages successfully limited learning losses in maths and Portuguese in Brazil.
“Sending motivational text messages successfully limited learning losses in maths and Portuguese in Brazil 48 .”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [48] Lichand, G., Christen, J. & van Egeraat, E. Do Behavioral Nudges Work under Remote Learning? Evidence from Brazil during the Pandemic (Univ. Zurich, 2022). source
- Interpretationown data
The available evidence is too limited to support multivariate or causal analyses.
“given that the limited amount of available evidence precludes multivariate or causal analyses, we examine the bivariate association between COVID-19 learning deficits and the months in which learning was measured using a scatter plot”
Quote in the paperSubstantial claim - Premisecitation
Experimental evidence from low- and middle-income countries suggests that relatively low-tech and low-cost learning interventions can have substantial positive effects on students' learning progress in remote learning.
“Experimental evidence from low-and middle-income countries suggests that even relatively low-tech and low-cost learning interventions can have substantial, positive effects on students' learning progress in the context of remote learning.”
Quote in the paperSubstantial claim - Interpretationreasoning
The pooled effect of d = -0.14 implies that students lost about 35% of a school year's worth of learning.
“Thus, the overall effect of d = -0.14suggests that students lost out on 0.14/0.4,or about 35%, of a school year's worth of learning.”
- Also stated in: § Discussion · plain
“The pooled effect size of d = -0.14, implies that students lost out on about 35% of a normal school year's worth of learning.”
Quote in the paperSubstantial claim - Also stated in: § Discussion · plain
- Interpretationreasoning
Learning deficits are likely to be even larger in low-income countries than in middle-income countries.
“Learning deficits are likely to be even larger in low-income countries, considering that these countries already faced a learning crisis before the pandemic, generally implemented longer school closures, and were under-resourced and ill-equipped to facilitate remote learning [32][33][34][35]45 .”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites [32] World Development Report 2018: Learning to Realize Education’s Promise (World Bank, 2018).
Not checked in the free run.
- cites [33] Policy Brief: Education during COVID-19 and Beyond (United Nations, 2020).
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [34] One Year into COVID-19 Education Disruption: Where Do We Stand? (UNESCO, 2021).
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Classified as probably not a substantial claim. 18
- May combine two claims. 18
Classified as probably not a substantial claim.
Study design and conductown dataStudies rated at critical risk of bias (n = 19) were excluded from all analyses and figures except Fig. 2a.
“we excluded studies rated to be at critical risk of bias (n = 19) from all of our analyses and figures, except for Fig. 2a”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [9] Sterne, J. A. et al. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. BMJ https://doi.org/10.1136/bmj.i4919 (2016). source
The Discussion (page unavailable in our copy) recommends excluding studies at critical risk of bias from meta-analyses. It does not report that the citing authors excluded 19 studies from all analyses and figures except Fig. 2a; those details describe the citing authors’ own review. (LLM, conf=0.85)
Experimental — accuracy not yet measured
May combine two claims.
PremisecitationExisting research on teacher strikes, shortened school years, and disruptions during World War II suggests that learning deficits are difficult to compensate and tend to persist in the long run.
“existing research on teacher strikes in Belgium 13 and Argentina 14 , shortened school years in Germany 15 and disruptions to education during World War II 16 suggests that learning deficits are difficult to compensate and tend to persist in the long run.”
Quote in the paperSubstantial claim1 of 3 sources checked- cites [13] Belot, M. & Webbink, D. Do teacher strikes harm educational attainment of students? Labour 24, 391–406 (2010). source
- cites [14] Jaume, D. & Willén, A. The long-run effects of teacher strikes: evidence from Argentina. J. Labor Econ. 37, 1097–1139 (2019). source
- cites [15] Cygan-Rehm, K. Are there no wage returns to compulsory schooling in Germany? A reassessment. J. Appl. Econ. 37, 218–223 (2022). source
The Introduction (p. 4) identifies shortened school years in Germany, and the Results (p. 9) report negative effects on wages and schooling duration. Those findings support a lasting adverse outcome, but the paper does not establish that learning deficits persisted or were difficult to compensate. (LLM, conf=0.82)
Experimental — accuracy not yet measured
Classified as probably not a substantial claim.
Study design and conductown dataThe study used an adapted version of the ROBINS-I tool to assess risk of bias.
“We assessed the quality of the evidence using an adapted version of the Risk Of Bias In Non-randomized Studies of Interventions (ROBINS-I) tool 9 .”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [9] Sterne, J. A. et al. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. BMJ https://doi.org/10.1136/bmj.i4919 (2016). source
May combine two claims.
Findingown dataSome studies reported higher missing data post-pandemic, generally without adjustment, and several did not report any information on missing data.
“Some studies also reported a higher amount of missing data post-pandemic, again generally without adjustment, and several studies did not report any information on missing data.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe learning deficit arose early in the pandemic and persisted over time without closing or substantially widening.
“which arose early in the pandemic and persists over time.”
- Also stated in: § Learning deficits arose early in the pandemic and persist · hedged
“The figure suggests that learning deficits opened up early in the pandemic and have neither closed nor substantially widened since then.”
Quote in the paperSubstantial claim- Also stated in: § Learning deficits arose early in the pandemic and persist · hedged
May combine two claims.
Findingown dataCommon sources of potential bias were confounding, sample selection, and missing data.
“common sources of potential bias were confounding, sample selection and missing data.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataSeveral studies found evidence of selection bias, often with low socio-economic students or deprived schools under-represented after the pandemic, but this was not always adjusted for.
“Several studies found evidence of selection bias, often with students from a low socio-economic background or schools in deprived areas being under-represented after (as compared with before) the pandemic, but this was not always adjusted for.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe evidence base over-represents high-income countries and has a dearth of studies from middle-income countries.
“there is a strong over-representation of studies from high-income countries, a dearth of studies from middle-income countries and no studies from low-income countries.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe overall risk of bias was low for 15% of studies, moderate for 30%, serious for 25%, and critical for 30%.
“The overall risk of bias was considered 'low' for 15% of studies, 'moderate' for 30% of studies, 'serious' for 25% of studies and 'critical' for 30% of studies.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe increase in educational inequality held for both maths and reading, across primary and secondary education, at each stage of the pandemic, and independently of how socio-economic background was measured.
“This holds for both maths and reading, across primary and secondary education, at each stage of the pandemic, and independently of how socio-economic background is measured.”
Quote in the paperSubstantial claimMay combine two claims.
FindingreasoningMost studies provide multiple estimates, so the number of estimates (n = 291) is larger than the number of included studies (n = 42).
“Most studies provide multiple estimates of COVID-19 learning deficits, separately for maths and reading and for different school grades.The number of estimates (n = 291) is therefore larger than the number of included studies (n = 42).”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Findingnone givenThe studies included in this systematic review and meta-analysis examine children aged 5 to 18.
“The studies included in this systematic review and meta-analysis examine children aged between 5 and 18.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataNineteen of the 61 studies shown in the risk-of-bias figure were rated at critical risk of bias.
“including studies rated to be at critical risk of bias (n = 19 out of a total of n = 61 studies shown in this figure)”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe formal database search identified 15 eligible studies, and citation and preprint hand searches identified 27 additional studies, totaling 42.
“The formal database search process identified 15 eligible studies.”
- Also stated in: § Results · plain
“The citation and preprint hand searches allowed us to identify 27 additional eligible studies, resulting in a total of 42 studies.”
Quote in the paperNot a substantial claim- Also stated in: § Results · plain
Probably not a substantial claim: may not pass S3 (load-bearing).
Findingnone givenThe studies included in this systematic review and meta-analysis generally did not disaggregate effect sizes by sex or gender.
“The studies included in this systematic review and meta-analysis generally did not disaggregate effect sizes by sex or gender.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataAbout half of the estimates (n = 149) are from the United States, 58 from the UK, 70 from other European countries, and 14 from Australia, Brazil, Colombia, Mexico, and South Africa.
“About half of the estimates (n = 149) are from the United States, 58 are from the UK, a further 70 are from other European countries and the remaining 14 estimates are from Australia, Brazil, Colombia, Mexico and South Africa.”
Quote in the paperSubstantial claimMay combine two claims.
Study design and conductown dataThe maths-reading difference was statistically significant and robust to dropping estimates from individual countries.
“This difference is statistically significant and robust to dropping estimates from individual countries (Supplementary Fig. 9).”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenThe systematic review and meta-analysis was pre-registered.
“Here we conduct a pre-registered systematic review, quality appraisal and meta-analysis of 42 studies across 15 countries to assess the magnitude of learning deficits during the pandemic.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataThe results were replicated excluding studies deemed to be at serious risk of bias.
“we replicate all our results excluding studies deemed to be at serious risk of bias.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataThe authors prospectively registered a protocol of the systematic review and meta-analysis in PROSPERO (CRD42021249944) on 19 April 2021.
“We prospectively registered a protocol of our systematic review and meta-analysis in the International Prospective Register of Systematic Reviews (CRD42021249944) on 19 April 2021”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenThe funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
“The funders had no role in study design, data collection and analysis, decision to publish or preparation of the manuscript.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Study design and conductcitationStudies rated at critical risk of bias were excluded from all analyses and figures, following ROBINS-I guidance.
“In line with ROBINS-I guidance, studies rated to be at critical risk of bias were excluded from all analyses and other figures in this article and in the Supplementary Information (including b).”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Study design and conductown dataStudies were included in the review and meta-analysis according to the inclusion criteria in the pre-registered protocol.
“Studies were included in the systematic review and meta-analysis based on the inclusion criteria described in the pre-registered study protocol”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenData extraction was performed by B.A.B. and validated independently by A.M.B.-M., with discrepancies resolved through discussion and by conferring with P.E.
“Data extraction was performed by B.A.B. and validated independently by A.M.B.-M., with discrepancies resolved through discussion and by conferring with P.E.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationSchools in low- and middle-income countries have been closed for longer and have had fewer resources to facilitate remote learning.
“Schools in low-and middle-income countries have not only been closed for longer, but have also had fewer resources to facilitate remote learning 33,34 .”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [33] Policy Brief: Education during COVID-19 and Beyond (United Nations, 2020).
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [34] One Year into COVID-19 Education Disruption: Where Do We Stand? (UNESCO, 2021).
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenAll studies were double screened by the first two authors.
“All studies were double screened by the first two authors.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenAll code needed to replicate the findings is available on the Open Science Framework repository.
“All code needed to replicate our findings is available on the Open Science Framework repository (https://doi.org/10.17605/osf.io/u8gaz).”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationThe economic resources, availability of digital learning equipment, and ability to support learning from home are likely lower in low- and middle-income countries.
“the economic resources, availability of digital learning equipment and ability of children, parents, teachers and governments to support learning from home are likely to be lower in low-and middle-income countries 35 .”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [35] Azevedo, J. P., Hasan, A., Goldemberg, D., Geven, K. & Iqbal, S. A. Simulating the potential impacts of COVID-19 school closures on schooling and learning outcomes: a set of global estimates. World Bank Res. Observer 36, 1–40 (2021).
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenThe reported estimates, confidence intervals and significance tests for the bivariate associations come from common-effects models with standard errors clustered by study and two-sided tests.
“The reported estimates, CIs and statistical significance tests of these bivariate associations are based on common-effects models with standard errors clustered by study, and two-sided tests.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: The distribution of the data is normal.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataRisk-of-bias assessments were performed by A.M.B.-M. and B.A.B. and independently checked by the other author.
“A.M.B.-M.and B.A.B. performed the risk-of-bias assessments, which were independently checked by the respective other author.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenAll titles and abstracts identified in the search were double-screened using the Rayyan online application.
“All titles and abstracts identified in our search were double-screened using the Rayyan online application (last accessed on August 8, 2022).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenData extraction was done by the first author and independently validated by the second author, with discrepancies resolved by discussion and consultation with the third author.
“Data extraction was performed by the first author and validated independently by the second author, with discrepancies resolved through discussion and by conferring with the third author.”
Quote in the paperNot a substantial claim
The paper relies on this without support.
The COVID-19 pandemic caused one of the largest disruptions to learning in history.
“The coronavirus disease 2019 (COVID-19) pandemic has led to one of the largest disruptions to learning in history.”
The paper relies on this without support.
The pandemic's consequences for children's out-of-school learning environment, mental health, and physical health compound the effect of limited face-to-face instruction.
“The effect of limited face-to-face instruction is compounded by the pandemic's consequences for children's out-of-school learning environment, as well as their mental and physical health.”
The paper relies on this without support.
The COVID-19 learning deficit will affect children's life chances through education and labour market prospects and have societal implications for growth, prosperity, and social cohesion.
“The COVID-19 learning deficit is likely to affect children's life chances through their education and labour market prospects.At the societal level, it can have important implications for growth, prosperity and social cohesion.”
The authors state this as an assumption.
The distribution of the data is normal.
“With respect to statistical tests reported, the data distribution was assumed to be normal, but this was not formally tested.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
After a period dominated by remote and hybrid teaching models due to the COVID-19 pandemic, there has been a return to in-person, group learning activities, with early indications of better academic outcomes in students at all education levels.
“After a period dominated by remote and hybrid teaching models due to the COVID-19 pandemic, there has been a return to in-person, group learning activities, with early indications of better academic outcomes in students at all education levels (23–28).”
From Global Health Trade Summit: an AI-enhanced simulation of international trade and global health for undergraduate public health education (2025) · cites this paper as [24]
Split into 2 atoms — 0 confirmed, 1 partially supported, 1 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredSystematic reviews and meta-analyses suggest an average learning loss attributable to COVID-19 school closures of 0.17 of a standard deviation, at least one-third of a year's worth of learning.
“Nevertheless, there are several systematic reviews and meta-analyses, and these suggest an average learning loss attributable to COVID-19 school closures of 0.17 of a standard deviation—that is, at least one-third of a year’s worth of learning16–20.”
From COVID-19, school closures, and student learning outcomes. New global evidence from PISA (2025) · cites this paper as [16]
The Results section (page not specified) reports an average deficit of 0.14 standard deviations, equivalent to about 35% of a school year. The claimed 0.17 is the bound of the reported confidence interval, not the average. The paper measures learning deficits during the pandemic and identifies school closures as a major contributor, but does not attribute the entire pooled deficit specifically to closures. (LLM, conf=0.90)
Experimental — accuracy not yet measuredThe COVID-19 pandemic substantially harmed the average American student's achievement.
“The COVID-19 pandemic had substantial negative effects on the average American student's achievement (Betthäuser et al., 2023;Cohodes et al., 2022).”
From Unequal Learning Loss: How the COVID-19 Pandemic Influenced the Academic Growth of Learners at the Tails of the Achievement Distribution (2025) · cites this paper as Betthäuser et al., 2023
The Discussion reports a substantial average learning deficit across the countries studied. The section ‘Learning deficits arose early in the pandemic and persist’ says persistent deficits also appear in US estimates, but it does not establish that the estimated effect represents the average American student or give a US-specific magnitude described as substantial. (LLM, conf=0.82)
Experimental — accuracy not yet measuredThe activity was designed in the post-pandemic era, where residual complexities from pandemic-era education must be taken into account.
“This activity was designed in the post-pandemic era, where residual complexities from pandemic-era education must be taken into account (24, 91).”
From Global Health Trade Summit: an AI-enhanced simulation of international trade and global health for undergraduate public health education (2025) · cites this paper as [24]
The study's results are similar to what systematic reviews are finding.
“Interestingly, our results are similar to what systematic reviews are finding learning16–20,44,45.”
From COVID-19, school closures, and student learning outcomes. New global evidence from PISA (2025) · cites this paper as [16]
The differences in learning deficits between countries are striking.
“The differences in learning deficits between countries are striking, and further research is needed to understand why some countries have experienced greater deficits than others.”
From School closure policies and student reading achievement: evidence across countries (2023) · cites this paper as Betthäuser et al., 2023
An emerging body of literature has documented significant declines in student academic performance following the onset of the COVID-19 pandemic, with varying levels of reported learning deficits across countries.
“An emerging body of literature has documented significant declines in student academic performance following the onset of the COVID-19 pandemic, with varying levels of reported learning deficits experienced across countries (e.g., Betthäuser et al., 2023;Di Pietro, 2023).”
From School closure policies and student reading achievement: evidence across countries (2023) · cites this paper as Betthäuser et al., 2023
Both meta-analyses revealed a significant decline in academic achievement following the outbreak of the pandemic, with similar mean effect sizes of Cohen's d = -0.14 and -0.17.
“Drawing on over 45 individual studies from 18 countries, both meta-analyses revealed a significant decline in academic achievement following the outbreak of the pandemic, with similar mean effect sizes of Cohen's d = -0.14 and -0.17.”
From School closure policies and student reading achievement: evidence across countries (2023) · cites this paper as Betthäuser et al., 2023
The true impact of school closure policies may be larger than the effects estimated in this study because other subjects (mathematics) were impacted more by the pandemic than reading.
“Evidence showing that other subjects (i.e., mathematics) were impacted more by the pandemic than reading makes it important to note that the true impact of the school closure policies may be larger than the effects estimated in this study (Betthäuser et al., 2023;Di Pietro, 2023).”
From School closure policies and student reading achievement: evidence across countries (2023) · cites this paper as Betthäuser et al., 2023
With an international standard deviation of 100, this is an average effect of 0.15 SD, which aligns remarkably well with results from several meta-analyses.
“With an international standard deviation of 100, this would be an average effect of 0.15 SD which aligns remarkably well with results from several meta-analyses (e.g., Storey & Zhang, 2021;König & Frey, 2022;Betthäuser et al., 2023;Di Pietro, 2023).”
From School closure policies and student reading achievement: evidence across countries (2023) · cites this paper as Betthäuser et al., 2023
In this paper, approximately 33.9% of the effect sizes are derived from US and UK studies, compared to about 71.1% in Betthäuser et al. (2023).
“For instance, while in Betthäuser et al. (2023) about 71.1% of the effect sizes are derived from these studies, in our paper the corresponding figure is approximately 33.9%.”
From The impact of Covid-19 on student achievement: Evidence from a recent meta-analysis (2023) · cites this paper as Betthäuser et al. (2023)
The findings from the RVE analysis are broadly consistent with those from previous meta-analyses (Storey and Zhang 2021a: 0.15 SD; König and Frey 2022: 0.175 SD; Betthäuser et al. 2023: 0.14 SD).
“our findings from the RVE analysis are broadly consistent with those from previous meta-analyses. Storey and Zhang (2021a) concluded that due to Covid-19 students lost, on average, 0.15 standard deviations of learning, König and Frey (2022) found average losses of 0.175 standard deviations, and Betthäuser et al. (2023) estimated average losses at 0.14 standard deviations.”
From The impact of Covid-19 on student achievement: Evidence from a recent meta-analysis (2023) · cites this paper as Betthäuser et al. (2023)
Statistics recomputed
Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.
- ConsistentQ(41) = 112817.79reported p = 0 · recomputed p < .001
“Q(41) = 112,817.79,p = .000”
- Consistentt(41) = -7.3reported p = 0 · recomputed p < .001
“t(41) = -7.30,p = .000”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
February 2022 citation-search dates disagree
MinorThe Results section dates the first full forward and backward citation search to 15 February 2022, whereas the Methods section dates it to 14 February 2022.
“we conducted two full forward and backward citation searches of all included studies on 15 February 2022, and on 8 August 2022.”
“we conducted two forward and backward citation searches of all eligible studies identified in the above steps, on 14 February 2022, and on 8 August 2022”
Cites
Rayyan-a web and mobile app for systematic reviews.
Ouzzani, M., Hammady, H., Fedorowicz, Z., & Elmagarmid, A. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0384-4 · Cited by 26,092 · see citing works
ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions
Sterne, J. A., Hernán, M. A., Reeves, B. C., Savović, J., Berkman, N. D., Viswanathan, M., Henry, D., Altman, D. G., Ansari, M. T., Boutron, I., et al. (2016) · BMJ · doi:10.1136/bmj.i4919 · Cited by 20,329 · see citing works
A basic introduction to fixed-effect and random-effects models for meta-analysis
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.12 · Cited by 6,793 · see citing works
Learning loss due to school closures during the COVID-19 pandemic
Engzell, P., Frey, A., & Verhagen, M. D. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2022376118 · Cited by 1,848 · see citing works
Self-citationLearning loss due to school closures during the COVID-19 pandemic
Engzell, P., Frey, A., & Verhagen, M. D. (2020) · doi:10.31235/osf.io/ve4z7 · Cited by 1,739 · see citing works
The Effects of Summer Vacation on Achievement Test Scores: A Narrative and Meta-Analytic Review
Cooper, H., Nye, B., Charlton, K., Lindsay, J., & Greathouse, S. (1996) · Review of Educational Research · doi:10.3102/00346543066003227 · Cited by 991 · see citing works
Empirical Benchmarks for Interpreting Effect Sizes in Research
Hill, C. J., Bloom, H. S., Black, A. R., & Lipsey, M. W. (2008) · Child Development Perspectives · doi:10.1111/j.1750-8606.2008.00061.x · Cited by 950 · see citing works
Schools, Achievement, and Inequality: A Seasonal Perspective
Alexander, K. L., Entwisle, D. R., & Olson, L. S. (2001) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737023002171 · Cited by 575 · see citing works
The effect of school closures on standardised student test outcomes
Maldonado, J. E., & De Witte, K. (2022) · British Educational Research Journal · doi:10.1002/berj.3754 · Cited by 499 · see citing works
Bloom, H. S., Hill, C. J., Black, A. R., & Lipsey, M. W. (2008) · Journal of Research on Educational Effectiveness · doi:10.1080/19345740802400072 · Cited by 477 · see citing works
Goldemberg, D., Azevedo, J. P., Iqbal, S. A., Hasan, A., & Geven, K. (2020) · doi:10.1596/1813-9450-9284 · Cited by 476 · see citing works
Effects of COVID-19-Related School Closures on Student Achievement-A Systematic Review
Hammerstein, S., König, C., Dreisörner, T., & Frey, A. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.746289 · Cited by 461 · see citing works
Learning loss during Covid-19: An early systematic review
Donnelly, R., & Patrinos, H. A. (2022) · PROSPECTS · doi:10.1007/s11125-021-09582-6 · Cited by 445 · see citing works
The harvest plot: A method for synthesising evidence about the differential effects of interventions
Ogilvie, D., Fayter, D., Petticrew, M. P., Sowden, A. J., Thomas, S., Whitehead, M. M., & Worthy, G. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-8 · Cited by 423 · see citing works
Tomasik, M. J., Helbling, L. A., & Moser, U. (2021) · International Journal of Psychology · doi:10.1002/ijop.12728 · Cited by 378 · see citing works
Measuring human capital using global learning data
Angrist, N., Djankov, S., Goldberg, P. K., & Patrinos, H. A. (2021) · Nature · doi:10.1038/s41586-021-03323-7 · Cited by 328 · see citing works
Kaffenberger, M. (2021) · International Journal of Educational Development · doi:10.1016/j.ijedudev.2020.102326 · Cited by 308 · see citing works
The Long‐Run Educational Cost of World War II
Ichino, A., & Winter‐Ebmer, R. (2004) · Journal of Labor Economics · doi:10.1086/380403 · Cited by 307 · see citing works
Goudeau, S., Sanrey, C., Stanczak, A., Manstead, A. S. R., & Darnon, C. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01212-7 · Cited by 286 · see citing works
Schult, J., Mahler, N., Fauth, B., & Lindner, M. A. (2022) · School Effectiveness and School Improvement · doi:10.1080/09243453.2022.2061014 · Cited by 262 · see citing works
Addressing Summer Reading Setback Among Economically Disadvantaged Elementary Students
Allington, R. L., McGill-Franzen, A., Camilli, G., Williams, L., Graff, J., Zeig, J., Zmach, C., & Nowak, R. (2010) · Reading Psychology · doi:10.1080/02702711.2010.505165 · Cited by 256 · see citing works
Assessing the effect of school days and absences on test score performance
Aucejo, E. M., & Romano, T. F. (2016) · Economics of Education Review · doi:10.1016/j.econedurev.2016.08.007 · Cited by 222 · see citing works
Large socio-economic, geographic and demographic disparities exist in exposure to school closures
Parolin, Z., & Lee, E. K. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01087-8 · Cited by 217 · see citing works
The impact of COVID-19 on student learning in New South Wales primary schools: an empirical study
Gore, J., Fray, L., Miller, A., Harris, J., & Taggart, W. (2021) · The Australian Educational Researcher · doi:10.1007/s13384-021-00436-w · Cited by 201 · see citing works
Flaking Out: Student Absences and Snow Days as Disruptions of Instructional Time
Goodman, J. (2014) · doi:10.3386/w20221 · Cited by 177 · see citing works
The Detrimental Effects of Missing School: Evidence from Urban Siblings
Gottfried, M. A. (2011) · American Journal of Education · doi:10.1086/657886 · Cited by 171 · see citing works
COVID-19 learning losses: Early grade reading in South Africa
Ardington, C., Wills, G., & Kotze, J. (2021) · International Journal of Educational Development · doi:10.1016/j.ijedudev.2021.102480 · Cited by 164 · see citing works
Hevia, F. J., Vergara-Lope, S., Velásquez-Durán, A., & Calderón, D. (2022) · International Journal of Educational Development · doi:10.1016/j.ijedudev.2021.102515 · Cited by 158 · see citing works
The Long-Run Effects of Teacher Strikes: Evidence from Argentina
Jaume, D., & Willén, A. (2019) · Journal of Labor Economics · doi:10.1086/703134 · Cited by 142 · see citing works
The impacts of remote learning in secondary education during the pandemic in Brazil
Lichand, G., Doria, C. A., Leal-Neto, O., & Fernandes, J. P. C. (2022) · Nature Human Behaviour · doi:10.1038/s41562-022-01350-6 · Cited by 139 · see citing works
Achievement Gaps in the Wake of COVID-19
Bailey, D. H., Duncan, G. J., Murnane, R. J., & Au Yeung, N. (2021) · Educational Researcher · doi:10.3102/0013189x211011237 · Cited by 134 · see citing works
Angrist, N., de Barros, A., Bhula, R., Chakera, S., Cummiskey, C., DeStefano, J., Floretta, J., Kaffenberger, M., Piper, B., & Stern, J. M. B. (2021) · International Journal of Educational Development · doi:10.1016/j.ijedudev.2021.102397 · Cited by 133 · see citing works
The Impact of COVID‐19‐Related School Closures on Student Achievement—A Meta‐Analysis
König, C., & Frey, A. (2022) · Educational Measurement: Issues and Practice · doi:10.1111/emip.12495 · Cited by 125 · see citing works
Sharp increase in inequality in education in times of the COVID-19-pandemic
Haelermans, C., Korthals, R. A., Jacobs, M., de Leeuw, S. G., Vermeulen, S., van Vugt, L., Aarts, B., Prokic‐Breuer, T., van der Velden, R., van Wetten, S., et al. (2022) · PLoS ONE · doi:10.1371/journal.pone.0261114 · Cited by 125 · see citing works
School Performance among Children and Adolescents during COVID-19 Pandemic: A Systematic Review
Panagouli, E. D., Stavridou, A., Savvidi, C., Kourti, A., Ψαλτοπούλου, Θ., Sergentanis, T. Ν., & Τσίτσικα, Ά. (2021) · Children · doi:10.3390/children8121134 · Cited by 121 · see citing works
Human Capital Accumulation and Disasters: Evidence from the Pakistan Earthquake of 2005
Andrabi, T., Daniels, B., & Das, J. (2020) · doi:10.35489/bsg-risewp_2020/039 · Cited by 119 · see citing works
Zierer, K. (2021) · Education Sciences · doi:10.3390/educsci11060252 · Cited by 118 · see citing works
An Analysis of COVID-19 Student Learning Loss
Patrinos, H. A., Vegas, E., & Carter-Rau, R. (2022) · World Bank policy research working paper · doi:10.1596/1813-9450-10033 · Cited by 105 · see citing works
Experimental evidence on learning using low-tech when school is out
Angrist, N., Bergman, P., & Matsheng, M. (2022) · Nature Human Behaviour · doi:10.1038/s41562-022-01381-z · Cited by 105 · see citing works
The Long-Term Distributional and Welfare Effects of Covid-19 School Closures
Fuchs-Schündeln, N., Krueger, D., Ludwig, A., & Popova, I. (2020) · doi:10.3386/w27773 · Cited by 84 · see citing works
Do Teacher Strikes Harm Educational Attainment of Students?
Belot, M., & Webbink, D. (2010) · LABOUR · doi:10.1111/j.1467-9914.2010.00494.x · Cited by 79 · see citing works
No learning loss in Sweden during the pandemic: Evidence from primary school reading assessments
Hallin, A. E., Danielsson, H., Nordström, T., & Fälth, L. (2022) · International Journal of Educational Research · doi:10.1016/j.ijer.2022.102011 · Cited by 68 · see citing works
Schuurman, T. M., Henrichs, L. F., Schuurman, N. K., Polderdijk, S., & Hornstra, L. (2021) · Scandinavian Journal of Educational Research · doi:10.1080/00313831.2021.2006307 · Cited by 67 · see citing works
Consequences of school closure on access to education: Lessons from the 2013–2016 Ebola pandemic
Smith, W. C. (2021) · International Review of Education · doi:10.1007/s11159-021-09900-2 · Cited by 65 · see citing works
No evidence of a major learning slide 14 months into the COVID-19 pandemic in Denmark
Birkelund, J. F., & Karlson, K. B. (2022) · European Societies · doi:10.1080/14616696.2022.2129085 · Cited by 64 · see citing works
Schult, J., Mahler, N., Fauth, B., & Lindner, M. A. (2022) · Frontiers in Education · doi:10.3389/feduc.2022.867316 · Cited by 50 · see citing works
Who Lost the Most? Mathematics Achievement during the COVID-19 Pandemic
Contini, D., Tommaso, M. L. D., Muratori, C., Piazzalunga, D., & Schiavon, L. (2022) · The B E Journal of Economic Analysis & Policy · doi:10.1515/bejeap-2021-0447 · Cited by 49 · see citing works
Kompetenzstände Hamburger Schüler*innen vor und während der Corona-Pandemie
Depping, D., Lücken, M., Musekamp, F., & Thonke, F. (2021) · Schule während der Corona-Pandemie. Neue Ergebnisse und Überblick über ein dynamisches Forschungsfeld · doi:10.31244/9783830993315.03 · Cited by 46 · see citing works
An Analysis of COVID-19 Student Learning Loss
Patrinos, H., Vegas, E., & Carter-Rau, R. (2023) · Oxford Research Encyclopedia of Economics and Finance · doi:10.1093/acrefore/9780190625979.013.893 · Cited by 42 · see citing works
Kaffenberger, M. (2020) · doi:10.35489/bsg-rise-ri_2020/017 · Cited by 40 · see citing works
The Effect of COVID on Oral Reading Fluency During the 2020–2021 Academic Year
Domingue, B. W., Dell, M., Lang, D., Silverman, R. D., Yeatman, J. D., & Hough, H. J. (2022) · AERA Open · doi:10.1177/23328584221120254 · Cited by 36 · see citing works
Inequality in learning is a major concern after school closures
van de Werfhorst, H. G. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2105243118 · Cited by 29 · see citing works
Attewell, P., & Newman, K. S. (2010) · doi:10.1093/acprof:oso/9780199732180.001.0001 · Cited by 25 · see citing works
Past is future for the era of COVID-19 research in the social sciences
Conley, D., & Johnson, T. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2104155118 · Cited by 22 · see citing works
Are there no wage returns to compulsory schooling in Germany? A reassessment
Cygan‐Rehm, K. (2022) · Journal of Applied Econometrics · doi:10.1002/jae.2854 · Cited by 20 · see citing works
COVID-19’S IMPACT ON LEARNING LOSSES AND LEARNING INEQUALITY IN COLOMBIA
Vegas, E. (2022) · International Journal of Advanced Studies in Economics and Public Sector Management · doi:10.48028/iiprds/ijasepsm.v10.i1.07 · Cited by 20 · see citing works
Educational Mobility in the Developing World
Torche, F. (2021) · Social Mobility in Developing Countries · doi:10.1093/oso/9780192896858.003.0007 · Cited by 18 · see citing works
The Long-Term Distributional and Welfare Effects of Covid-19 School ClosuresPreprint
Fuchs‐Schündeln, N., Ludwig, A., Popova, I., & Krueger, D. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3696313 · Cited by 17 · see citing works
Haelermans, C., Jacobs, M., van Vugt, L., Aarts, B., Abbink, H., Smeets, C., van der Velden, R., & van Wetten, S. (2021) · doi:10.31219/osf.io/78fje · Cited by 12 · see citing works
Haelermans, C., Jacobs, M., van Vugt, L., et al. (2021) · doi:10.26481/umaror.2021009 · Cited by 12
Regional Variation in Inequality of Educational Opportunity across Europe
Betthäuser, B. A., Kaiser, C., & Trinh, N. A. (2021) · Socius: Sociological Research for a Dynamic World · doi:10.1177/23780231211019890 · Cited by 10 · see citing works
Self-citationThe Impacts of Remote Learning in Secondary Education during the Pandemic in Brazil
Lichand, G., Alberto Doria, C., Leal Neto, O., & Cossi Fernandes, J. P. (2021) · doi:10.2139/ssrn.3841775 · Cited by 8 · see citing works
The Effects of COVID-19 on Inequalities in Educational Achievement in ItalyPreprint
Borgonovi, F., & Ferrara, A. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4171968 · Cited by 6 · see citing works
Sharp increase in inequality in education in times of the COVID-19-pandemic
Haelermans, C. I. 0.-0.-9.-8., Korthals, R., Jacobs, M. I. 0.-0.-6.-8., et al. (2021) · Research Publications (Maastricht University) · doi:10.26481/umaror.2021010 · Cited by 3 · see citing works
COVID Learning Loss: A Meta-Analysis
Storey, N. (2022) · American Educational Research Association Annual Meeting (AERA) · doi:10.3102/1891605
Are There No Wage Returns to Compulsory Schooling in Germany? A Reassessment
Cygan-Rehm, K. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3870201
Flagged first, then by citations
Research works printed but not linked: 1
- Azevedo, J. P., Hasan, A., Goldemberg, D., Geven, K. & Iqbal, S. A. Simulating the potential impacts of COVID-19 school closures on schooling and learning outcomes: a set of global estimates. World Bank Res. Observer 36, 1–40 (2021).
Cited by
Sorted by citations
The impact of Covid-19 on student achievement: Evidence from a recent meta-analysis
Di Pietro, G. (2023) · Educational Research Review · doi:10.1016/j.edurev.2023.100530 · Cited by 173 · see citing works
“Consistent with the findings of Betth ¨ auser et al. (2023), our results suggest that pandemic-related learning delays are similar across primary and secondary school students.”
InfluentialArtificial intelligence for low income countries
Khan, M. S., Umer, H., & Faruqe, F. (2024) · Humanities and Social Sciences Communications · doi:10.1057/s41599-024-03947-w · Cited by 210 · see citing works
“LICs, already challenged by inadequate resources and infrastructure, have experienced aggravated education setbacks (Betthäuser et al., 2023).”
Golden, A. R., Srisarajivakul, E., Hasselle, A. J., Pfund, R. A., & Knox, J. L. (2023) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2023.101632 · Cited by 130 · see citing works
Mustafa, F., Nguyen, H. T. M., & Gao, X. A. (2024) · International Journal of Educational Research · doi:10.1016/j.ijer.2024.102380 · Cited by 215 · see citing works
Lewalter, D. (2023) · Waxmann Verlag GmbH eBooks · doi:10.31244/9783830998488 · Cited by 130 · see citing works
Mazrekaj, D., & Witte, K. D. (2023) · Perspectives on Psychological Science · doi:10.1177/17456916231181108 · Cited by 105 · see citing works
“…countries, Brazil, Colombia, Mexico, South Africa, and the United States (nine of which were rated to have a low risk of bias) showed an even larger overall learning deficit of about .14 SD , suggesting that students lost about 35% of a school year’s worth of learning (Betthäuser et al., 2023).”
BackgroundKuhfeld, M. R., Lewis, K., & Peltier, T. K. (2022) · Reading and Writing · doi:10.1007/s11145-022-10345-8 · Cited by 91 · see citing works
Parental Involvement and Student Engagement: A Review of the Literature
Yang, D., Chen, P., Wang, K., Li, Z., Zhang, C., & Huang, R. (2023) · Sustainability · doi:10.3390/su15075859 · Cited by 150 · see citing works
Gee, K. A., Asmundson, V. S., & Vang, T. M. (2023) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2023.101643 · Cited by 72 · see citing works
Fütterer, T., Hoch, E., Lachner, A., Scheiter, K., & Stürmer, K. (2023) · Computers & Education · doi:10.1016/j.compedu.2023.104788 · Cited by 77 · see citing works
“…to have different levels of familiarity depending on which country the study was conducted in and how advanced digitization was in that country (Betth ¨ auser et al., 2023), or if the sample of a study had already worked with the learning program before the change to digital distance teaching,…”
InfluentialGoniewicz, K., Khorram‐Manesh, A., Burkle, F. M., Hertelendy, A. J., & Goniewicz, M. (2023) · Global Transitions · doi:10.1016/j.glt.2023.10.003 · Cited by 74 · see citing works
Association Between the COVID-19 Pandemic and Early Childhood Development
Sato, K., Fukai, T., Fujisawa, K. K., et al. (2023) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/jamapediatrics.2023.2096 · Cited by 58 · see citing works
No evidence of a major learning slide 14 months into the COVID-19 pandemic in Denmark
Birkelund, J. F., & Karlson, K. B. (2022) · European Societies · doi:10.1080/14616696.2022.2129085 · Cited by 64 · see citing works
Global learning loss in student achievement: First estimates using comparable reading scores
Jakubowski, M., Gajderowicz, T., & Patrinos, H. A. (2023) · Economics Letters · doi:10.1016/j.econlet.2023.111313 · Cited by 51 · see citing works
Chadaga, K., Prabhu, S., Vivekananda Bhat, K., Sampathila, N., Umakanth, S., & Chadaga, R. (2023) · Bioengineering · doi:10.3390/bioengineering10040439 · Cited by 44 · see citing works
Wijaya, T. T., Hidayat, W., Hermita, N., et al. (2024) · Infinity Journal · doi:10.22460/infinity.v13i1.p139-156 · Cited by 41 · see citing works
COVID-19, school closures, and student learning outcomes. New global evidence from PISA
Jakubowski, M., Gajderowicz, T., & Patrinos, H. A. (2025) · npj Science of Learning · doi:10.1038/s41539-025-00297-3 · Cited by 39 · see citing works
“Country studies show large losses (Alasino et al. 2024; Betthäuser et al. 2023; Carlana and La Ferrara 2023; Donnelly and Patrinos 2021; Engzell et al. 2021; Hammerstein et al. 2021; Jack and Oster 2023; Jack et al 2022; Maldonado and De Witte 2022; Zierer 2021).”
InfluentialThe Effect of COVID on Oral Reading Fluency During the 2020–2021 Academic Year
Domingue, B. W., Dell, M., Lang, D., Silverman, R. D., Yeatman, J. D., & Hough, H. J. (2022) · AERA Open · doi:10.1177/23328584221120254 · Cited by 36 · see citing works
Bullying before and during the COVID-19 pandemic
Vaillancourt, T., Farrell, A. H., Brittain, H. L., Krygsman, A., Vitoroulis, I., & Pepler, D. J. (2023) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2023.101689 · Cited by 37 · see citing works
School closure policies and student reading achievement: evidence across countries
Kennedy, A. I., & Strietholt, R. (2023) · Educational Assessment, Evaluation and Accountability · doi:10.1007/s11092-023-09415-4 · Cited by 45 · see citing works
“1 Substantial variation in learning deficits can be observed across individual studies and countries, as demonstrated by two recent meta-analyses (Betthäuser et al., 2023; Di Pietro, 2023).”
InfluentialEmpowering a Sustainable Future Through Digital Learning and the SDGs
Aarthi, S., Ravikumar, R. N., Sobirova, K., et al. (2025) · IGI Global eBooks · doi:10.4018/979-8-3373-0112-9.ch006 · Cited by 33 · see citing works
How Did COVID-19 Affect Education and What Can Be Learned Moving Forward?
Daumiller, M. H., Rinas, R., Schoon, I., & Lüftenegger, M. (2023) · Zeitschrift für Psychologie · doi:10.1027/2151-2604/a000527 · Cited by 30 · see citing works
“However, findings also showed little evidence for an accumulation of learning deficits over time that was frequently feared (Betthäuser et al., 2023).”
BackgroundLearning losses during the COVID-19 pandemic: Evidence from Mexico
Alasino, E., Ramírez, M. J., Romero, M., Schady, N., & Uribe, D. (2023) · Economics of Education Review · doi:10.1016/j.econedurev.2023.102492 · Cited by 30 · see citing works
Developmental Milestone Attainment in US Children Before and During the COVID-19 Pandemic
Johnson, S. B., Kuehn, M., Lambert, J. O., Spin, J. P., Klein, L. M., Howard, B. J., STURNER, R. A., & Perrin, E. M. (2024) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/jamapediatrics.2024.0683 · Cited by 28 · see citing works
Teaching and learning challenges due to the COVID-19 pandemic: A systematic review
Tan, C. Y., Jang, S. T., Lam, S. M., An, A. Q., & Lo, U. K. V. (2025) · Educational Research Review · doi:10.1016/j.edurev.2025.100667 · Cited by 35 · see citing works
Dewa, L. H., Roberts, L. F., Choong, E., Crandell, C., Demkowicz, O., Ashworth, E., Branquinho, C., & Scott, S. (2024) · PLoS ONE · doi:10.1371/journal.pone.0299547 · Cited by 28 · see citing works
COVID-19, School Closures, and Student Learning Outcomes: New Global Evidence from PISA
Jakubowski, M., Gajderowicz, T., & Patrinos, H. (2024) · doi:10.1596/1813-9450-10666 · Cited by 25 · see citing works
COVID-19 and inequalities in educational achievement in Italy
Borgonovi, F., & Ferrara, A. (2023) · Research in Social Stratification and Mobility · doi:10.1016/j.rssm.2023.100760 · Cited by 24 · see citing works
Spitzer, M., & Moeller, K. (2023) · Trends in Neuroscience and Education · doi:10.1016/j.tine.2023.100203 · Cited by 23 · see citing works
Janssen, T. W. P., & van Atteveldt, N. (2023) · Scientific Reports · doi:10.1038/s41598-023-33392-9 · Cited by 22 · see citing works
“We addressed several limitations of previous studies, by (1) including a measure of school-related mental health (school burnout symptoms) before and during the pandemic, (2) manipulating growth mindset before the pandemic with an RCT design and follow-up during the pandemic, (3) operationalizing school-related resili…”
MethodSocioeconomic disparities in the reopening of schools during the pandemic in Chile
Kuzmanic, D., Valenzuela, J. P., Claro, S., Canales, A., Cerda, D. C., & Undurraga, E. A. (2023) · International Journal of Educational Development · doi:10.1016/j.ijedudev.2023.102805 · Cited by 21 · see citing works
The heterogeneity of Covid-19 learning loss across Italian primary and middle schools
Bertoletti, A., Cannistrà, M., Soncin, M., & Agasisti, T. (2023) · Economics of Education Review · doi:10.1016/j.econedurev.2023.102435 · Cited by 21 · see citing works
Neugebauer, M., Patzina, A., Dietrich, H., & Sandner, M. (2023) · European Sociological Review · doi:10.1093/esr/jcad077 · Cited by 22 · see citing works
“…were faced not only with social isolation (e.g., Elmer et al., 2020) and erosion of their daily structure (e.g., Grewenig et al., 2021) but also with skill deficits (e.g., Betthäuser et al., 2023) and insecurity concerning their educational and occupational futures (e.g., Aucejo et al., 2020).”
BackgroundInfluentialThe COVID-19 pandemic and social cognitive outcomes in early childhood
Scott, R. M., Nguyentran, G., & Sullivan, J. Z. (2024) · Scientific Reports · doi:10.1038/s41598-024-80532-w · Cited by 20 · see citing works
Heinz, M., Daid, R. M., & Keane, E. (2025) · Learning Environments Research · doi:10.1007/s10984-025-09540-5 · Cited by 28 · see citing works
“However, despite international, national, and local policy efforts, students from lower socio-economic and migrant backgrounds continue to underperform (OECD, 2019), and worryingly, achievement gaps have widened since the COVID-19 pandemic (Betthäuser et al., 2023; European Commission, 2024).”
A year of missed opportunity: Post-Covid learning loss – A renewed call to action
Asadullah, M. N., Bouhlila, D. S., Chan, S., et al. (2023) · International Journal of Educational Development · doi:10.1016/j.ijedudev.2023.102770 · Cited by 20 · see citing works
“Children from poorest families and countries have fallen furthest behind (Moscoviz and Evans, 2022; Betthäuser et al., 2023).”
Hübner, N., Fahrbach, T., Lachner, A., & Scherer, R. (2023) · Computers & Education · doi:10.1016/j.compedu.2023.104847 · Cited by 27 · see citing works
Mukuka, A., & Alex, J. K. (2024) · Journal of Mathematics Teacher Education · doi:10.1007/s10857-024-09657-z · Cited by 28 · see citing works
“…like Zoom, Google Meet, and Microsoft Teams, among others enabled educators to conduct virtual mathematics lessons, demonstrations, and tutorials, thereby overcoming geographical barriers and expanding access to quality education (Asad et al., 2022; Betthäuser et al., 2023; Mukuka et al., 2021).”
Policies on children and schools during the SARS-CoV-2 pandemic in Western Europe
Soriano‐Arandes, A., Brett, A., Buonsenso, D., Emilsson, L., Garcia, I. D. L. F., Gkentzi, D., Helve, O., Kepp, K. P., Mossberg, M., Muka, T., et al. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2023.1175444 · Cited by 19 · see citing works
“A recent meta-analysis showed substantial overall learning deficit, which arose early in the pandemic and persists over time, affecting disproportionally children from low socio-economic backgrounds (22).”
BackgroundLalin, S. A. A., Ahmed, M. N. Q., & Haq, S. M. A. (2024) · Regional Science Policy & Practice · doi:10.1016/j.rspp.2024.100046 · Cited by 23 · see citing works
Learning loss and recovery from the COVID-19 pandemic: A systematic review of evidence
Cruz, N. A. D., Adona, A. J., Molato-Gayares, R., & Park, A. F. (2025) · International Journal of Educational Development · doi:10.1016/j.ijedudev.2025.103271 · Cited by 21 · see citing works
Routine child immunizations in India during the COVID-19 pandemic
Chakrabarti, A., Bair, E. F., & Thirumurthy, H. (2023) · SSM - Population Health · doi:10.1016/j.ssmph.2023.101383 · Cited by 18 · see citing works
Levine, R. S., Lim, R. J., & Bintliff, A. V. (2023) · Education Sciences · doi:10.3390/educsci13040411 · Cited by 17 · see citing works
Spitzer, M., & Moeller, K. (2024) · Computers and Education Open · doi:10.1016/j.caeo.2024.100162 · Cited by 16 · see citing works
COVID-19 disruptions and education in South Africa: Two years of evidence
Wills, G., & van der Berg, S. (2024) · Development Southern Africa · doi:10.1080/0376835x.2024.2311711 · Cited by 17 · see citing works
“Across studies, Patrinos et al. (2022) fi nd greater learning loss among students or schools with lower socio-economic status, a conclusion reinforced by Betthäuser et al. (2023).”
Durrani, N., & Ozawa, V. (2024) · SAGE Open · doi:10.1177/21582440241233402 · Cited by 16 · see citing works
“Although most countries provided remote learning opportunities, the extent and quality of these initiatives varied significantly (Akabayashi et al., 2023; Bettha¨user et al., 2023).”
Benner, A. D., Harrington, M. K., Kealy, C., & Nwafor, C. E. (2024) · Journal of Research on Adolescence · doi:10.1111/jora.12935 · Cited by 22 · see citing works
Bracco, J., Ciaschi, M., Gasparini, L., et al. (2024) · Review of Income and Wealth · doi:10.1111/roiw.12687 · Cited by 16 · see citing works
Successive model-agnostic meta-learning for few-shot fault time series prognosis
Su, H., Hu, J., Yu, S.-S., Liu, J.-H., & Qin, X. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.127879 · Cited by 11 · see citing works
Aligning Digital Educational Policies with the New Realities of Schooling
Butler, D., Leahy, M., Charania, A., Gedara, P. M., Keane, T., Laferrière, T., Nakamura, K., Ueda, H., & Bocconi, S. (2024) · Technology Knowledge and Learning · doi:10.1007/s10758-024-09776-9 · Cited by 30 · see citing works
“Instead, as the fallout from the pandemic becomes increasingly more evident, we know the prolonged disruption of schooling has exposed and amplified the persistent inequalities and shortcomings of current education systems (Betthäuser et al., 2023; Byrant, Child & Dorn, 2022; OECD, 2020).”
Unraveling the controversial effect of Covid-19 on college students’ performance
Bonacini, L., Gallo, G., & Patriarca, F. (2023) · Scientific Reports · doi:10.1038/s41598-023-42814-7 · Cited by 17 · see citing works
“(1) one variable in two different cases.”
BackgroundMethodInfluentialPeters, S. J., Langi, M., Kuhfeld, M., & Lewis, K. (2025) · Journal for the Education of the Gifted · doi:10.1177/01623532241301079 · Cited by 15 · see citing works
“Betth¨auser et al. (2023) conducted a preregistered systematic review and meta-analysis of 42 studies across 15 countries on COVID un fi nished learning.”
Zuniga‐Montanez, C., Davies, C. E., Ligoxygakis, L., Kašćelan, D., & Gonzalez‐Gomez, N. (2024) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.14102 · Cited by 17 · see citing works
Ghanamah, R., Eghbaria-Ghanamah, H., & Adi‐Japha, E. (2024) · Learning and Instruction · doi:10.1016/j.learninstruc.2024.101898 · Cited by 16 · see citing works
Honest machines? A cross-disciplinary perspective on trustworthy technology for children
Hoehl, S., Krenn, B., & Vincze, M. (2024) · Frontiers in Developmental Psychology · doi:10.3389/fdpys.2024.1308881 · Cited by 13 · see citing works
School Closure Policies and Student Reading Achievement: Evidence Across CountriesPreprint
Kennedy, A., & Strietholt, R. (2023) · doi:10.31219/osf.io/93rgz · Cited by 13 · see citing works
Xiong, Y., Fang, S., & Shen, M. (2024) · Interactive Learning Environments · doi:10.1080/10494820.2024.2375347 · Cited by 12 · see citing works
“Betthäuser et al. (2023) conducted a meta-analysis of research studies on learning loss during Covid-19 among school-age children, finding that the pandemic has impeded learning progress, with a negative effect size of 0.14.”
InfluentialTanri, A., Benny Aprial, M., Mashud, M., et al. (2023) · Retos · doi:10.47197/retos.v50.100587 · Cited by 12 · see citing works
“Once teachers and families have had time to adjust to the new learning environment, and the structure for online learning and reversing the decrease in early learning has been established (Betthäuser et al., 2023).”
BackgroundGeoffroy, M., Chadi, N., Bouchard, S., Fuoco, J., Chartrand, E., Loose, T., Sciola, A., Boruff, J. T., Iyer, S. N., Sun, Y., et al. (2024) · Canadian Journal of Public Health · doi:10.17269/s41997-024-00865-x · Cited by 13 · see citing works
“Stay-at-home orders and school closures have disrupted the daily routines of young people, leading to increased screen time (Trott et al., 2022) and learning deficits, particularly among socioeconomically disadvantaged students (Betthäuser et al., 2023).”
Back to school after COVID-19 pandemic: Resumption or transitional disruption?
Asadullah, M. N. (2024) · International Journal of Educational Development · doi:10.1016/j.ijedudev.2024.103086 · Cited by 12 · see citing works
Dropping out of university in response to the COVID-19 pandemic
Dagorn, E., & Moulin, L. (2024) · Economics of Education Review · doi:10.1016/j.econedurev.2024.102604 · Cited by 13 · see citing works
Understanding Student Engagement in AI-Powered Online Learning Platforms
Garcia, M. B., Goi, C. L., Shively, K., Maher, D., Rosak-Szyrocka, J., Happonen, A., Bozkurt, A., & Damaševičius, R. (2024) · Advances in educational technologies and instructional design book series · doi:10.4018/979-8-3693-5633-3.ch001 · Cited by 19 · see citing works
Elementary school teachers’ perspectives about learning during the COVID-19 pandemic
Alvarez-Rivero, A., Odgers, C. L., & Ansari, D. (2023) · npj Science of Learning · doi:10.1038/s41539-023-00191-w · Cited by 12 · see citing works
Schools and Society During the COVID-19 Pandemic
Reimers, F. M. (2023) · Springer eBooks · doi:10.1007/978-3-031-42671-1 · Cited by 12 · see citing works
Kastorff, T., Müller, M., & Greiff, S. (2025) · Computers & Education · doi:10.1016/j.compedu.2025.105409 · Cited by 16 · see citing works
The role of family composition in students' learning growth during the COVID ‐19 pandemic
de Leeuw, S. G., Haelermans, C., Jacobs, M., van der Velden, R., van Vugt, L., & van Wetten, S. (2023) · Journal of Marriage and the Family · doi:10.1111/jomf.12912 · Cited by 12 · see citing works
Peers turning on cameras promotes learning in video conferencing
Pi, Z., Zhang, L., Zhao, X., & Li, X. (2024) · Computers & Education · doi:10.1016/j.compedu.2023.104986 · Cited by 11 · see citing works
Improving the Usefulness and Use of Meta-Analysis to Inform Policy and Practice
Maynard, R. A. (2024) · Evaluation Review · doi:10.1177/0193841x241229885 · Cited by 13 · see citing works
Brüssow, H. (2024) · Microbial Biotechnology · doi:10.1111/1751-7915.14431 · Cited by 11 · see citing works
Zhao, B., Wang, X., Zhang, T., et al. (2024) · Humanities and Social Sciences Communications · doi:10.1057/s41599-024-03068-4 · Cited by 11 · see citing works
“Subsequently, as infection rates escalated, schools transitioned to online or remote learning modalities (Betthäuser et al., 2023).”
Kennedy, R. S., & Dendy, K. (2024) · International Journal of Bullying Prevention · doi:10.1007/s42380-024-00255-4 · Cited by 11 · see citing works
“This difference has been documented in other areas; students are underperforming in academics compared to pre-pandemic (Betthäuser et al., 2023).”
A single‐session growth mindset intervention among Chinese junior secondary school students
Cheng, Y., Zhao, S., Jin, L., Wang, Y., & Lin, D. (2024) · Applied Psychology Health and Well-Being · doi:10.1111/aphw.12596 · Cited by 12 · see citing works
The ability of low- and High-SES schools to inhibit learning losses during the COVID-19 pandemic
Vit, E. (2022) · Social Sciences & Humanities Open · doi:10.1016/j.ssaho.2022.100393 · Cited by 12 · see citing works
Müller, F., Goudeau, S., Stephens, N. K., Aelenei, C., & Sanitioso, R. B. (2023) · International Review of Social Psychology · doi:10.5334/irsp.716 · Cited by 11 · see citing works
Early Warning of Student Performance With Integration of Subjective and Objective Elements
Qin, K., Xie, X., He, Q., et al. (2023) · IEEE Access · doi:10.1109/access.2023.3295580 · Cited by 11 · see citing works
“Since the level of knowledge and competence acquired through online learning is only 1/3 of that of traditional offline teaching [25].”
BackgroundCampos, D., Fütterer, T., Gfrörer, T., Lavelle-Hill, R. E., Murayama, K., König, L., Hecht, M., Zitzmann, S., & Scherer, R. (2023) · doi:10.31234/osf.io/fpwc2 · Cited by 11 · see citing works
Garcia, M. B., Goi, C. L., Shively, K., Maher, D., Rosak-Szyrocka, J., Happonen, A., Bozkurt, A., & Damaševičius, R. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5074608 · Cited by 12 · see citing works
Rusakova, O., Tamozhska, I., Цой, Т., Vyshotravka, L., Shvay, R., & Kapelista, I. (2023) · Journal of Curriculum and Teaching · doi:10.5430/jct.v12n2p166 · Cited by 10 · see citing works
Jörgensen, E., Wood, L., Lynch, M. A., Spencer, N. J., & Gunnlaugsson, G. (2023) · Children · doi:10.3390/children10101670 · Cited by 10 · see citing works
“The importance of the school system as an equity measure for children has been reported; Betthäuser, Bach-Mortensen, and Engzell’s [44] meta-analysis shows that learning deficits, as a result of the pandemic, are socioeconomically dependent and more prevalent among children from deprived social…”
BackgroundGambi, L., & Witte, K. D. (2024) · Labour Economics · doi:10.1016/j.labeco.2024.102549 · Cited by 10 · see citing works
Segers, E., Zandt, M. I. '., Stoep, J. M. G. M., Daniels, L., Roelofs, J., & Gubbels, J. (2022) · Reading and Writing · doi:10.1007/s11145-022-10369-0 · Cited by 11 · see citing works
Understanding and addressing the post-pandemic learning disparities
Alejo, A., Jenkins, R., Reuge, N., & Yao, H. (2023) · International Journal of Educational Development · doi:10.1016/j.ijedudev.2023.102842 · Cited by 10 · see citing works
A democratic curriculum for the challenges of post-truth
Nally, D. (2024) · Curriculum Perspectives · doi:10.1007/s41297-024-00228-z · Cited by 12 · see citing works
Hepworth, A., Haddad, H., & Edmonds, C. J. (2024) · Journal of Adventure Education & Outdoor Learning · doi:10.1080/14729679.2024.2393130 · Cited by 13 · see citing works
“A recent systematic review across 15 countries found learning deficits, particularly in maths and particularly in children from lower socio-economic backgrounds (Betthäuser et al., 2023).”
The Effect of the Covid‐19 Pandemic on Inequality
Meyer, P. B., Piacentini, J., Frazis, H., Schultz, M., & Sveikauskas, L. (2024) · Review of Income and Wealth · doi:10.1111/roiw.12707 · Cited by 10 · see citing works
Educational efficiency across Spanish regions: a comparative analysis over time
Ferrera, J. M. C., Sicilia, G., & Simancas, R. (2024) · International Transactions in Operational Research · doi:10.1111/itor.13567 · Cited by 10 · see citing works
Delprato, M., & Antequera, G. (2024) · International Journal of Educational Research · doi:10.1016/j.ijer.2024.102493 · Cited by 9 · see citing works
Suwathanpornkul, I., Sarnkhaowkhom, C., Tulmethakaan, M., Sakuntanak, P., & Charoensuk, O. (2023) · BMC Psychology · doi:10.1186/s40359-023-01269-1 · Cited by 9 · see citing works
“Learning loss was also found with mathematics, since there were issues with identifying numbers, conducting mathematical operations, solving mathematical problems, and recognizing shapes, etc. [54].”
BackgroundBranquinho, C., Moraes, B., Noronha, C., Ferreira, T., Rodrigues, N. N., & de Matos, M. G. (2023) · Children · doi:10.3390/children10091460 · Cited by 9 · see citing works
SGS: SqueezeNet-guided Gaussian-kernel SVM for COVID-19 Diagnosis
Shi, F., Wang, J., & Govindaraj, V. (2024) · Mobile Networks and Applications · doi:10.1007/s11036-023-02288-3 · Cited by 9 · see citing works
Miani, M., & Picucci-Huang, S.-C. (2023) · Chinese Education & Society · doi:10.1080/10611932.2024.2303913 · Cited by 9 · see citing works
“In recent years the impact of the global Covid-19 pandemic on educational systems worldwide has emerged as a major theme in the educational literature (Bozkurt et al. 2022; Betth € auser, Bach-Mortensen, and Engzell 2023).”
BackgroundLearning disruptions during the COVID-19 pandemic: Evidence from household surveys in Southeast Asia
Maddawin, A., Morgan, P., Park, A. F., Suryadarma, D., Long, T. Q., & Vandenberg, P. (2024) · International Journal of Educational Development · doi:10.1016/j.ijedudev.2024.103053 · Cited by 9 · see citing works
Shaul, S., Lipka, O., Tal, D., Bufman, A., & Dotan, S. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1289145 · Cited by 13 · see citing works
“An interesting recent meta-analysis review (Betthäuser et al., 2023) identified 42 studies from 15 countries on learning progress among primary and secondary school children during the COVID-19 pandemic.”
BackgroundSelection and the economic value of education: A barrier to reducing the SES achievement gap?
Darnon, C., Sommet, N., Normand, A., & Manstead, A. S. R. (2024) · Journal of Social Issues · doi:10.1111/josi.12646 · Cited by 8 · see citing works
“The COVID pandemic has had a marked effect on different types of inequality, including educational inequality (Betthäuser et al., 2023; Goudeau et al., 2021) and has also made existing educational disparities quite visible among the population (Fiske et al., 2022; Frohn, 2021).”
BackgroundLearning and happiness during Covid-19 school closure in urban Malaysia
Asadullah, M. N., & Tham, E. (2023) · International Journal of Educational Development · doi:10.1016/j.ijedudev.2023.102822 · Cited by 12 · see citing works
Chen, S., & Lin, Y. (2023) · International Transactions in Operational Research · doi:10.1111/itor.13341 · Cited by 8 · see citing works
Educational tool kits for basic traditional Thai dancing for learners with visual impairment
Sucharitakul, S., Phuengngern, C., Ketaiam, K., et al. (2023) · Cogent Arts and Humanities · doi:10.1080/23311983.2023.2283948 · Cited by 8 · see citing works
“…and the research yielded a conclusion that COVID-19 affects learning deficits with no statistical differences between grades, but with larger learning deficits in poorer countries (Betthäuser et al., 2023), especially in families with economical disadvantages (Van Lancker & Parolin, 2020).”
ResultMartínez-Alonso, B., Pabón, N. S. T., Fernández‐Bachiller, M. I., et al. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e24284 · Cited by 8 · see citing works
Valenzuela, J. P., Kuzmanic, D., & Cortés, F. (2024) · International Journal of Educational Development · doi:10.1016/j.ijedudev.2023.102978 · Cited by 8 · see citing works
Global to Regional: From Twenty-First Century Skills to Life Skills in East Africa
Care, E. (2024) · The enabling power of assessment · doi:10.1007/978-3-031-51490-6_1 · Cited by 8 · see citing works
- Authors
- Betthäuser, B. A., Bach-Mortensen, A. M., & Engzell, P.
- Affiliations
- Institut d'Etudes Politiques de Paris (FR)
- Stockholm University (SE)
- Corresponding author
- Betthäuser, Bastian A.
- Venue
- Nature Human Behaviour
- Published
- 2023-01-30
- Volume
- 7
- Issue
- 3
- Pages
- 375-385
- ISSN
- 2397-3374 (ISSN-L)
- OpenAlex
- W4318486553
- Cited by
- 568
- References
- 60
- Citations by year
- 2026: 102 · 2025: 145 · 2024: 180 · 2023: 124 · 2022: 16 · 2020: 1
- FWCI
- 33.40
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- Locations
- Nature Human Behaviour (publishedVersion)
- PubMed (publishedVersion)
- HAL (submittedVersion, cc-by-nc)
- UCL Discovery (University College London) (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- EdArXiv (OSF Preprints) (submittedVersion)
- SocArXiv (OSF Preprints) (submittedVersion)
- SocArXiv (OSF Preprints) (submittedVersion, cc-by-nc-nd)
- EdArXiv (OSF Preprints) (submittedVersion, cc-by-nc-nd)
- Funders
- Carlsbergfondet (CF19-0102)
- Agence Nationale de la Recherche (ANR-11-LABX-0091, ANR-11-IDEX-0005-02, ANR-18-IDEX-0001)
- Leverhulme Trust Large Centre Grant; Swedish Swedish Research Council for Health, Working Life and Welfare (FORTE)
- Topics
- Social Sciences › Education › Education during COVID-19 pandemic
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › COVID-19 Pandemic Impacts
- Social Sciences › Safety Research › Poverty, Education, and Child Welfare
- Keywords
- COVID-19 pandemic, learning deficits, school-aged children, academic performance, socioeconomic disparities, mathematics learning, reading achievement, low-income countries, middle-income countries, high-income countries, learning loss
- MeSH terms
- COVID-19, Child, Humans, Income, Learning, Pandemics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-09-30.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-09-30.
Cited sources are checked by gpt-6-sol.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review