Experimental evidence on learning using low-tech when school is out
Open accessAbstract
School closures occurred extensively during the COVID-19 pandemic, and occur in other settings, such as teacher strikes and natural disasters. The cost of school closures has proven to be substantial, particularly for households of lower socioeconomic status, but little evidence exists on how to mitigate these learning losses. This paper provides experimental evidence on strategies to support learning when schools close. We conduct a large-scale randomized trial testing two low-technology interventions-SMS messages and phone calls-with parents to support their child in Botswana. The combined treatment improves learning by 0.12 standard deviations, which translates to 0.89 standard deviations of learning per US$100, ranking among the most cost-effective interventions to improve learning. We develop remote assessment innovations, which show robust learning outcomes. Our findings have immediate policy relevance and long-run implications for the role of technology and parents to support education provision during school disruptions.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Sending SMS messages with numeracy problems accompanied by short phone calls led to substantial learning gains in numeracy in Botswana.
“sending SMS messages with numeracy problems accompanied by short phone calls was found to lead to substantial learning gains in numeracy in Botswana 47 .”
From A systematic review and meta-analysis of the evidence on learning during the COVID-19 pandemic (2023) · cites this paper as [47]
A large-scale randomized trial testing SMS messages and phone calls with parents in Botswana improved learning by 0.12 standard deviations.
“A large-scale randomized trial testing low-technology interventions—SMS messages and phone calls—with parents to support their child in Botswana improved learning by 0.12 standard deviations35 but this would not be enough to reverse the total losses and it has only been tested in a few low- and middle-income environments36, and the effects are limited when not implemented well and, in any case, w”
From COVID-19, school closures, and student learning outcomes. New global evidence from PISA (2025) · cites this paper as [35]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
The citation lists haven’t been fetched yet
References 54 · Cited by 105
- Authors
- Angrist, N., Bergman, P., & Matsheng, M.
- Affiliations
- World Bank (US)
- National Bureau of Economic Research (US)
- Corresponding author
- Angrist, Noam
- ORCID
- Angrist, Noam
- Venue
- Nature Human Behaviour
- Published
- 2022-06-13
- Volume
- 6
- Issue
- 7
- Pages
- 941-950
- ISSN
- 2397-3374 (ISSN-L)
- OpenAlex
- W4282594162
- Semantic Scholar
- bc7a677895de98541d784d9bb544038617a18695
- Cited by
- 105
- References
- 54
- Citations by year
- 2026: 16 · 2025: 21 · 2024: 28 · 2023: 30 · 2022: 10
- FWCI
- 47.99
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Nature Human Behaviour (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Funders
- United States Agency for International Development (FHI360)
- UNICEF (COVID-19)
- Northwestern University
- University of Oxford
- Topics
- Social Sciences › Education › Education during COVID-19 pandemic
- Social Sciences › Safety Research › Poverty, Education, and Child Welfare
- Social Sciences › Education › Online Learning Methods and Innovations
- Keywords
- school closures, learning loss, distance education, low-tech interventions, text messaging, parental involvement, remote assessment, cost-effectiveness, COVID-19 pandemic, Botswana
- MeSH terms
- COVID-19, Child, Humans, Learning, Parents, Schools, Pandemics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review