Cited by 105Education during COVID-19 pandemicPoverty, Education, and Child WelfareOnline Learning Methods and Innovations

Experimental evidence on learning using low-tech when school is out

Open access
Angrist, Noam, Bergman, Peter, Matsheng, Moitshepi·2022·Nature Human Behaviour

Abstract

School closures occurred extensively during the COVID-19 pandemic, and occur in other settings, such as teacher strikes and natural disasters. The cost of school closures has proven to be substantial, particularly for households of lower socioeconomic status, but little evidence exists on how to mitigate these learning losses. This paper provides experimental evidence on strategies to support learning when schools close. We conduct a large-scale randomized trial testing two low-technology interventions-SMS messages and phone calls-with parents to support their child in Botswana. The combined treatment improves learning by 0.12 standard deviations, which translates to 0.89 standard deviations of learning per US$100, ranking among the most cost-effective interventions to improve learning. We develop remote assessment innovations, which show robust learning outcomes. Our findings have immediate policy relevance and long-run implications for the role of technology and parents to support education provision during school disruptions.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1038/s41562-022-01381-z

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Sending SMS messages with numeracy problems accompanied by short phone calls led to substantial learning gains in numeracy in Botswana.

    “sending SMS messages with numeracy problems accompanied by short phone calls was found to lead to substantial learning gains in numeracy in Botswana 47 .”
  • A large-scale randomized trial testing SMS messages and phone calls with parents in Botswana improved learning by 0.12 standard deviations.

    “A large-scale randomized trial testing low-technology interventions—SMS messages and phone calls—with parents to support their child in Botswana improved learning by 0.12 standard deviations35 but this would not be enough to reverse the total losses and it has only been tested in a few low- and middle-income environments36, and the effects are limited when not implemented well and, in any case, w”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

The citation lists haven’t been fetched yet

References 54 · Cited by 105

Authors
Angrist, N., Bergman, P., & Matsheng, M.
Affiliations
  • World Bank (US)
  • National Bureau of Economic Research (US)
Corresponding author
Angrist, Noam
Venue
Nature Human Behaviour
Published
2022-06-13
Volume
6
Issue
7
Pages
941-950
ISSN
2397-3374 (ISSN-L)
OpenAlex
W4282594162
Cited by
105
References
54
Citations by year
2026: 16 · 2025: 21 · 2024: 28 · 2023: 30 · 2022: 10
FWCI
47.99
Type
journal article
Language
en
Open access
Locations
  • Nature Human Behaviour (publishedVersion)
  • PubMed (publishedVersion)
  • RePEc: Research Papers in Economics (submittedVersion)
Funders
  • United States Agency for International Development (FHI360)
  • UNICEF (COVID-19)
  • Northwestern University
  • University of Oxford
Topics
  • Social Sciences › Education › Education during COVID-19 pandemic
  • Social Sciences › Safety Research › Poverty, Education, and Child Welfare
  • Social Sciences › Education › Online Learning Methods and Innovations
Keywords
school closures, learning loss, distance education, low-tech interventions, text messaging, parental involvement, remote assessment, cost-effectiveness, COVID-19 pandemic, Botswana
MeSH terms
COVID-19, Child, Humans, Learning, Parents, Schools, Pandemics

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review