In-Person Instruction and Educational Outcomes of K–8 Students During the COVID-19 Pandemic
Open accessAbstract
OBJECTIVES: Quantify the relationship between district policy permitting in-person instruction and educational outcomes during the 2020 to 2021 academic year for kindergarten through eighth grade students. METHODS: An ecological, repeated cross-sectional analysis of grade-level proficiency of students enrolled in public school districts in North Carolina (n = 115 school districts) was conducted. Univariate and multivariate analyses were performed to evaluate the association between the proportion of the school year a district spent in-person and 2020 to 2021 end-of-year student proficiency in the district. We then fit a multivariable linear regression model, weighted by district size, and adjusted for district-level 2018 to 2019 proficiency and district-level factors (rural or urban, area deprivation). RESULTS: Compared to 2018 to 2019, there was a 12.1% decrease (95% confidence interval [CI]: 16.8–19.3) in mathematics and an 18.1% decrease (95% CI: 10.8–13.4) in reading proficiency across the state at the end of 2020 to 2021. Compared to a district that remained entirely remote for the 2020 to 2021 school year, a district offering full in-person instruction had 12% (95% CI: 11%–12.9%) and 4.1% (95% CI: 3.5%–4.8%) more students achieve grade-level proficiency in mathematics and reading, respectively. In-person instruction was associated with greater increases in mathematics proficiency than reading, and greater increases in elementary-level students’ proficiency than middle school–level. CONCLUSIONS: The proportion of students achieving grade-level proficiency in 2020 to 2021 fell below prepandemic levels at each evaluated time point in the academic year. Increased time spent in-person by a school district was associated with an increased proportion of students achieving grade-level end-of-grade proficiency in both mathematics and reading.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The movement away from in-person instruction during the 2020-2021 school year reduced student achievement, worsened children's mental health, and decreased school enrollment.
“There is a growing body of literature suggesting that the movement away from in-person instruction during the 2020-2021 school year reduced student achievement,8,10,11,12 worsened children’s mental health,13,14,15,16 and decreased school enrollment.17,18”
From Virtual Learning in Kindergarten Through Grade 12 During the COVID-19 Pandemic and Chronic Absenteeism (2024) · cites this paper as [11]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Making Neighborhood-Disadvantage Metrics Accessible — The Neighborhood Atlas
Kind, A. J. H., & Buckingham, W. R. (2018) · New England Journal of Medicine · doi:10.1056/nejmp1802313 · Cited by 3,310 · see citing works
The Effect of Education on Crime: Evidence from Prison Inmates, Arrests, and Self-Reports
Lochner, L., & Moretti, E. (2004) · American Economic Review · doi:10.1257/000282804322970751 · Cited by 2,032 · see citing works
Learning loss due to school closures during the COVID-19 pandemic
Engzell, P., Frey, A., & Verhagen, M. D. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2022376118 · Cited by 1,848 · see citing works
Learning loss due to school closures during the COVID-19 pandemic
Engzell, P., Frey, A., & Verhagen, M. D. (2020) · doi:10.31235/osf.io/ve4z7 · Cited by 1,739 · see citing works
2013 NCHS Urban-Rural Classification Scheme for Counties.
Ingram, D. D., & Franco, S. J. (2012) · PubMed · Cited by 1,523 · see citing works
The Relationship Between Education and Adult Mortality in the United States
Lleras-Muney, A. (2005) · Review of Economic Studies · doi:10.1111/0034-6527.00329 · Cited by 1,282 · see citing works
Advocating for Children During the COVID-19 School Closures
Masonbrink, A. R., & Hurley, E. (2020) · Pediatrics · doi:10.1542/peds.2020-1440 · Cited by 423 · see citing works
Area Deprivation Index Predicts Readmission Risk at an Urban Teaching Hospital
Hu, J., Kind, A. J. H., & Nerenz, D. (2018) · American Journal of Medical Quality · doi:10.1177/1062860617753063 · Cited by 389 · see citing works
Incidence and secondary transmission of SARS-CoV-2 infections in schools
Zimmerman, K. O., Akinboyo, I. C., Brookhart, M. A., Boutzoukas, A. E., McGann, K. A., Smith, M. J., Maradiaga Panayotti, G., Armstrong, S. C., Bristow, H., Parker, D., et al. (2021) · Pediatrics · doi:10.1542/peds.2020-048090 · Cited by 223 · see citing works
Self-citationLarge socio-economic, geographic and demographic disparities exist in exposure to school closures
Parolin, Z., & Lee, E. K. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01087-8 · Cited by 217 · see citing works
Lansford, J. E., Dodge, K. A., Pettit, G. S., & Bates, J. E. (2016) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2016.01.014 · Cited by 188 · see citing works
Comparing social determinants of self-rated health across the United States and Canada
Prus, S. G. (2011) · Social Science & Medicine · doi:10.1016/j.socscimed.2011.04.010 · Cited by 169 · see citing works
Falk, A., Benda, A., Falk, P., Steffen, S., Wallace, Z., & Høeg, T. B. (2021) · MMWR Morbidity and Mortality Weekly Report · doi:10.15585/mmwr.mm7004e3 · Cited by 165 · see citing works
Christakis, D. A., Van Cleve, W., & Zimmerman, F. J. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.28786 · Cited by 161 · see citing works
The Consequences of Remote and Hybrid Instruction During the Pandemic
Goldhaber, D., Kane, T., McEachin, A., Morton, E., Patterson, T., & Staiger, D. (2022) · doi:10.3386/w30010 · Cited by 148 · see citing works
Oster, E., Jack, R., Halloran, C., Schoof, J., McLeod, D., Yang, H., Roche, J., & Roche, D. (2021) · MMWR. Morbidity and Mortality Weekly Report · doi:10.15585/mmwr.mm7026e2 · Cited by 75 · see citing works
E(race)ing Inequities: The State of Racial Equity in North Carolina Public Schools
Triplett, N. P. (2020) · American Educational Research Association Annual Meeting (AERA) · doi:10.3102/1572421 · Cited by 11 · see citing works
Goldman, J. L., Schuster, J. E., Maier, V. F., Anand, R., Hill, E. E., Butteris, S. M., DeMuri, G. P., Omidfar, S. A., Brookhart, M. A., Pak, J., et al. (2022) · PEDIATRICS · doi:10.1542/peds.2021-054268m · Cited by 8 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Lo, C. K., Hew, K. F., Xu, S., Song, Y., Chen, G., & Jong, M. S. (2025) · Journal of Computer Assisted Learning · doi:10.1111/jcal.70005 · Cited by 11 · see citing works
Evans, W. N., Muchnick, K., & Rosenlund, O. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.29569 · Cited by 7 · see citing works
Hadley, E. B., Liu, S., Kim, E., McKenna, M., & Hull, K. (2025) · AERA Open · doi:10.1177/23328584251338816 · Cited by 7 · see citing works
Seto, K. C., Xu, S., & Lo, C. K. (2025) · SN Computer Science · doi:10.1007/s42979-024-03645-z · Cited by 3 · see citing works
Wright, A. M., Martin, A., Pollak, S. D., Phillips, D. A., Livas, G., & Johnson, A. D. (2026) · Child Development · doi:10.1093/chidev/aacaf030
Mathematics Policy Across the United States: A Landscape Analysis
Douglas, G. P., Powell, S. R., & Benz, S. A. (2026) · Learning Disabilities Research and Practice · doi:10.1177/09388982261465446
- Authors
- Uthappa, D. M., Pak, J., McGann, K. A., Brookhart, M. A., McKinzie, K., Abdelbarr, M., Cockrell, J., Hickerson, J., Armstrong, S., D’Agostino, E. M., Weber, D. J., Kalu, I. C., Benjamin, D. K., Zimmerman, K. O., Boutzoukas, A. E., & Collaborative, A. S.
- Affiliations
- Duke University (US)
- University of North Carolina at Chapel Hill (US)
- cDepartment of Pediatrics
- dDepartment of Population Health Sciences
- North Carolina School of Science and Mathematics (US)
- gYadkin County Schools, Yadkinville, North Carolina
- hDuke Clinical Research Institute, Durham, North Carolina
- iDepartment of Family Medicine & Community Health, Duke University School of Medicine, Durham, North Carolina
- ORCID
- Venue
- Pediatrics
- Publisher
- American Academy of Pediatrics (AAP)
- Published
- 2023-07-01
- Volume
- 152
- Issue
- Supplement 1
- ISSN
- 0031-4005 (ISSN-L)
- 1098-4275
- PMC
- PMC10312276
- OpenAlex
- W4382919487
- Cited by
- 6
- References
- 17
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 1
- FWCI
- 4.44
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- PEDIATRICS (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Amgen
- Pfizer
- Brigham and Women's Hospital
- Gilead Sciences (COVID-19)
- Atara Biotherapeutics
- Melinta Therapeutics
- Sun Pharma
- National Institutes of Health (U24TR001608, HHSN275201000003I, COVID-19)
- Centers for Disease Control and Prevention (1T32HD094671)
- Allergan
- National Institute on Alcohol Abuse and Alcoholism (HHSN275201000003C)
- National Institute of Child Health and Human Development (HHSN-275201000003I)
- National Center for Advancing Translational Sciences (HHSN275201000003I)
- National Institute on Minority Health and Health Disparities (U24MD016258)
- Eunice Kennedy Shriver National Institute of Child Health and Human Development (OT2HD107559, HHSN275201000003I, T32HD094671)
- Topics
- Social Sciences › Education › Education during COVID-19 pandemic
- Social Sciences › Education › School Choice and Performance
- Physical Sciences › Mathematics › Modeling and Simulation › COVID-19 epidemiological studies
- Keywords
- face-to-face teaching, COVID-19 pandemic, school closures, student academic outcomes, mathematics proficiency, reading proficiency, K-8 students, school district policy, distance education, North Carolina public schools
- MeSH terms
- COVID-19, Child, Cross-Sectional Studies, Educational Status, Humans, Schools, Students, Pandemics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review