CoChat

In-person learning during the pandemic: Student take-up and school-level effects of remote and hybrid instruction on student outcomes

Open access
Ross, Stephen L., Jiang, Shangyue, Young, Michael F., Meyer, Joanna L., Strambler, Michael J. · 2024 · Proceedings of the National Academy of Sciences

The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index; none of the 11 sources its claims cite is checked for support yet.

Abstract

While studies have examined the effects of schools offering in-person learning during the pandemic, this study provides analysis of student enrollment decisions (remote versus in-person) in response to schools providing in-person learning opportunities. In Connecticut during the 2020–21 school year, we find that student take-up of in-person learning opportunities was low with students on average enrolled in-person for only half of the days offered, and take-up was even lower in schools with larger shares of disadvantaged students. The provision of in-person learning opportunities has been previously shown to mitigate pandemic learning losses. By exploiting data on actual enrollment, we show that the protective benefits of in-person learning are twice as large as previously estimated once we account for the low rates of student take-up. Finally, we provide evidence suggesting that a key mechanism behind the benefits of in-person learning is alleviating the burden faced by schools and teachers in delivering remote education. First, we show that the benefits to individual students of their in-person learning are substantially smaller than the overall benefits a student receives from their school average level of in-person enrollment. Second, we show that a combination of remote and in-person learning (hybrid) with a full-time on-line presence of students when at home was worse than hybrid learning with students never or only partially online. This second finding is consistent with qualitative evidence showing that teachers found hybrid learning especially challenging when having to manage both in-person and remote students for the entire class period.

Overview

CoChat Summary

TL;DR

Using Connecticut administrative data, this paper shows that student take-up of in-person learning in 2020–21 was low, especially in high-needs schools, so treatment-on-the-treated effects of in-person enrollment were about twice the intent-to-treat effects of district offerings. Most of the benefit appears to be school-level rather than individual, and fully synchronous hybrid instruction was associated with larger learning losses.

Key findings

  • Take-up was low and unequal: in districts with an above-median fraction of high-needs students, students were enrolled in-person for 25 to 27% of school days between October and March and 53% between April and June; a 10 percentage point increase in days offered in-person was associated with only a 4.5 point increase in days enrolled in-person in above-median schools, versus over 7 points in below-median schools between October and March.
  • Moving from all-remote to all-in-person instruction produced TOT effects of 0.2 to 0.4 SD smaller ELA test-score losses and 0.3 to 0.5 SD smaller Math losses; these TOT estimates were approximately two times larger than ITT estimates, which ranged from 0.1 to 0.3 SD.
  • Within-school individual effects of a student’s own in-person enrollment were at most modest: 0.0 to 0.2 SD and always well below TOT estimates; elementary attendance had a negative individual estimate of 2.6 percentage points, opposite the TOT direction, implying school-level effects dominate.
  • Fully synchronous hybrid learning led to larger test-score losses than partial or asynchronous hybrid, with negative estimates of 0.04 to 0.06 SD in higher grades; hybrid versus fully remote learning generally showed minimal differences, with point estimates between 0.0 and 0.03 SD except 8th-grade Math at 0.05 SD just missing significance.

Methods

  • Connecticut administrative data on LEA-by-grade weekly learning mode and student monthly in-person enrollment/attendance, pooled into repeated cross-sections for 2016–17 through 2020–21, omitting 2019–20 and requiring students to be observed in the state public school system in the given year and two years earlier.
  • Difference-in-differences models with school fixed effects, pandemic dummy, and two-year lagged outcomes; ITT models use district share of days offered in-person, TOT models instrument school average share of days enrolled in-person with district offerings, and within-school individual models subtract the prepandemic correlation between enrollment and outcomes.
  • Hybrid models condition on the TOT estimate for school average in-person enrollment and bootstrap SEs; a district-leader survey classified hybrid as fully synchronous, partially synchronous, or asynchronous, with response rates of 96% of town districts, 100% of regional districts, and 97% of choice LEAs.

Limitations

  • The paper states the instrument varies only by LEA-by-grade, so it cannot disentangle direct individual effects of in-person learning from broader aggregate effects on a school or grade.
  • The paper notes attendance estimates for middle and high school are very noisy, and that remote attendance may be easier because it can simply require logging in; elementary attendance individual estimates are negative.
  • Evident from the text: the analysis is Connecticut-specific for 2020–21, and the monthly in-person/remote enrollment and attendance data were newly collected that year, though the paper presents validation checks; the paper has no dedicated limitations section.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1073/pnas.2407322121

Cites

19 of 19 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Fig. 1. Student take-up of in-person learning by below- and above-median fraction of high-needs students. This figure presents the model prediction for share of days enrolled in-person in 2020–21 evaluated at the mean of the full sample on share of days offered (gray) and one SD above the mean share (red). “Below” identifies the estimate for schools that are below the median on fraction of high-needs students where fraction high need is based on fraction of students either FRPL, EL or with disabilities, and “Above” identifies estimates for schools that are above the median.
Fig. 1. Student take-up of in-person learning by below- and above-median fraction of high-needs students. This figure presents the model prediction for share of days enrolled in-person in 2020–21 evaluated at the mean of the full sample on share of days offered (gray) and one SD above the mean share (red). “Below” identifies the estimate for schools that are below the median on fraction of high-needs students where fraction high need is based on fraction of students either FRPL, EL or with disabilities, and “Above” identifies estimates for schools that are above the median.CC BY-NC-ND · PubMed Central
Fig. 2. Declines in pandemic effects on attendance from in-person learning. This figure presents parameter estimates for student attendance on the interaction of in-person learning with the pandemic dummy variable. Gray bars present estimates on the interaction of district share of days offered in-person with the pandemic dummy conditional on lagged student outcomes and school and pandemic year fixed effects, red bars present instrumental variable estimates of the same model where the variable of interest is school mean share of days enrolled in-person and district offerings are the instrument, and pink bars present estimates of the difference between the pandemic and prepandemic correlation between student in-person enrollment and outcomes conditional on separate fixed effects for each school in the pandemic year and the prepandemic years.
Fig. 2. Declines in pandemic effects on attendance from in-person learning. This figure presents parameter estimates for student attendance on the interaction of in-person learning with the pandemic dummy variable. Gray bars present estimates on the interaction of district share of days offered in-person with the pandemic dummy conditional on lagged student outcomes and school and pandemic year fixed effects, red bars present instrumental variable estimates of the same model where the variable of interest is school mean share of days enrolled in-person and district offerings are the instrument, and pink bars present estimates of the difference between the pandemic and prepandemic correlation between student in-person enrollment and outcomes conditional on separate fixed effects for each school in the pandemic year and the prepandemic years.CC BY-NC-ND · PubMed Central
Fig. 3. Declines in pandemic effects on test scores from in-person learning. This figure presents parameter estimates for student test scores on the interaction of in-person learning with the pandemic dummy variable. The Top panel presents estimates for ELA test scores, and the Bottom panel presents Math test score estimates. The interpretation of the gray, red, and pink bars is identical to Fig. 2.
Fig. 3. Declines in pandemic effects on test scores from in-person learning. This figure presents parameter estimates for student test scores on the interaction of in-person learning with the pandemic dummy variable. The Top panel presents estimates for ELA test scores, and the Bottom panel presents Math test score estimates. The interpretation of the gray, red, and pink bars is identical to Fig. 2.CC BY-NC-ND · PubMed Central
Fig. 4. Test score effects of hybrid relative to remote learning. This figure presents estimates for ELA and Math test scores on the share of nonfully in-person weeks that were taught as hybrid rather than remote. The models condition on the school average of share of days enrolled in-person where the variable is conditioned out using the TOT estimates from Fig. 3. The red dots represent the parameter estimates, and the blue bars represent the 95% CI.
Fig. 4. Test score effects of hybrid relative to remote learning. This figure presents estimates for ELA and Math test scores on the share of nonfully in-person weeks that were taught as hybrid rather than remote. The models condition on the school average of share of days enrolled in-person where the variable is conditioned out using the TOT estimates from Fig. 3. The red dots represent the parameter estimates, and the blue bars represent the 95% CI.CC BY-NC-ND · PubMed Central
Fig. 5. Differences in the effect of fully synchronous hybrid relative to other hybrid learning. This figure presents the difference between the estimates on share of weeks hybrid for schools where hybrid was fully synchronous and for schools where hybrid was either partially synchronous or asynchronous, only part-time or no on-line participation during class. The models condition on the school average of share of days enrolled in-person where the variable is conditioned out using the TOT estimates from Fig. 3. The red dots represent the parameter estimates, and the blue bars represent the 95% CI.
Fig. 5. Differences in the effect of fully synchronous hybrid relative to other hybrid learning. This figure presents the difference between the estimates on share of weeks hybrid for schools where hybrid was fully synchronous and for schools where hybrid was either partially synchronous or asynchronous, only part-time or no on-line participation during class. The models condition on the school average of share of days enrolled in-person where the variable is conditioned out using the TOT estimates from Fig. 3. The red dots represent the parameter estimates, and the blue bars represent the 95% CI.CC BY-NC-ND · PubMed Central

Verification

Claims the paper makes

0 Valid · 1 Not valid · 9 Not checked · 71 Own results and interpretations

38 more claims

Create a free account to see all 81 claims and to verify the 11 references still open.

See all claims — free account
  • It may state two separate claims as one. 36
  • Probably not a substantial claim. 5

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

3 of 3

Citations

Cites

Show all 19 references

Research works printed but not linked: 10

  1. T. Pressley, Elementary hybrid and virtual teacher stress during COVID-19. J. Res. Educ. 30, 97–116 (2021).
  2. M. J. Strambler , Remote Learning Study (Center for Connecticut Education Research Collaboration, Connecticut State Department of Education, 2022).
  3. B. W. Domingue, H. J. Hough, D. Lang, J. Yeatman, Changing Patterns of Growth in Oral Reading Fluency during the COVID-19 Pandemic. Policy Brief (Policy Analysis for California Education (PACE), 2021).
  4. V. Kogan, S. Lavertu, The COVID-19 Pandemic and Student Achievement on Ohio’s Third-grade English Language Arts Assessment (Ohio State University, 2021).
  5. M. J. Hicks, D. Faulk, What Contributed to COVID Learning Loss in Indiana’s Schools? (The Center for Business and Economic Research, Ball State University, 2022).
  6. K. Lewis, M. Kuhfeld, M. Langi, S. Peters, E. Fahle, The Widening Achievement Divide during COVID-19 (Center for School Student Progress, NWEA Brief, 2022).
  7. L. Pier, M. Christian, H. Tymerson, R. H. Meyer, COVID-19 Impacts on Student Learning: Evidence from Interim Assessments in California (Policy Analysis for California Education (PACE) Report, 2021).
  8. S. E. Stemler , An Evaluation of the Effectiveness of Home Visits for Re-Engaging Students Who Were Chronically Absent in the Era of Covid-19 (Center for Connecticut Education Research Collaboration, Connecticut State Department of Education, 2022).
  9. L. Moscoviz, D. Evans, Learning Loss and Student Dropouts during the COVID-19 Pandemic: A Review of the Evidence Two Years after Schools Shut Down (Center for Global Development Working Paper, 2022).
  10. D. Bassok, A. Shapiro, Understanding COVID-19-Era Enrollment Drops Among Early-Grade Public School Students (Brown Center Chalkboard, 2021).

Cited by

See all 7

Metadata

Authors
Ross, S. L., Jiang, S., Young, M. F., Meyer, J. L., & Strambler, M. J.
Affiliations
  • National Bureau of Economic Research (US)
  • University of Connecticut (US)
  • Yale University (US)
Corresponding author
Ross, Stephen L.
Venue
Proceedings of the National Academy of Sciences
Published
2024-08-07
Volume
121
Issue
33
Pages
e2407322121-e2407322121
ISSN
  • 0027-8424 (ISSN-L)
  • 1091-6490
OpenAlex
W4401387488
Cited by
7
References
18
Citations by year
2026: 1 · 2025: 5 · 2024: 1
FWCI
8.78
Type
journal article
Language
en
Open access
Locations
  • Proceedings of the National Academy of Sciences (publishedVersion, cc-by-nc-nd)
  • PubMed Central (publishedVersion, cc-by-nc-nd)
  • PubMed (publishedVersion)
Funders
Center for Connecticut Education Research Collaborative (NA)
Topics
  • Social Sciences › Education › Education during COVID-19 pandemic
  • Social Sciences › Education › School Choice and Performance
  • Social Sciences › Education › Online Learning Methods and Innovations
Keywords
in-person learning, COVID-19 pandemic, hybrid learning, remote instruction, student enrollment decisions, school-level effects, learning loss, disadvantaged students, teacher burden, school closures, Connecticut
MeSH terms
COVID-19, SARS-CoV-2, Adolescent, Child, Connecticut, Female, Humans, Learning, Male, Schools, Students, Education, Distance, Pandemics

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: In-person learning during the pandemic: Student take-up and school-level effects of remote and hybrid instruction on student outcomes. https://app.cochat.ai/papers/10.1073/pnas.2407322121
The paper
Ross, S. L., Jiang, S., Young, M. F., Meyer, J. L., & Strambler, M. J. (2024). In-person learning during the pandemic: Student take-up and school-level effects of remote and hybrid instruction on student outcomes. Proceedings of the National Academy of Sciences. https://doi.org/10.1073/pnas.2407322121

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.