Negative Impacts From the Shift to Online Learning During the COVID-19 Crisis: Evidence From a Statewide Community College System
Open accessThe DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
The COVID-19 pandemic led to an abrupt shift from in-person to virtual instruction in the spring of 2020. We use two complementary difference-in-differences frameworks: one that leverages within-instructor-by-course variation on whether students started their spring 2020 courses in person or online and another that incorporates student fixed effects. We estimate the impact of this shift on the academic performance of Virginia’s community college students. With both approaches, we find modest negative impacts (3%–6%) on course completion. Our results suggest that faculty experience teaching a given course online does not mitigate the negative effects. In an exploratory analysis, we find minimal long-term impacts of the switch to online instruction.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“These years were chosen to track trends in course enrollment and performance over time, while avoiding a focus on the years most heavily affected by the COVID-19 pandemic, (2019-20 and2020-21), when the data on course classifications are less clean and course outcomes may reflect pandemic-era stresses and challenges that may differentially affect intendedface-to-face vs. intended-online students (”
From Online Student Performance Under Synchronous and Asynchronous Instruction in California Community Colleges (2026) · cites this paper as Bird et al., 2022
In the citing paper
“These years were chosen to track trends in course enrollment and performance over time, while avoiding a focus on the years most heavily affected by the COVID-19 pandemic, (2019-20 and2020-21), when the data on course classifications are less clean and course outcomes may reflect pandemic-era stresses and challenges that may differentially affect intendedface-to-face vs. intended-online students (”
From Online Student Performance Under Synchronous and Asynchronous Instruction in California Community Colleges (2026) · cites this paper as Bird et al., 2022
Citations
Cites
BEYOND STUDENT PERCEPTIONS: ISSUES OF INTERACTION, PRESENCE, AND PERFORMANCE IN AN ONLINE COURSE
Picciano, A. G. (2002) · Online Learning · doi:10.24059/olj.v6i1.1870 · Cited by 1,313
The impact of COVID-19 on student experiences and expectations: Evidence from a survey
Aucejo, E. M., French, J., Ugalde Araya, M. P., & Zafar, B. (2020) · Journal of Public Economics · doi:10.1016/j.jpubeco.2020.104271 · Cited by 895
Xu, D., & Jaggars, S. S. (2014) · The Journal of Higher Education · doi:10.1080/00221546.2014.11777343 · Cited by 568 · cited 1×
“The lack of in-person interaction in online courses can lead to a sense of isolation and disconnectedness from a learning community (Picciano, 2002) and can make it more difficult for students to engage with and learn from peers and instructors (Friesen & Kuskis, 2013; Xu & Jaggars, 2014).”
BackgroundHow do online course design features influence student performance?
Jaggars, S. S., & Xu, D. (2016) · Computers & Education · doi:10.1016/j.compedu.2016.01.014 · Cited by 519 · cited 1×
“…analyses show that students in online courses have lower rates of course completion and final grades, lower rates of persistence, and increased course repetition (Alpert et al., 2016; Bettinger et al., 2017; Figlio et al., 2013; Hart et al., 2016; Jaggars & Xu, 2016; Xu & Xu, 2019).”
BackgroundVirtual Classrooms: How Online College Courses Affect Student Success
Bettinger, E. P., Fox, L., Loeb, S., & Taylor, E. S. (2017) · American Economic Review · doi:10.1257/aer.20151193 · Cited by 441 · cited 1×
“Online learning requires a higher degree of autonomy among learners than in-person courses, which may be challenging for academically weaker students or students with nontraditional enrollment trajectories (Corbeil, 2003; Dabbagh et al., 2019).”
BackgroundShah, A. K., Shafir, E., & Mullainathan, S. (2015) · Psychological Science · doi:10.1177/0956797614563958 · Cited by 433
Figlio, D., Rush, M., & Yin, L. (2013) · Journal of Labor Economics · doi:10.1086/669930 · Cited by 367 · cited 1×
“…analyses show that students in online courses have lower rates of course completion and final grades, lower rates of persistence, and increased course repetition (Alpert et al., 2016; Bettinger et al., 2017; Figlio et al., 2013; Hart et al., 2016; Jaggars & Xu, 2016; Xu & Xu, 2019).”
BackgroundA Randomized Assessment of Online Learning
Alpert, W. T., Couch, K. A., & Harmon, O. R. (2016) · American Economic Review · doi:10.1257/aer.p20161057 · Cited by 209 · cited 1×
“Most like our analysis is the work of Altindag et al. (2021), which leverages data from a public university to investigate the performance of students in in-person versus online courses during the pandemic.”
BackgroundJoyce, T., Crockett, S., Jaeger, D. A., Altındağ, O., & O'Connell, S. D. (2015) · Economics of Education Review · doi:10.1016/j.econedurev.2015.02.007 · Cited by 149 · cited 1×
“This result is in line with prior research that finds that random assignment to a hybrid course with an online component led to worse outcomes for lower-performing students but had no negative impact among higher-performing students (Joyce et al., 2015).”
ResultOnline Course-taking and Student Outcomes in California Community Colleges
Hart, C. M. D., Friedmann, E., & Hill, M. (2018) · Education Finance and Policy · doi:10.1162/edfp_a_00218 · Cited by 136 · cited 1×
“…analyses show that students in online courses have lower rates of course completion and final grades, lower rates of persistence, and increased course repetition (Alpert et al., 2016; Bettinger et al., 2017; Figlio et al., 2013; Hart et al., 2016; Jaggars & Xu, 2016; Xu & Xu, 2019).”
Background
Research works printed but not linked: 3
- Corbeil J. R. (2003). Online technologies, self-efficacy, self-directed learning readiness, and locus of control of learners in a graduate-level web-based distance education program [Unpublished doctoral dissertation]. University of Houston.
- Picciano A., 2002, Journal of Asynchronous Learning Network, 6, 21
- 10.1353/jhe.2014.0028 · doi:10.1353/jhe.2014.0028 · Paper page
Cited by
The impacts of remote learning in secondary education during the pandemic in Brazil
Lichand, G., Doria, C. A., Leal-Neto, O., & Fernandes, J. P. C. (2022) · Nature Human Behaviour · doi:10.1038/s41562-022-01350-6 · Cited by 139
Zooming to Class? Experimental Evidence on College Students’ Online Learning during COVID-19
Kofoed, M. S., Gebhart, L., Gilmore, D., & Moschitto, R. (2024) · American Economic Review: Insights · doi:10.1257/aeri.20230077 · Cited by 125
Bulman, G. B., & Fairlie, R. W. (2022) · Education Finance and Policy · doi:10.1162/edfp_a_00384 · Cited by 81
“For examples of evidence prior to the pandemic, see Figlio, Rush, and Lin (2013), Bowen et al. (2014), Xu and Jaggars (2014), Alpert, Couch, and Harmon (2016), Krieg and Henson (2016), Bettinger et al.”
BackgroundTutoring in (Online) Higher Education: Experimental Evidence
Hardt, D., Nagler, M., & Rincke, J. (2022) · Economics of Education Review · doi:10.1016/j.econedurev.2022.102350 · Cited by 67
Yang, Z., Wu, J. G., & Xie, H. (2024) · Asia Pacific Journal of Education · doi:10.1080/02188791.2023.2300137 · Cited by 75
“Despite its convenience and flexibility, studies have demonstrated that it may reduce human interaction and socialization by replacing face-to-face communication and collaborative learning (Teng & Wu, 2021; Bird et al., 2022).”
Metadata
- Authors
- Bird, K. A., Castleman, B. L., & Lohner, G.
- Affiliations
- University of Virginia (US)
- University of California, Berkeley (US)
- Venue
- AERA Open
- Publisher
- SAGE Publications
- Published
- 2022-01
- Volume
- 8
- ISSN
- 2332-8584 (ISSN-L)
- OpenAlex
- W3088567566
- Cited by
- 140
- References
- 17
- Citations by year
- 2026: 9 · 2025: 22 · 2024: 35 · 2023: 33 · 2022: 25
- FWCI
- 61.98
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- AERA Open (publishedVersion, cc-by-nc)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Topics
- Social Sciences › Education › Education during COVID-19 pandemic
- Social Sciences › Education › Online and Blended Learning
- Social Sciences › Education › E-Learning and COVID-19
- Keywords
- COVID-19 pandemic, online learning, community colleges, course completion, academic performance, virtual instruction, faculty experiences, higher education, Virginia Community College System
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Negative Impacts From the Shift to Online Learning During the COVID-19 Crisis: Evidence From a Statewide Community College System. https://app.cochat.ai/papers/10.1177/23328584221081220
- The paper
- Bird, K. A., Castleman, B. L., & Lohner, G. (2022). Negative Impacts From the Shift to Online Learning During the COVID-19 Crisis: Evidence From a Statewide Community College System. AERA Open. https://doi.org/10.1177/23328584221081220
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.