Is Online Education Working?
The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
This study examines the impact of instruction modality on student learning outcomes, with a focus on disparities observed pre- and post-pandemic. Using administrative data from a public university spanning seven pre-pandemic and five post-pandemic semesters, the analysis controls for endogenous sorting using fixed effects. The findings suggest that face-to-face (FtF) instruction results in better student performance, such as higher grades and a lower withdrawal rate. Additionally, students with greater exposure to FtF instruction are less likely to repeat courses, more likely to graduate on time, and achieve higher Grade Point Averages (GPA). The study also shows that the FtF advantage has been decreasing over time, and the differences are smaller post-pandemic. The results are consistent across student and instructor characteristics, except for Honors and graduate students, where the FtF advantage is either smaller or statistically insignificant.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Virtual Classrooms: How Online College Courses Affect Student Success
Bettinger, E. P., Fox, L., Loeb, S., & Taylor, E. S. (2017) · American Economic Review · doi:10.1257/aer.20151193 · Cited by 441 · cited 2×
“Bettinger et al. (2017) use an instrumental variable strategy to overcome the selection bias.”
Figlio, D., Rush, M., & Yin, L. (2013) · Journal of Labor Economics · doi:10.1086/669930 · Cited by 367
Xu, D., & Jaggars, S. S. (2013) · Economics of Education Review · doi:10.1016/j.econedurev.2013.08.001 · Cited by 359 · cited 2×
“Three notable exceptions are Bettinger et al. (2017) and Xu and Jaggars (2011, 2013).”
COVID-19 pandemic-online education in the new normal and the next normal
Xie, X., Siau, K., & Nah, F. F.-H. (2020) · Journal of Information Technology Case and Application Research · doi:10.1080/15228053.2020.1824884 · Cited by 338
Xu, D., & Jaggars, S. S. (2011) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373711413814 · Cited by 239
Bilen, E., & Matros, A. (2021) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2020.12.004 · Cited by 237
A Randomized Assessment of Online Learning
Alpert, W. T., Couch, K. A., & Harmon, O. R. (2016) · American Economic Review · doi:10.1257/aer.p20161057 · Cited by 209 · cited 1×
“Similarly, Alpert et al. (2016) found that students in the purely online section of a course received significantly lower grades than those in the FtF sections or the compressed sections with no significant differences between the latter two versions.”
Does online learning impede degree completion? A national study of community college students
Shea, P., & Bidjerano, T. (2014) · Computers & Education · doi:10.1016/j.compedu.2014.02.009 · Cited by 182 · cited 1×
“For example, using data from community college students, Shea and Bidjerano (2014) find that students who take some online or distance classes in early semesters are more likely to complete their program successfully than other students who took their classes exclusively in”
Online Course-taking and Student Outcomes in California Community Colleges
Hart, C. M. D., Friedmann, E., & Hill, M. (2018) · Education Finance and Policy · doi:10.1162/edfp_a_00218 · Cited by 136 · cited 5×
“This exercise is similar to the falsification test performed in Hart et al. (2018).”
InfluentialZooming to Class? Experimental Evidence on College Students’ Online Learning during COVID-19
Kofoed, M. S., Gebhart, L., Gilmore, D., & Moschitto, R. (2024) · American Economic Review: Insights · doi:10.1257/aeri.20230077 · Cited by 125
Cited by
Bird, K. A., Castleman, B. L., & Lohner, G. (2022) · AERA Open · doi:10.1177/23328584221081220 · Cited by 140
“Most like our analysis is the work of Altindag et al. (2021), which leverages data from a public university to investigate the performance of students in in-person versus online courses during the pandemic.”
BackgroundZooming to Class? Experimental Evidence on College Students’ Online Learning during COVID-19
Kofoed, M. S., Gebhart, L., Gilmore, D., & Moschitto, R. (2024) · American Economic Review: Insights · doi:10.1257/aeri.20230077 · Cited by 125
Addressing Non-Financial Barriers to College Access and Success: Evidence and Policy Implications
Dynarski, S., Nurshatayeva, A., Page, L., & Scott-Clayton, J. (2022) · doi:10.3386/w30054 · Cited by 38
Addressing nonfinancial barriers to college access and success: Evidence and policy implications
(2023) · Handbook of the Economics of Education · doi:10.1016/bs.hesedu.2022.11.007 · Cited by 21
Hart, C. M. D., Baker, R., Hill, M., Alonso, E., & Xu, D. (2026) · Research in Higher Education · doi:10.1007/s11162-025-09873-3
Metadata
- Authors
- Altindag, D. T., Filiz, E. S., & Tekin, E.
- Venue
- Educational Evaluation and Policy Analysis
- Published
- 2024-09-30
- Volume
- 47
- Issue
- 4
- Pages
- 1136-1162
- ISSN
- 0162-3737 (ISSN-L)
- 1935-1062
- OpenAlex
- W3188401584
- Cited by
- 60
- References
- 10
- FWCI
- 18.91
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Is Online Education Working? https://app.cochat.ai/papers/10.3102/01623737241274802
- The paper
- Altindag, D. T., Filiz, E. S., & Tekin, E. (2025). Is Online Education Working? Educational Evaluation and Policy Analysis. https://doi.org/10.3102/01623737241274802
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.