Is It Live or Is It Internet? Experimental Estimates of the Effects of Online Instruction on Student Learning
The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
This article presents the first experimental evidence on the effects of live versus Internet media of instruction. Students in a large introductory microeconomics course at a major research university were randomly assigned to live lectures versus watching these same lectures in an Internet setting where all other factors (e.g., instruction, supplemental materials) were the same. We find modest evidence that live-only instruction dominates Internet instruction. These results are particularly strong for Hispanic students, male students, and lower-achieving students. We also provide suggestions for future experimentation in other settings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Academic preparation (usually measured by G.P.A., SAT score and/or class rank), has been found to be a mediating variable affecting online grades and dropout rates (Bettinger et al., 2017; Figlio et al., 2013; Gregory, 2016; Harrell & Bower, 2011; Ice et al., 2012; Johnson & Mejia, 2014; Lee & Choi, 2011; Lint, 2013; Ryabov, 2012; Wladis et al., 2016; Xu & Jaggars, 2011a*), although it is unclear”
From Post-secondary online learning in the U.S.: an integrative review of the literature on undergraduate student characteristics (2022) · cites this paper as Figlio et al., 2013
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Many of these studies-including several high-quality randomized control trials-have looked at four-year institutions, generally finding null to negative effects of online course-taking (Altindag et al., Forthcoming;Bettinger et al., 2017;Figlio et al., 2013;Kofoed et al., 2024;Krieg & Henson, 2016; see Xu & Xu, 2020, for a review).”
From Online Student Performance Under Synchronous and Asynchronous Instruction in California Community Colleges (2026) · cites this paper as Figlio et al., 2013
The cited source says what the claim attributes to it.
In the citing paper
“Figlio et al. (2013) report that students with specific characteristics (Latinx, men, low achievers) do poorly online in comparison to face-to-face.”
From Post-secondary online learning in the U.S.: an integrative review of the literature on undergraduate student characteristics (2022) · cites this paper as Figlio et al. (2013)
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Some studies have attempted to do this with mixed results (i.e., Alpert et al., 2016; Arias et al., 2018; Figlio et al., 2013; Stack, 2015), though most randomized studies typically compare hybrid courses to face-to-face courses (see Bowen et al., 2014; Vernadakis et al., 2012).”
From Post-secondary online learning in the U.S.: an integrative review of the literature on undergraduate student characteristics (2022) · cites this paper as Figlio et al., 2013
The cited source says what the claim attributes to it.
In the citing paper
“Figlio et al. (2013) found no significant difference between online and face-to face course formats among students with higher prior G.P.A.s.”
From Post-secondary online learning in the U.S.: an integrative review of the literature on undergraduate student characteristics (2022) · cites this paper as Figlio et al. (2013)
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2009) · US Department of Education · Cited by 3,654
Zhang, D., Zhou, L., Briggs, R. O., & Nunamaker, J. F. (2006) · Information & Management · doi:10.1016/j.im.2005.01.004 · Cited by 1,283
Experimental Estimates of Education Production Functions
Krueger, A. B. (1999) · The Quarterly Journal of Economics · doi:10.1162/003355399556052 · Cited by 1,120
Making the Grade: Online Education in the United States, 2006.
Allen, I. E., & Seaman, J. (2006) · Cited by 630
Can Web Courses Replace the Classroom in Principles of Microeconomics?
Brown, B. W., & Liedholm, C. E. (2002) · American Economic Review · doi:10.1257/000282802320191778 · Cited by 408
Angrist, J., Bettinger, E., & Kremer, M. (2006) · American Economic Review · doi:10.1257/aer.96.3.847 · Cited by 406
Interactive Multimedia-Based E-Learning: A Study of Effectiveness
Zhang, D. (2005) · American Journal of Distance Education · doi:10.1207/s15389286ajde1903_3 · Cited by 281
Navarro, P., & Shoemaker, J. (2000) · Contemporary Economic Policy · doi:10.1111/j.1465-7287.2000.tb00032.x · Cited by 39
Cramming: The Effects of School Accountability on College-Bound Students
Donovan, C. M., Figlio, D., & Rush, M. (2006) · National Bureau of Economic Research · doi:10.3386/w12628 · Cited by 25
Self-citation
Research works printed but not linked: 3
- Bettinger Eric, 2007, Long
- Kane Thomas, Funding restrictions at public universities: Effects and policy implications. Working paper
- Mortenson Thomas, 2005, State tax fund appropriations for higher education: FY 1961 to FY
Cited by
Items 401–440 of 440
Enhancing and Humanizing Virtual Courses Through Culturally Responsive Curriculum
Contreras, L. R., & Duran, L. (2025) · IGI Global eBooks · doi:10.4018/979-8-3373-2955-0.ch004
The quality of online instruction and returns to instructor experience
Zhang, X., & Atwater, A. (2025) · Economics of Education Review · doi:10.1016/j.econedurev.2025.102700
Chergosky, A. J., Hultquist, A. S., & Liere, A. V. (2025) · Journal of Political Science Education · doi:10.1080/15512169.2025.2548901
Disconnecting women: gender disparities in the impact of online instruction
Shan, X., Zölitz, U., & Backes‐Gellner, U. (2025) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-279463
Essays on Health and Behavioral Economics
Wang, Y. (2023) · eCommons (Cornell University) · doi:10.7298/c47g-7a92
Wang, Z.-Y., Zhang, L.-J., Liu, Y.-H., Jiang, W.-X., Jia, J.-Y., Tang, S.-L., & Liu, X.-Y. (2021) · Figshare · doi:10.6084/m9.figshare.14615497
Faner, M., Ritchie, R. P., Ruger, K. M., Waarala, K. L., & Wilkins, C. A. (2022) · Figshare · doi:10.6084/m9.figshare.21582073
Wang, Z.-Y., Zhang, L.-J., Liu, Y.-H., Jiang, W.-X., Jia, J.-Y., Tang, S.-L., & Liu, X.-Y. (2021) · Figshare · doi:10.6084/m9.figshare.14615494
Faner, M., Ritchie, R. P., Ruger, K. M., Waarala, K. L., & Wilkins, C. A. (2022) · Figshare · doi:10.6084/m9.figshare.21582070
Wang, Z.-Y., Zhang, L.-J., Liu, Y.-H., Jiang, W.-X., Jia, J.-Y., Tang, S.-L., & Liu, X.-Y. (2021) · Figshare · doi:10.6084/m9.figshare.14615491
The Role of In-Person Tutorials in Higher EducationPreprint
Schafmeister, F., & Merkus, E. (2020) · OSF Preprints (OSF Preprints) · doi:10.17605/osf.io/rf8th
Cullinan, J., Flannery, D. J., Harold, J., Lyons, S., & Palcic, D. (2021) · Figshare · doi:10.6084/m9.figshare.14633996
Student Experiences with COVID-19 in CanadaPreprint
Afodjo, N., Cotton, C., Jones, M., & Scholle-Cotton, L. (2023) · RePEc: Research Papers in Economics
Ruales, S. T. P. (2020) · Lirias
De rol van ouders, binnenklasdifferentiatie en leerkrachten in financiële educatie
Witte, K. D., Maldonado, J. E., Iterbeke, K., Compen, B., Declercq, K., Schelfhout, W., & Campenhout, G. V. (2019) · Lirias (KU Leuven)
The impact of the COVID-19 pandemic in higher education: the case of Nova SBE undergraduate student
Salvador, P. N. D. M. (2022) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT)
Online Instructional Clarity: A Phenomenological Study of Students’ Experiences
Sutliff, E. C. B. (2023) · Digital Commons - University of South Florida (University of South Florida)
Psychosocial Stressors Affecting the Mental Health of Young Adults During the COVID-19 Pandemic
ElTohamy, A. (2023) · Digital Access to Scholarship at Harvard (DASH) (Harvard University)
Hall, C. K. B., Lindskog, A., & Lundin, M. (2025) · Econstor (Econstor)
Gałkiewicz, A. D. (2026) · publish.UP (University of Potsdam) · doi:10.25932/publishup-69075
The tailoring premium: AI design, behavioral engagement, and human capital formation
Polanco-Jimenez, J., & Witte, K. D. (2026) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2026.107826
Henzel, S. R., & Holzner, C. (2026) · International Review of Economics Education · doi:10.1016/j.iree.2026.100340
Effectiveness of Online Learning in the HyFlex Educational Environment
Precourt, E., & Cullinan, C. P. (2026) · Emerald Group Publishing Limited eBooks · doi:10.1108/s1085-462220260000029011
E-Learning at Universities: Does Starting with Difficult Questions Affect Student Performance?
Galkiewicz, A., Marcus, J., & Siedler, T. (2026) · Journal of Human Capital · doi:10.1086/741540
Teachers’ Accountability and Its Effects on Learners’ Learning Outcome
Pedraza, C. J., & Cacharo, A. (2026) · Psychology and Education A Multidisciplinary Journal · doi:10.70838/pemj.550203
Disconnected: The unequal impact of online learning on minority students
Gershoni, N., & Stryjan, M. (2026) · European Economic Review · doi:10.1016/j.euroecorev.2026.105356
Exploring subgroup heterogeneity in online and in-person learning outcomes using causal forest
Hattab, Z., Aqel, F. A.-Z., Kharousha, A., Yasin, M., & Jaafra, Y. (2026) · Humanities and Social Sciences Communications · doi:10.1057/s41599-026-07835-3
Instructional Design, Student Engagement, and Learning Outcomes in,Introductory Economics EducationPreprint
Mitra, A. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7044638
Park, J. (2026) · Journal of Latinos and Education · doi:10.1080/15348431.2026.2705525
Estefan, A., Altamirano, Á., & Winters, P. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7313379
Blended Learning a Boon or a Bane: Students Perspectives
Kashif, N. U., Javed, M. A., & Raheem, M. A. (2025) · Journal of Development and Social Sciences · doi:10.47205/jdss.2025(6-iii)38
Kautz, S., Hendrickson, E. C., Hernandez, E., Grunwald, A. L., Tuor, L., & Reddy, R. G. (2026) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.00135-26
Online Short Summer Course vs. Full Semester In-Person Course Outcomes
Williams, M. R., & Holcomb, J. E. (2026) · Journal of Criminal Justice Education · doi:10.1080/10511253.2026.2735017
Durongkaveroj, W. (2020) · Economics and Public Policy Journal
Essays in the Economics of Education, Labor and Human Capital
Malisan, I. (n.d.) · Institutional Research Information System University of Turin (University of Turin)
Rashid, A., Shahbaz, S., & Jabeen, S. (2021) · VFAST Transactions on Education and Social Sciences
Farley, I. (2022) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign)
Demand for online teaching – evidence from a survey experiment
Fidjeland, A. Ø., & Wiborg, V. S. (2026) · Education Economics · doi:10.1080/09645292.2026.2740217
The impact of emotion, motivation and attention in online and in person learning
Poch, C., Buades, F., Camuñas, N., & Hinojosa, J. A. (2026) · Current Psychology · doi:10.1007/s12144-026-10212-7
Georgieva, V., & Krasteva-Hristova, R. (2026) · Trends in Higher Education · doi:10.3390/higheredu5040139
Metadata
- Authors
- Figlio, D., Rush, M., & Yin, L.
- Affiliations
- Northwestern University (US)
- University of Florida (US)
- ORCID
- Yin, Lu
- Venue
- Journal of Labor Economics
- Publisher
- University of Chicago Press
- Published
- 2013-10
- Volume
- 31
- Issue
- 4
- Pages
- 763-784
- ISSN
- 0734-306X (ISSN-L)
- 1537-5307
- OpenAlex
- W3122912300
- Cited by
- 367
- References
- 9
- Citations by year
- 2026: 16 · 2025: 17 · 2024: 32 · 2023: 40 · 2022: 54 · 2021: 52 · 2020: 31 · 2019: 19 · 2018: 21 · 2017: 16 · 2016: 23 · 2015: 18 · 2014: 9 · 2013: 10
- FWCI
- 96.77
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Labor Economics (publishedVersion)
- Topics
- Social Sciences › Education › Online and Blended Learning
- Social Sciences › Education › Innovations in Educational Methods
- Social Sciences › Education › Education during COVID-19 pandemic
- Keywords
- online instruction, live lectures, student learning, microeconomics education, instructional media, Hispanic students, gender differences, academic performance, randomized field experiment, higher education
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.