A Randomized Assessment of Online Learning
The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
A microeconomics principles course employing random assignment across three sections with different teaching models is used to explore learning outcomes as measured by a cumulative final exam for students who participate in traditional face-to-face classroom instruction, blended face-to-face and online instruction with reduced instructor contact time, and a purely online instructional format. Evidence indicates learning outcomes were reduced for students in the purely online section relative to those in the face-to-face format by 5 to 10 points on a cumulative final exam. No statistically significant differences in outcomes are observed for students in the blended relative to the face-to-face section.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Citations
Cites
Can Web Courses Replace the Classroom in Principles of Microeconomics?
Brown, B. W., & Liedholm, C. E. (2002) · American Economic Review · doi:10.1257/000282802320191778 · Cited by 408
Interactive Learning Online at Public Universities: Evidence from a Six‐Campus Randomized Trial
Bowen, W. G., Chingos, M. M., Lack, K. A., & Nygren, T. I. (2014) · Journal of Policy Analysis and Management · doi:10.1002/pam.21728 · Cited by 403
Figlio, D., Rush, M., & Yin, L. (2013) · Journal of Labor Economics · doi:10.1086/669930 · Cited by 367
Joyce, T., Crockett, S., Jaeger, D. A., Altındağ, O., & O'Connell, S. D. (2015) · Economics of Education Review · doi:10.1016/j.econedurev.2015.02.007 · Cited by 149
Drydakis, N. (2015) · Anglia Ruskin Research Online (Anglia Ruskin University) · Cited by 22
Cited by
Items 101–200 of 211
DISTANCE TO PROMOTION: EVIDENCE FROM MILITARY GRADUATE EDUCATION
Bacolod, M., & Chaudhary, L. (2018) · Contemporary Economic Policy · doi:10.1111/coep.12275 · Cited by 6
“Although the number of randomized studies is increasing (Alpert, Couch, and Harmon 2016; Bowen et al. 2014; Figlio, Rush, and Yin 2013; and Joyce et al. 2015), randomized experiments in this particular context 5.”
Student Learning in Online College Programs
Cellini, S. R., & Grueso, H. (2021) · National Bureau of Economic Research · doi:10.3386/w28552 · Cited by 7
Online self-assessments and student engagement: a causal analysis in university mathematics
Büchele, S., Feiste, L., Müller, R., & Schürmann, M. (2025) · Education and Information Technologies · doi:10.1007/s10639-025-13794-0 · Cited by 7
“Studies indicate that students are more likely to engage with OSAs when they find them intuitive and perceive them as beneficial to their learning (Alpert et al., 2016).”
An Eye toward Equity: Redesigning Course Scheduling within Guided Pathways Reform Efforts
Sublett, C., & Orenstein, A. (2021) · Community College Journal of Research and Practice · doi:10.1080/10668926.2021.1982795 · Cited by 9
“Similarly, research into the educational impacts of enrolling in hybrid coursework shows that, by and large, four- and two-year students in hybrid courses perform as well as students in FtF courses (Alpert et al., 2016; Bowen et al., 2014; Joyce et al., 2015).”
BackgroundWatson, D. J., Webb, R., & Cook, S. (2024) · Studies in Higher Education · doi:10.1080/03075079.2024.2438843 · Cited by 5
Wu, C.-C., Chao, H.-W., & Tsai, C. (2021) · International Journal of Mobile and Blended Learning · doi:10.4018/ijmbl.2021100103 · Cited by 9
Manzi, A., Henley, P., Lieberman, H., Topper, L., Wuethrich, B., Logan, J. E., Bekele, A., Mubiligi, J. M., Davis, S., Binagwaho, A., et al. (2022) · Global Health Action · doi:10.1080/16549716.2022.2104319 · Cited by 3
“While online learning approaches have limited effect on knowledge acquisition compared to face-toface or blended courses [24], participants of this course expressed a remarkable increase in knowledge and skills acquisition.”
BackgroundKumar, V. (2023) · Management for professionals · doi:10.1007/978-981-19-8148-7_6 · Cited by 5
Cheraghi, F., & Rahimi, M. (2024) · SAGE Open · doi:10.1177/21582440241227006 · Cited by 8
“Unfortunately, when students are not trained to be autonomous and self-directed, loosening the teacher’s control of their study time and reducing the amount of out-of-class activities may lead to learning disruption (Alpert et al., 2016).”
Postpandemic EdTech (Educational Technology) on Perspectives of Green Society
Pradhan, P., Mitra, P., Chowdhuri, S., Neogi, B., & Ghosh, S. S. (2021) · Springer eBooks · doi:10.1007/978-3-030-73295-0_3 · Cited by 3
Beckmann, S. (2023) · Journal of Mammalogy · doi:10.1093/jmammal/gyad020 · Cited by 8
Bulman, G. B., & Fairlie, R. W. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4077480 · Cited by 3
Samaniego, R. M., Jedwab, R., Romer, P., & Islam, A. M. (2022) · World Bank, Washington, DC eBooks · doi:10.1596/1813-9450-9932 · Cited by 5
Digitizing High-Touch Interactions: The Divided Efficacy in Personal SellingPreprint
Rahman, M. S., & Reeder, J. C. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4197485 · Cited by 3
The Effects of Flipped Classrooms in Higher Education: A Causal Machine Learning AnalysisPreprint
Czarnowske, D., Heiß, F., Schmitz, T. M. A., & Stammann, A. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5341104 · Cited by 5
The Expanding Landscape of Online Education: Who Engages and How They Fare
Barrow, L., Morris, W. T., & Sartain, L. (2022) · Journal of Labor Economics · doi:10.1086/728807 · Cited by 5
“Results from these experiments indicate that students who are assigned to online courses have slightly worse end-of-course exam grades than students assigned to take the course in person (Brown and Liedholm 2002; Coates et al. 2004; Figlio, Rush, and Yin 2013; Alpert, Couch, and Harmon 2016).”
BackgroundWang, C., Wang, Y., Xiao, A., Zhang, Y., & Zou, H. (2025) · Journal of Public Economics · doi:10.1016/j.jpubeco.2024.105285 · Cited by 8
van den Oever, K., & Koornneef, S. (2025) · The International Journal of Management Education · doi:10.1016/j.ijme.2025.101171 · Cited by 3
Watson, D., Webb, R., & Cook, S. (2025) · Professional Development in Education · doi:10.1080/19415257.2025.2536264 · Cited by 5
“2013, Alpert et al .”
Do Most Students Need in-Person Lectures? A Study of a Large Statistics Class
Fireman, E. S., Donnini, Z. S., Weissman, M. B., & Eck, D. J. (2023) · Journal of Educational Technology Systems · doi:10.1177/00472395231166592 · Cited by 3
“…of this course that may tend to make the online version work particularly well and thus may account for why our results are a bit different from the previous studies (Alpert et al., 2016; Arias et al., 2018; Figlio et al., 2013; Joyce et al., 2014) that found advantages for in-person lectures.”
BackgroundResultInfluentialLee, H. R., Yang, K., Rutherford, T. A., Ramirez, K., & Eccles, J. S. (2023) · Frontiers in Education · doi:10.3389/feduc.2023.1233978 · Cited by 3
The best of both worlds? A controlled comparison of hybrid and online economics student outcomes
Babin, J. J., Feld, T., Harriger-Lin, J., & Mitchell, K. (2021) · Journal of Education for Business · doi:10.1080/08832323.2021.1887793 · Cited by 3
“Brown and Liedholm (2002) and Alpert, Couch, and Harmon (2016) evaluate F2F, online, and hybrid courses and consistently determine that online students perform worst relative to those in other learning formats.”
BackgroundCovid-19, an opportunity to compare in-person and online teaching
Bru, S., Ribeiro, M. P. C., Quandt, E., Clotet, J., & Jiménez, J. (2021) · Revista Española de Educación Médica · doi:10.6018/edumed.480681 · Cited by 2
“This indicates that the majority of students still have the feeling that they perform better in a traditional classroom setting, even though many reports support the notion of a negligible impact (13, 21-23).”
Miller, T., Cunha, J. M., Delello, J. A., Dossani, R. K., & Marzilli, T. S. (2018) · RAND Corporation eBooks · doi:10.7249/rr2817 · Cited by 2
DISTANCE LEARNING: MINDSET, MOTIVATION, AND ADAPTATION IN THE COVID ERA
Goble, B. V. (2022) · European Journal of Open Education and E-learning Studies · doi:10.46827/ejoe.v7i1.4130 · Cited by 2
“…has yielded contradictory results, with some studies suggesting that online learning yields inferior learning and comprehension (Figlio et al., 2010; Alpert et al., 2016; Cellini & Grueso, 2021) and others suggesting that online learning is either equivalent or superior to in-class instruction…”
ResultProud, S. (2022) · REIRE Revista d Innovació i Recerca en Educació · doi:10.1344/reire.38120 · Cited by 6
Palongpalong, P. S., Taroc, R. D., & Bilocora, D. D. (2018) · International Journal of Science and Management Studies (IJSMS) · doi:10.51386/25815946/ijsms-v1i3p104 · Cited by 3
Wang, A. (2020) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 3
Live or Lecture Capture: Evidence from a Classroom Random Control TrialPreprint
Johnson, M., Artz, B., Robson, D., & Taengnoi, S. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3933067 · Cited by 2
Bulman, G. B., & Fairlie, R. W. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4156927 · Cited by 3
Online Education Trajectory during the COVID-19 Pandemic Among the Bangladeshi Adolescent ChildrenPreprint
Sakib, F. (2022) · Research Square · doi:10.21203/rs.3.rs-1941710/v1 · Cited by 3
“Regardless of the general success of online students, the ability of technology to break down barriers to educational opportunity and close gaps in educational attainment between socioeconomic groups is contingent on how well at-risk students perform in this setting (Alpert et al., 2016).”
BackgroundRice, M. F. (2022) · Online Learning · doi:10.24059/olj.v26i3.3621 · Cited by 2
Szura, J. W., Fischer, C., Link, R. D., & Collins, P. (2022) · Journal of Chemical Education · doi:10.1021/acs.jchemed.2c00437 · Cited by 1
Humanizing the Online Classroom
Ebben, M., Arcand, C., Tupper, J. B., & Schott, G. (2022) · Advances in higher education and professional development book series · doi:10.4018/978-1-6684-5934-8.ch001 · Cited by 1
Working from home is here to stay, but how does it affect workplace learning?
Morlet, G. M., & Bolli, T. (2024) · Zeitschrift für schweizerische Statistik und Volkswirtschaft/Schweizerische Zeitschrift für Volkswirtschaft und Statistik/Swiss journal of economics and statistics · doi:10.1186/s41937-024-00123-4 · Cited by 3
“This literature suggests that distance instruction hampers acquisition of mostly theoretical knowledge for community colleges (see, e.g., Xu & Jag-gars, 2013; Mohammadian et al., 2021) and universities (see, e.g., Alpert et al., 2016; Bettinger et al., 2017; Joyce et al., 2015).”
BackgroundThe Influence of Mega Universities on college competition and outcomes
Guzman, M., McGuinness, S., & Turner, L. J. (2025) · Economics of Education Review · doi:10.1016/j.econedurev.2025.102688 · Cited by 3
Wang, Y., Zhang, C., & Zhang, J. (2025) · Journal of Comparative Economics · doi:10.1016/j.jce.2025.09.001 · Cited by 2
Flores, M., Gerstenblüth, M., & Suarez, L. (2025) · Research in Higher Education · doi:10.1007/s11162-025-09862-6 · Cited by 1
“…to face-to-face instruction, with increased dropout rates often exacerbating negative impacts on students who already face academic challenges (Alpert, Couch, and Harmon, 2016; Escueta et al., 2017; Bettinger, Fox, Loeb, and Taylor, 2017; Figlio et al., 2013; Jaggars and Xu, 2016; Xu and…”
Basic 3D Animation Online Learning Model for Multimedia Student
Yusa, I. M. M., Ardhana, I. K., Putra, I. N. D., Pujaastawa, I. B. G., Anggara, I. G. A. S., & Yasa, N. P. D. (2022) · East Asian Journal of Multidisciplinary Research · doi:10.55927/eajmr.v1i11.2297 · Cited by 2
Is there e-learning penalty on wages?
Petterini, F. C., Almeida, V. L., França, M. T. A., & Irffi, G. D. (2023) · Applied Economics Letters · doi:10.1080/13504851.2023.2203448 · Cited by 2
“…(online) would achieve different exam scores if they attended traditional face-to-face courses (offline), and vice versa – see, for example, the literature review of Coates et al. (2004), Anstine and Skidmore (2005), Alpert, Couch, and Harmon (2016), or Nortvig, Petersen, and Balle (2018).”
Yeaton, W. H. (2023) · International Journal of Research & Method in Education · doi:10.1080/1743727x.2023.2220649 · Cited by 1
“The sample consisted of students who took microeconomics at a large, Northeast, public university (Alpert et al. 2016).”
BackgroundIdentifying Strategies for Strengthening the Health Care Workforce in the Commonwealth of Virginia
Andrew, M., Briscombe, B., Vardavas, R., Wolters, N., Qureshi, N., Nham, W., & Abir, M. (2023) · Rand health quarterly · doi:10.7249/rhq-11-02-01 · Cited by 1
Efobi, U. (2023) · Education Economics · doi:10.1080/09645292.2023.2283686 · Cited by 1
“…hand, several research document negative consequences of comparable innovation for a variety of causes, such as social isolation due to decreased physical connection and attention deficit in virtual classes (Alpert, Couch, and Harmon 2016; Bird, Castleman, and Lohner 2020; Kofoed et al. 2021).”
Students' Perceptions of Online Class Delivery During the COVID-19 Pandemic: The Case of the UAE
Elchaar, R., Grassa, R., & White, T. (2023) · Emerald Group Publishing Limited eBooks · doi:10.1108/s1085-462220230000027011 · Cited by 1
Evidence of the Challenge in Engaging Unemployed Youth with Online Learning Platforms
Dhuey, E., Furzer, J., Perlman, M., & White, L. A. (2024) · Canadian Public Policy · doi:10.3138/cpp.2022-023 · Cited by 1
Online Proctoring Discount: The Role of Measured Stressors
Gaynor, G., Wynne, K. T., Zhang, T., Gerlowski, D. A., & Morse, J. N. (2021) · The Journal of Economic Education · doi:10.1080/00220485.2024.2314484 · Cited by 1
“Alpert, Couch, and Harmon (2016) use a randomized sampling approach and find evidence consistent with reduced learning outcomes for online students of an introductory economics course relative to those in a hybrid or face-to-face course section.”
BackgroundRomer, P., Samaniego, R. M., Jedwab, R., & Islam, A. M. (2024) · Journal of Economic Growth · doi:10.1007/s10887-024-09246-y · Cited by 1
Does adaptive learning improve student performance? Evidence from a Kuwaiti university
Omerčević, E., Lary, A. M., & O’Neill, K. (2025) · Journal of Education for Business · doi:10.1080/08832323.2025.2518067 · Cited by 4
“Whereas Alpert et al. (2016) found that performance in blended courses matched that of face-to-face courses (Chen et al., 2010; Cosgrove & Olitsky, 2015).”
Using Google Drawings to Create Homework Exercises
Harmon, O. R., & Szarka, R. (2018) · Journal of Economics Teaching · doi:10.58311/jeconteach/cb6e720d514867854cefdc6b43a098f676b69bd6 · Cited by 1
Self-citationThe trend of distance education: problems and prospects for implementation
Grigorov, G. (2021) · Grani · doi:10.15421/172131 · Cited by 1
Impact of peers on educational outcomes in Economics
Abío, G., Alcañiz, M., Belloni, C. M., Gómez‐Puig, M., Ortiz-Gracia, L., Royuela, V., Rubert, G., Serrano, M., & Stoyanova, A. (2022) · REIRE Revista d Innovació i Recerca en Educació · doi:10.1344/reire.38063 · Cited by 1
“However, other studies report no or even negative effects on academic outcomes (Alpert et al., 2016; Green, 2014; Joyce et al., 2015; Kwak et al., 2015; Olitsky & Cosgrove, 2014).”
BackgroundDisrupted Learning about Democracy: Instructor Strategies for Navigating Temporary Modality Shifts
Jansa, J. M., & Ringsmuth, E. M. (2023) · PS Political Science & Politics · doi:10.1017/s1049096522001305 · Cited by 1
“The extant scholarship on teaching and learning has investigated whether and how modality can affect student learning (Alpert, Couch, and Harmon 2016; Botsch and Botsch 2012; Clawson, Deen, and Oxley 2002; Daigle and Stuvland 2020; Glazier et al. 2020; Hamann, Pollock, and Wilson 2009; Pollock and…”
BackgroundHarmon, O. R., & Tomolonis, P. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3056727 · Cited by 1
Self-citationA Meta-Analysis of Technology Interventions in Collegiate Economics ClassesPreprint
Johnson, M., & Meder, M. E. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3501227 · Cited by 3
Wang, Z., Zhang, L., Liu, Y., Jiang, W., Tang, S., & Liu, X. (2020) · Research Square · doi:10.21203/rs.3.rs-121029/v1 · Cited by 2
Online vs. Classroom: Course Engagement and Attention with Large Groups of StudentsPreprint
Rodríguez-Longarela, I. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3958070 · Cited by 1
Demand for Online Teaching - Evidence from a Survey ExperimentPreprint
Wiborg, V. S., & Fidjeland, A. K. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4848838 · Cited by 1
Disconnecting Women: Gender Disparities in the Impact of Online InstructionPreprint
Shan, X., Zölitz, U., & Backes‐Gellner, U. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5363191 · Cited by 1
Wladis, C., Hachey, A. C., Conway, K., & Manly, C. (2025) · Online Learning · doi:10.24059/olj.v29i3.5018
Evaluation of blended learning strategies from exam outcomes
Kark, L., Odell, R. A., & Nordon, R. E. (2016)
Three Essays on the Conveyance of Economic Information: Firm, Public, and Educational
Tomolonis, P. (2017) · OpenCommons at University of Connecticut (University of Connecticut)
Online Versus Traditional Course Achievement at a Small Liberal Arts College
Venable, K. M. (2019) · ProQuest LLC eBooks · doi:10.7916/d8-abvb-8w45
Do In-Person Lectures Help? A Study of a Large Statistics ClassPreprint
Fireman, E. S., Donnini, Z. S., Eck, D. J., & Weissman, M. B. (2021) · arXiv (Cornell University)
Are in-person lectures beneficial for all students? A Study of a Large Statistics ClassPreprint
Fireman, E. S., Donnini, Z. S., Eck, D. J., & Weissman, M. B. (2021) · arXiv (Cornell University)
The impact of online technical education on schooling outcomes: Evidence from Brazil
Elacqua, G., Navarro-Palau, P., Prada, M. F., & Soares, S. (2021) · doi:10.18235/0003778
Mayer, R. E., & Fiorella, L. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108894333.002 · Cited by 1
Business School Grades, Assessment Scores, and Dropout Rates in the Covid-19 PandemicPreprint
Johnson, M., Engelhardt, B., & Taengnoi, S. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3943471 · Cited by 1
Tutoring in (Online) Higher Education
Rincke, J. (2021) · AEA Randomized Controlled Trials · doi:10.1257/rct.7686
An Academic Solution: Fusion Learning Activities
(2019) · Advances in mobile and distance learning book series · doi:10.4018/978-1-5225-8912-9.ch009
Fusion Learning: An Online Blended Pedagogy
(2019) · Advances in mobile and distance learning book series · doi:10.4018/978-1-5225-8912-9.ch008
Tutoring in (Online) Higher Education
Rincke, J. (2021) · AEA Randomized Controlled Trials · doi:10.1257/rct.7686-1.0
Navigating the New Normal: Teaching in the Time of Covid
Craig, C., Bergström, A., Brooks, M. E., & Bichard, S. L. (2022) · Journal of Effective Teaching in Higher Education · doi:10.36021/jethe.v5i2.287
The Expanding Landscape of Online Education: Who Engages and How They FarePreprint
Barrow, L., Morris, W., & Sartain, L. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4266416
Guo, J., & Ding, Q. (2023) · Advances in educational technologies and instructional design book series · doi:10.4018/978-1-6684-6500-4.ch011 · Cited by 1
Policy initiatives, self-sorting, and labor market effects of tertiary education for adult workers
Li, H., Liu, Q., Su, Y., & Ederer, P. (2023) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2023.03.003 · Cited by 1
Abana, N. M., Tolentino, A. N., & Roleda, L. S. (2023) · International Conference on e-Education, e-Business, e-Management and e-Learning · doi:10.1145/3588243.3588271
“Findings provided predominantly negative effects of online classes on grades, test scores, and progress in college, with larger negative effects for students who exert lower levels of academic preparation [2, 5, 7, 12].”
BackgroundImproving introductory science courses using comparative assessment across multiple modalities
Schweitzer, J. K., Tobin, W., Krerowicz, S., Blakefield, M., Olson, B., & Law, Y. K. (2023) · New Directions for Teaching and Learning · doi:10.1002/tl.20538
Teaching Courses Online: Practical Implications from an International University Teachers’ Survey
Paccagnini, A. (2023) · Springer eBooks · doi:10.1007/978-3-031-17841-2_4
Aguilar, D., Barrantes, R., Agüero, A., & Soberón, A. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4527126 · Cited by 1
Lacking Motivation or Lacking Productivity to Explain Failure: A Field ExperimentPreprint
Dench, D. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4578615
The Quality of Online Instruction and Returns to Instructor ExperiencePreprint
Zhang, X., & Atwater, A. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4506986
Residential versus Online? Experimental Evidence on Diversifying the STEM Pipeline
Cohodes, S., Ho, H., Huffaker, E., & Robles, S. C. (2024) · AEA Papers and Proceedings · doi:10.1257/pandp.20241016
Do Students Perform Better in Online Delivery of Education? Evidence from Bangladesh
Hoque, N., Basher, S. A., & Haque, A. K. E. (2024) · The Bangladesh Development Studies · doi:10.57138/rwxh4322
“Some randomised experiments at US universities for introductory microeconomics courses show that students perform poorly in online classes compared to face-to-face and blended formats (Alpert, Couch, & Harmon, 2016; Figlio, Rush, & Yin, 2013).”
BackgroundXu, Y., Gu, X., & Deng, L. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4875769
Pedagogical Practices and the Gender Gap in Economics EducationPreprint
Johnson, M., Taengnoi, S., & Engelhardt, B. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4874739
The Impact of Online Testing Mode on Business Assessment Test Performance Before and During COVID
Huang, X., Lin, P., & Yur‐Austin, J. (2024) · Journal of Applied Business and Economics · doi:10.33423/jabe.v26i4.7179
“Noticeably, the attrition rate of students enrolled in online courses is far lower than that of leaners enrolled in traditional face-to-face courses (Alpert et al., 2016; Bettinger et al., 2017; Fendler et al., 2011).”
BackgroundDefining Success for an Introductory Mathematics Non-STEM Pathway Course
Metz, C. (2024) · The Research Repository @ WVU (West Virginia University) · doi:10.33915/etd.12534 · Cited by 2
Student preferences over module design
Fullard, J. (2024) · Discover Education · doi:10.1007/s44217-024-00270-z · Cited by 2
“…the magnitude should be treated with caution, due to selection, this is supported by a growing experimental literature—where students are randomly assigned to online or in-person lectures—that shows that students benefit from in-person teaching [1, 4, 14, 19] although there are some exceptions [2].”
Education, online education, and the earnings of nurses
Osman, S. M. I., & Rubb, S. (2025) · Applied Economics Letters · doi:10.1080/13504851.2025.2451110
“Instead, most studies on online education focus on learning outcomes and costs (Alpert, Couch, and Harmon 2016; Deming et al. 2015).”
Basu, K., Chau, N. H., & Wang, Y. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5091169
Ortagus, J. C., Hughes, R., Voorhees, N., & Allchin, H. (2025) · Research in Higher Education · doi:10.1007/s11162-025-09837-7
“One strand of research uses random assignment to examine the effects of online or face-to-face instructional approaches on students’ outcomes in a single course (Alpert et al., 2016 ; Bowen et al., 2014; Figlio et al., 2013).”
The Implications of a Blended Learning Environment on Students' Engagement
Odit-Dookhan, K., Chittoo, H. B., Vaghjee, H., & Makoondlall-Chadee, T. (2025) · IGI Global eBooks · doi:10.4018/979-8-3693-8402-2.ch010
Effectiveness of Online Education During the COVID-19 Pandemic: Evidence from Chinese Universities
Han, X., Lu, S., Wang, X. (., & Cui, N. (2025) · Production and Operations Management · doi:10.1177/10591478251361979 · Cited by 6
“In contrast, some subsequent randomized controlled trials have mainly reported negative effects (e.g., Alpert et al., 2016; Kofoed et al., 2021).”
The quality of online instruction and returns to instructor experience
Zhang, X., & Atwater, A. (2025) · Economics of Education Review · doi:10.1016/j.econedurev.2025.102700
Puertas, M. A., Gonzales, E. M. Y., & Flores-Molina, J. C. (2025) · European Public & Social Innovation Review · doi:10.31637/epsir-2026-1875
Impact of Online Learning on Achievement of Learning Objectives for Safety and Environmental Courses
Schaal, N., & Raiciulescu, S. (2025) · American Journal of Distance Education · doi:10.1080/08923647.2025.2564521 · Cited by 1
“…to include: health courses at a public university that was rapidly converted to online due to the COVID-19 pandemic (Speer, 2024), OSHA 10-hour General Industry or Construction Health and Safety Training (Shendell et al., 2017), and a microeconomics principles course (Alpert et al., 2016).”
Wang, Z.-Y., Zhang, L.-J., Liu, Y.-H., Jiang, W.-X., Jia, J.-Y., Tang, S.-L., & Liu, X.-Y. (2021) · Figshare · doi:10.6084/m9.figshare.14615497
Wang, Z.-Y., Zhang, L.-J., Liu, Y.-H., Jiang, W.-X., Jia, J.-Y., Tang, S.-L., & Liu, X.-Y. (2021) · Figshare · doi:10.6084/m9.figshare.14615494
Wang, Z.-Y., Zhang, L.-J., Liu, Y.-H., Jiang, W.-X., Jia, J.-Y., Tang, S.-L., & Liu, X.-Y. (2021) · Figshare · doi:10.6084/m9.figshare.14615491
Metadata
- Authors
- Alpert, W. T., Couch, K. A., & Harmon, O. R.
- Affiliations
- University of Connecticut (US)
- Venue
- American Economic Review
- Publisher
- American Economic Association
- Published
- 2016-05-01
- Volume
- 106
- Issue
- 5
- Pages
- 378-382
- ISSN
- 0002-8282 (ISSN-L)
- OpenAlex
- W2355830311
- Cited by
- 209
- References
- 5
- Citations by year
- 2026: 10 · 2025: 19 · 2024: 21 · 2023: 33 · 2022: 44 · 2021: 38 · 2020: 15 · 2019: 9 · 2018: 10 · 2017: 8 · 2016: 2
- FWCI
- 42.90
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Economic Review (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Education › Online and Blended Learning
- Social Sciences › Education › Education during COVID-19 pandemic
- Social Sciences › Education › Technology-Enhanced Education Studies
- Keywords
- online learning, blended learning, face-to-face teaching, learning outcomes, final exam performance, course format comparison
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.