The DOI matches its Crossref record; 95 of the 95 references it cites were found in a registry or an index.
Meta-analyzing the effect of online learning on academic achievement in higher education during COVID-19 pandemic
Abstract
Investigating the influence of the emergency transition to online learning during the Covid-19 pandemic can significantly enhance our understanding of the benefits and limitations of technology in higher education. We aim to assess the effect of online learning on college students' academic achievement compared to face-to-face learning during the Covid-19 crisis. This study utilizes a meta-analysis approach, examining 35 research studies conducted in 17 different countries and regions from 2020 to 2023, through an extensive database search encompassing the Web of Science Core Collection, EBSCO Host, JSTOR, Springerlink, and SCOPUS. The sample size comprised 8079 students, with 4160 assigned to the experimental group (online) and 3919 to the control group (face-to-face). We found that online learning yields a modest and positive effect (g = 0.336, 95% CI [0.139–0.534]) on students' academic achievement. The effect was consistent across class years and exam types but varied by subject, benefiting students in medicine, engineering, and natural sciences, while negatively affecting social sciences. Additionally, the effect of online learning shows a stronger positive impact on the academic achievement of students from lower-income level nations. Our research indicates that online learning could be a viable and potentially equalizing force in higher education.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225 · cited 2×
“If the I² value is 75% or greater, we would opt for the random-effects model (Borenstein et al., 2009).”
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2021) · doi:10.1002/9781119558378 · Cited by 9,799
The Difference between Emergency Remote Teaching and Online Learning
Hodges, C. B., Moore, S., Lockee, B. B., Trust, T., & Bond, M. A. (2024) · Handbook of Research in Online Learning · doi:10.1163/9789004702813_021 · Cited by 6,253
A Literature Review on Impact of COVID-19 Pandemic on Teaching and Learning
Pokhrel, S., & Chhetri, R. (2021) · Higher Education for the Future · doi:10.1177/2347631120983481 · Cited by 2,400
Online learning amid the COVID-19 pandemic: Students perspectives
Adnan, M. (2020) · Journal of Pedagogical Sociology and Psychology · doi:10.33902/jpsp.2020261309 · Cited by 1,920
Learning loss due to school closures during the COVID-19 pandemic
Engzell, P., Frey, A., & Verhagen, M. D. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2022376118 · Cited by 1,848 · cited 1×
“…consistently demonstrated that this sudden shift to remote learning, necessitated by the closure of physical campuses and the imposition of social isolation measures, has had detrimental effects on students ’ learning outcomes (Azevedo et al., 2021; Donnelly & Patrinos, 2021; Engzell et al., 2021).”
Learning loss due to school closures during the COVID-19 pandemic
Engzell, P., Frey, A., & Verhagen, M. D. (2020) · doi:10.31235/osf.io/ve4z7 · Cited by 1,739
Blended Learning in Higher Education: Framework, Principles, and Guidelines
Garrison, D. R., & Vaughan, N. D. (2007) · Wiley eBooks · doi:10.1002/9781118269558 · Cited by 1,609
Blended Learning in Higher Education: Framework, Principles, and Guidelines.
Wainwright, S. (2011) · Journal of Physical Therapy Education · doi:10.1097/00001416-201110000-00013 · Cited by 1,438
Research works printed but not linked: 5
- 10.24256/ideas.v8i2.1696.2020261309 · doi:10.24256/ideas.v8i2.1696.2020261309
- Mseleku, Z. (2020). A literature review of E-learning and E-teaching in the era of COVID-19 pandemic. International Journal of Innovative Science and Research Technology, 5(10), 588–597.
- Oxford Learning College. (n.d.). Online Education & E-learning Statistics UK. Retrieved July 18 2023 from https://www.oxfordcollege.ac/news/online-education-statistics/.
- Sharma, A. K., Sharma, H. R., & Choudhary, U. (2020). E-learning versus traditional teaching in medical education: A comparative study. JK Science, 22(3), 137–140.
- Wu, W., Yao, R., & Xie, Z. X. (2020). A study on the differences of college teachers’ online teaching satisfaction between regions and universities. The Australian Educational Researcher, 26, 71–79.
Cited by
Haywood, S., Padurean, L., Ralph, R., & Tobias, J. M. (2025) · Education Sciences · doi:10.3390/educsci15070902 · Cited by 4
Pedagogical System for Hybrid Training of Future Special Educators
Kiкbanova, A., & Zhiyenbayeva, N. (2026) · Open Education Studies · doi:10.1515/edu-2025-0123 · Cited by 4
Utsumi, Y., Smith, A., Yang, L., Kokubun, R., & Ishii, K. (2025) · Educational Psychology · doi:10.1080/01443410.2024.2448196 · Cited by 2
“…focuses on the impact of online education on objective learning outcomes, particularly academic performance as measured by grades (e.g. Alarifi & Song, 2024; Alzubi, 2022; Betthäuser et al., 2023; Chung et al., 2022; Clark et al., 2020; Paul & Jefferson, 2019; Ulum, 2022; Xiong et al., 2024).”
Learning Preferences and Academic Outcomes: Insights from Franciscan-Managed Schools
Cutillas, A. L., & Lebosada, J. O. (2024) · International Journal of Multidisciplinary Applied Business and Education Research · doi:10.11594/ijmaber.05.12.02 · Cited by 1
Transforming K-10 Motivation and Engagement Through Flipped Classrooms and Peer-Led Learning
Slime, M. (2025) · IEEE Integrated STEM Education Conference (ISEC) · doi:10.1109/isec64801.2025.11147361 · Cited by 1
Metadata
- Authors
- Xiong, Y., Fang, S., & Shen, M.
- Affiliations
- Hunan University (CN)
- Fudan University (CN)
- Sun Yat-sen University (CN)
- Corresponding author
- Fang, Shixin
- Venue
- Interactive Learning Environments
- Publisher
- Informa UK Limited
- Published
- 2024-07-10
- Pages
- 1-23
- ISSN
- 1049-4820 (ISSN-L)
- 1744-5191
- OpenAlex
- W4400509871
- Cited by
- 12
- References
- 93
- Citations by year
- 2026: 5 · 2025: 6 · 2024: 1
- FWCI
- 15.17
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Interactive Learning Environments (publishedVersion)
- Funders
- Education and Scientific Research Project of Shanghai (C2022054)
- Topics
- Social Sciences › Education › Education during COVID-19 pandemic
- Social Sciences › Education › Online and Blended Learning
- Social Sciences › Education › Online Learning Methods and Innovations
- Keywords
- online learning, academic performance, higher education, COVID-19 pandemic, emergency remote teaching, face-to-face learning, educational technology, subject differences, income level, educational equity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Meta-analyzing the effect of online learning on academic achievement in higher education during COVID-19 pandemic. https://app.cochat.ai/papers/10.1080/10494820.2024.2375347
- The paper
- Xiong, Y., Fang, S., & Shen, M. (2024). Meta-analyzing the effect of online learning on academic achievement in higher education during COVID-19 pandemic. Interactive Learning Environments. https://doi.org/10.1080/10494820.2024.2375347
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.