Is It Live or Is It Internet? Experimental Estimates of the Effects of Online Instruction on Student Learning
The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
This article presents the first experimental evidence on the effects of live versus Internet media of instruction. Students in a large introductory microeconomics course at a major research university were randomly assigned to live lectures versus watching these same lectures in an Internet setting where all other factors (e.g., instruction, supplemental materials) were the same. We find modest evidence that live-only instruction dominates Internet instruction. These results are particularly strong for Hispanic students, male students, and lower-achieving students. We also provide suggestions for future experimentation in other settings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Academic preparation (usually measured by G.P.A., SAT score and/or class rank), has been found to be a mediating variable affecting online grades and dropout rates (Bettinger et al., 2017; Figlio et al., 2013; Gregory, 2016; Harrell & Bower, 2011; Ice et al., 2012; Johnson & Mejia, 2014; Lee & Choi, 2011; Lint, 2013; Ryabov, 2012; Wladis et al., 2016; Xu & Jaggars, 2011a*), although it is unclear”
From Post-secondary online learning in the U.S.: an integrative review of the literature on undergraduate student characteristics (2022) · cites this paper as Figlio et al., 2013
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Many of these studies-including several high-quality randomized control trials-have looked at four-year institutions, generally finding null to negative effects of online course-taking (Altindag et al., Forthcoming;Bettinger et al., 2017;Figlio et al., 2013;Kofoed et al., 2024;Krieg & Henson, 2016; see Xu & Xu, 2020, for a review).”
From Online Student Performance Under Synchronous and Asynchronous Instruction in California Community Colleges (2026) · cites this paper as Figlio et al., 2013
The cited source says what the claim attributes to it.
In the citing paper
“Figlio et al. (2013) report that students with specific characteristics (Latinx, men, low achievers) do poorly online in comparison to face-to-face.”
From Post-secondary online learning in the U.S.: an integrative review of the literature on undergraduate student characteristics (2022) · cites this paper as Figlio et al. (2013)
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Some studies have attempted to do this with mixed results (i.e., Alpert et al., 2016; Arias et al., 2018; Figlio et al., 2013; Stack, 2015), though most randomized studies typically compare hybrid courses to face-to-face courses (see Bowen et al., 2014; Vernadakis et al., 2012).”
From Post-secondary online learning in the U.S.: an integrative review of the literature on undergraduate student characteristics (2022) · cites this paper as Figlio et al., 2013
The cited source says what the claim attributes to it.
In the citing paper
“Figlio et al. (2013) found no significant difference between online and face-to face course formats among students with higher prior G.P.A.s.”
From Post-secondary online learning in the U.S.: an integrative review of the literature on undergraduate student characteristics (2022) · cites this paper as Figlio et al. (2013)
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2009) · US Department of Education · Cited by 3,654
Zhang, D., Zhou, L., Briggs, R. O., & Nunamaker, J. F. (2006) · Information & Management · doi:10.1016/j.im.2005.01.004 · Cited by 1,283
Experimental Estimates of Education Production Functions
Krueger, A. B. (1999) · The Quarterly Journal of Economics · doi:10.1162/003355399556052 · Cited by 1,120
Making the Grade: Online Education in the United States, 2006.
Allen, I. E., & Seaman, J. (2006) · Cited by 630
Can Web Courses Replace the Classroom in Principles of Microeconomics?
Brown, B. W., & Liedholm, C. E. (2002) · American Economic Review · doi:10.1257/000282802320191778 · Cited by 408
Angrist, J., Bettinger, E., & Kremer, M. (2006) · American Economic Review · doi:10.1257/aer.96.3.847 · Cited by 406
Interactive Multimedia-Based E-Learning: A Study of Effectiveness
Zhang, D. (2005) · American Journal of Distance Education · doi:10.1207/s15389286ajde1903_3 · Cited by 281
Navarro, P., & Shoemaker, J. (2000) · Contemporary Economic Policy · doi:10.1111/j.1465-7287.2000.tb00032.x · Cited by 39
Cramming: The Effects of School Accountability on College-Bound Students
Donovan, C. M., Figlio, D., & Rush, M. (2006) · National Bureau of Economic Research · doi:10.3386/w12628 · Cited by 25
Self-citation
Research works printed but not linked: 3
- Bettinger Eric, 2007, Long
- Kane Thomas, Funding restrictions at public universities: Effects and policy implications. Working paper
- Mortenson Thomas, 2005, State tax fund appropriations for higher education: FY 1961 to FY
Cited by
Items 301–400 of 440
Stephan, M. (2021) · OPUS FAU (Kooperativer Bibliotheksverbund Berlin-Brandenburg (KOBV), on behalf of the Universitätsbibliothek Erlangen-Nürnberg) · Cited by 2
Latinos achieving online: an exploration at a Hispanic serving institution
Murphy, M. (2020) · John Spoor Broome Library Institutional Repository (California State University) · Cited by 2
Szura, J. W., Fischer, C., Link, R. D., & Collins, P. (2022) · Journal of Chemical Education · doi:10.1021/acs.jchemed.2c00437 · Cited by 1
A multi-attribute value approach for selection of course modality – A preliminary model
Juneja, P. K., Meadati, P., & Palreddy, S. R. (2023) · IOP Conference Series Earth and Environmental Science · doi:10.1088/1755-1315/1176/1/012010 · Cited by 1
Zhou, H. D., Walker, J. D., & Olson, D. M. (2024) · AJP Advances in Physiology Education · doi:10.1152/advan.00112.2023 · Cited by 1
(2024) · Frontiers research topics · doi:10.3389/978-2-8325-4913-1 · Cited by 1
Pedagogical practices and the gender gap in economics education
Engelhardt, B., Johnson, M., & Taengnoi, S. (2024) · Southern Economic Journal · doi:10.1002/soej.12718 · Cited by 1
Flores, M., Gerstenblüth, M., & Suarez, L. (2025) · Research in Higher Education · doi:10.1007/s11162-025-09862-6 · Cited by 1
Acuňa, M., & Intong, J. D. (2025) · Aloysian Interdisciplinary Journal of Social Sciences, Education, and Allied Fields · doi:10.5281/zenodo.15778866 · Cited by 1
Zhang, J., Yi, C., Wang, C., Xu, S., Wang, Y., & Xia, L. (2025) · AIS Electronic Library (AISeL) · Cited by 1
How home exams and peers affect college grades in unprecedented times
Ásgeirsdóttir, T. L., Francesconi, M., Jóhannsdóttir, Á. M., & Zoega, G. (2025) · European Economic Review · doi:10.1016/j.euroecorev.2025.105240 · Cited by 1
Nagakura, Y., Yamaki, F., Saimaru, H., Hiroya, K., & Ichinose, K. (2026) · Currents in Pharmacy Teaching and Learning · doi:10.1016/j.cptl.2026.102728 · Cited by 1
Häll, C., Lindskog, A., & Lundin, M. (2026) · Economics of Education Review · doi:10.1016/j.econedurev.2026.102818 · Cited by 1
Using Google Drawings to Create Homework Exercises
Harmon, O. R., & Szarka, R. (2018) · Journal of Economics Teaching · doi:10.58311/jeconteach/cb6e720d514867854cefdc6b43a098f676b69bd6 · Cited by 1
Belleflamme, P., & Jacqmin, J. (2018) · Regards économiques · doi:10.14428/regardseco2014.02.01 · Cited by 1
Lee, D., & Combes, N. J. (2020) · American Journal of Distance Education · doi:10.1080/08923647.2020.1768817 · Cited by 1
Maeda, K., & Tomiyama, K. (2020) · Japanese Journal of Sport Management · doi:10.5225/jjsm.2020-003 · Cited by 1
The trend of distance education: problems and prospects for implementation
Grigorov, G. (2021) · Grani · doi:10.15421/172131 · Cited by 1
Kapanadze, T. (2021) · Journal of Legal Studies · doi:10.2478/jles-2021-0010 · Cited by 1
Voss, S. (2021) · Springer eBooks · doi:10.1007/978-3-658-34432-0_8 · Cited by 1
(2015) · Issues in Information Systems · doi:10.48009/3_iis_2015_11-16 · Cited by 1
Do professors’ wages depend on students’ earnings?
Faria, J. R., & Mixon, F. G. (2022) · Applied Economics · doi:10.1080/00036846.2022.2078781 · Cited by 1
Guo, J., & Ding, Q. (2023) · Advances in educational technologies and instructional design book series · doi:10.4018/978-1-6684-6500-4.ch011 · Cited by 1
Policy initiatives, self-sorting, and labor market effects of tertiary education for adult workers
Li, H., Liu, Q., Su, Y., & Ederer, P. (2023) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2023.03.003 · Cited by 1
Stevenson, A. N., & Brown, W. A. (2023) · Advances in Social Sciences Research Journal · doi:10.14738/assrj.107.15122 · Cited by 1
Students' Perceptions of Online Class Delivery During the COVID-19 Pandemic: The Case of the UAE
Elchaar, R., Grassa, R., & White, T. (2023) · Emerald Group Publishing Limited eBooks · doi:10.1108/s1085-462220230000027011 · Cited by 1
Evidence of the Challenge in Engaging Unemployed Youth with Online Learning Platforms
Dhuey, E., Furzer, J., Perlman, M., & White, L. A. (2024) · Canadian Public Policy · doi:10.3138/cpp.2022-023 · Cited by 1
Reference Framework for Inclusive Digital Education – A project report
Hammoda, B., Ellyton, M., Foli, S., Mallarge, J., Durst, S., & Rothenberger, S. (2023) · Bogucki Wydawnictwo Naukowe eBooks · doi:10.12657/9788379863761-8 · Cited by 1
Lau, Y., Vyas, L., & Rawat, S. (2024) · foresight · doi:10.1108/fs-10-2023-0204 · Cited by 1
Exploring the Pandemic’s Impacts on Latinx Students’ Learning
Hendricks, M., Arellanes, J. A., Su‐Russell, C., Moon, N. E. J., & Vasquez, S. (2024) · Journal of Underrepresented & Minority Progress · doi:10.32674/ev7as419 · Cited by 1
Leorato, S. (2022) · Archivio Istituzionale della Ricerca (Universita Degli Studi Di Milano) · doi:10.26398/ijas.0034-003 · Cited by 1
Perceptions of Persistence in a Community College English Composition Class
Watson, S. (2019) · ScholarWorks (Walden University) · Cited by 1
Predicting Learning Behavior Using A Unified Framework: Looking Beyond the Clicks
Mohammed, S. (2020) · eScholarship (California Digital Library) · Cited by 1
Breaking Down Barriers: The Impact of State Authorization Reciprocity on Online Enrollment
Ward, J. D., Booth, H., Pisacreta, E. D., & Weintraut, B. (2021) · doi:10.18665/sr.315451 · Cited by 1
Mayer, R. E., & Fiorella, L. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108894333.002 · Cited by 1
Business School Grades, Assessment Scores, and Dropout Rates in the Covid-19 PandemicPreprint
Johnson, M., Engelhardt, B., & Taengnoi, S. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3943471 · Cited by 1
Online vs. Classroom: Course Engagement and Attention with Large Groups of StudentsPreprint
Rodríguez-Longarela, I. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3958070 · Cited by 1
Economics of Massive Open Online Courses, Higher Education
Saltzman, G. M. (2017) · Springer eBooks · doi:10.1007/978-94-017-9553-1_89-1 · Cited by 1
Diaz, L. I. D., Ferreyra, M. M., Urzúa, S., & Bassi, M. (2022) · National Bureau of Economic Research · doi:10.3386/w30364 · Cited by 1
Bassi, M., Dinarte, L., Ferreyra, M. M., & Urzúa, S. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4352366 · Cited by 1
Rice, M. F. (2023) · Online Learning · doi:10.24059/olj.v27i1.3887 · Cited by 1
Online Education and Student Performances : between effectiveness and equality
Arguirova, D. (2023) · theses.fr (ABES) · doi:10.70675/0228da4dzcc72z474ez8863z81c039720f8a · Cited by 1
Disconnecting Women: Gender Disparities in the Impact of Online InstructionPreprint
Shan, X., Zölitz, U., & Backes‐Gellner, U. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5363191 · Cited by 1
Guan, Y. (2023) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) · Cited by 1
Online Faculty and Administrators Perspectives of Online Advising Challenges and Resources
Betts, K. D. (2020) · ScholarWorks (Walden University) · Cited by 1
Essays in Political Economy and Economic Sociology
Mehic, A. (2023) · Lund University Publications (Lund University) · Cited by 1
Hart, C. M. D., Baker, R., Hill, M., Alonso, E., & Xu, D. (2026) · Research in Higher Education · doi:10.1007/s11162-025-09873-3
Wladis, C., Hachey, A. C., Conway, K., & Manly, C. (2025) · Online Learning · doi:10.24059/olj.v29i3.5018
Bantum, C. N. P. (2013) · ProQuest LLC eBooks
Evaluierung von eLearning-Instrumenten im Bereich der universitären Lehre
Wocken, M., & Loy, J. (2011) · GIL Jahrestagung
Zapatero, E. G., & Chen, J. (2015) · International Journal for Innovation Education and Research · doi:10.31686/ijier.vol3.iss11.478
The Effects of Facebook Discussions on Academic PerformancePreprint
Fano, S., & Pellizzari, P. (2015) · SSRN Electronic Journal · doi:10.2139/ssrn.2667076
A Comparison of Online Instructional Strategies Across Key Student Outcomes
Ingersoll, G. M. (2015) · eScholarship (California Digital Library)
STUDENT "ATTENDANCE" IN ONLINE LECTURES
Brothen, T. (2017) · EDULEARN proceedings · doi:10.21125/edulearn.2017.0494
Implementing Recorded Lectures: Education Production Function Analysis in Economics Online CoursesPreprint
Byrd, J., & Minadeo, D. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3060707
Personality and Scheduling in Online Courses
Cung, B. (2018) · eScholarship (California Digital Library)
Tan, C. K., Nguyen, B. D., & Choo, K. H. (2019) · International Journal of Modern Education · doi:10.35631/ijmoe.11002
Economics of Massive Open Online Courses, Higher Education
Saltzman, G. M. (2020) · Springer eBooks · doi:10.1007/978-94-017-8905-9_89
Online Delivery of a Beginners Course in Japanese: Its Costs and Benefits
Muranaka-Vuletich, H. (2020) · Language policy · doi:10.1007/978-3-030-50925-5_15
The Good MOOC and the UniversitiesPreprint
Dargaud, E., & Jouneau-Sion, F. (2019) · HAL
The Competitive Effects of Online EducationPreprint
Deming, D. J., Lovenheim, M., & Patterson, R. W. (2016) · RePEc: Research Papers in Economics
Henson, J. D. (2020) · Scholar Commons (University of South Carolina)
Arisudhana, G. A. B., & Risnawati, N. E. (2020) · Journal Center of Research Publication in Midwifery and Nursing · doi:10.36474/caring.v4i2.182
Essays on Labor Economics and Education
Fano, S. (2016) · Archivio istituzionale della Ricerca - Bocconi
Are in-person lectures beneficial for all students? A Study of a Large Statistics ClassPreprint
Fireman, E. S., Donnini, Z. S., Eck, D. J., & Weissman, M. B. (2021) · arXiv (Cornell University)
Bustillo-Booth, M. R. (2021) · University of Washington Tacoma Digital Commons (University of Washington Tacoma)
Farghally, M. F., Mohammed, M., Mahmoud, H. F. F., Ellis, M., Haqq, D., Domino, M., Jones, B. D., & Shaffer, C. A. (2024) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--37755
A Heterogeneous Study on Online Education Outcomes during the Quarantine Period
Shi, Y. (2021) · International Conference on Education and E-Learning (ICEEL) · doi:10.1145/3502434.3502459
The State of Higher Education in the Dominican Republic
Louime, C. J., Hernandez-Martich, D., & Perdomo, O. P. (2022) · International Journal of Education · doi:10.5296/ije.v14i1.19496
Computer-Supported Collaborative Learning and Psychology: An Option for the Future?
Mebane, M. (2022) · Advances in human and social aspects of technology book series · doi:10.4018/978-1-7998-8476-7.ch023
Tutoring in (Online) Higher Education
Rincke, J. (2021) · AEA Randomized Controlled Trials · doi:10.1257/rct.7686
A Flawed Promise: Anytime Learning
(2019) · Advances in mobile and distance learning book series · doi:10.4018/978-1-5225-8912-9.ch006
Education Smart Room: Designing an Intelligent Environment for Learning
Naidu, S., Pandaram, A., Chand, A., Karan, M. F., & Lako, J. (2021) · Springer eBooks · doi:10.1007/978-3-319-31816-5_4365-1
Berger, D. (2022) · Deep Blue (University of Michigan) · doi:10.7302/4676
The House Blend: Combining Technology and Accelerated Instruction
Hill, M. (2019) · American Educational Research Association Annual Meeting (AERA) · doi:10.3102/1445588
McPartlan, P. (2019) · American Educational Research Association Annual Meeting (AERA) · doi:10.3102/1438230
Making "chicken nuggets" and discussing "fried baloney": a study in racially equitable group work
Liechty, A. L. (2022) · Digital Repository Service (Northeastern University) · doi:10.17760/d20439298
Remote Teaching and Remote Exams Due to COVID-19: Some Evidence from Teaching Law and Economics
Baum, I., Bełdowski, J., & Dąbroś, Ł. (2022) · Economic analysis of law in European legal scholarship · doi:10.1007/978-3-030-95876-3_8
Technology and Education: Computers, Software, and the InternetPreprint
Bulman, G. B., & Fairlie, R. W. (2015) · RePEc: Research Papers in Economics
Fairlie, R. W. (2015) · RePEc: Research Papers in Economics
Gu, X., & Li, H. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4361959
Education Smart Room: Designing an Intelligent Environment for Learning
Naidu, S., Pandaram, A., Chand, A., Karan, M. F., & Lako, J. (2022) · Springer eBooks · doi:10.1007/978-3-030-66252-3_4365
Abana, N. M., Tolentino, A. N., & Roleda, L. S. (2023) · International Conference on e-Education, e-Business, e-Management and e-Learning · doi:10.1145/3588243.3588271
Teaching Courses Online: Practical Implications from an International University Teachers’ Survey
Paccagnini, A. (2023) · Springer eBooks · doi:10.1007/978-3-031-17841-2_4
دور التكنولوجيا في دعم التطوير المهني للكادر التدريسي في الجامعات: مناقشة الإمكانات
كلية التربية, ج. ق., & Altae, M. (2023) · International Conference on Language and Education · doi:10.24086/icafs2023/paper.971
The Quality of Online Instruction and Returns to Instructor ExperiencePreprint
Zhang, X., & Atwater, A. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4506986
Glazier, R. A. (2024) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780197544891.013.24
Residential versus Online? Experimental Evidence on Diversifying the STEM Pipeline
Cohodes, S., Ho, H., Huffaker, E., & Robles, S. C. (2024) · AEA Papers and Proceedings · doi:10.1257/pandp.20241016
Do Students Perform Better in Online Delivery of Education? Evidence from Bangladesh
Hoque, N., Basher, S. A., & Haque, A. K. E. (2024) · The Bangladesh Development Studies · doi:10.57138/rwxh4322
5. La didattica telematica: diffusione e caratteristiche degli studenti
Salini, S., Santo, V. D., Trancossi, S., & Zampatti, D. (2024) · doi:10.54103/mheo.179.c244
The Impact of Online Testing Mode on Business Assessment Test Performance Before and During COVID
Huang, X., Lin, P., & Yur‐Austin, J. (2024) · Journal of Applied Business and Economics · doi:10.33423/jabe.v26i4.7179
(2024) · Online Learning · doi:10.24059/olj.v28i3.4714
Ai, S. (2024) · InterActions UCLA Journal of Education and Information Studies · doi:10.5070/d41.6661
(2024) · Issues in Information Systems · doi:10.48009/2_iis_2024_112
Equity in hybrid microeconomics classes: Effects on diverse student groups
Adkins, S. (2024) · International Review of Economics Education · doi:10.1016/j.iree.2024.100304
E-Learning at Universities: Does Starting with Difficult Questions Affect Student Performance?Preprint
Galkiewicz, A., Marcus, J., & Siedler, T. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.5035508
Pramsanga, C., & Bejrananda, J. (2024) · Asian Creative Architecture, Art and Design : ACAAD · doi:10.55003/acaad.2024.271493
Basu, K., Chau, N. H., & Wang, Y. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5091169
Ortagus, J. C., Hughes, R., Voorhees, N., & Allchin, H. (2025) · Research in Higher Education · doi:10.1007/s11162-025-09837-7
Acceptance and adoption of e-learning tools among second language learners: a case study
Kingston, C. L. (2021) · International Forum Journal · doi:10.63201/krwc4751
Metadata
- Authors
- Figlio, D., Rush, M., & Yin, L.
- Affiliations
- Northwestern University (US)
- University of Florida (US)
- ORCID
- Yin, Lu
- Venue
- Journal of Labor Economics
- Publisher
- University of Chicago Press
- Published
- 2013-10
- Volume
- 31
- Issue
- 4
- Pages
- 763-784
- ISSN
- 0734-306X (ISSN-L)
- 1537-5307
- OpenAlex
- W3122912300
- Cited by
- 367
- References
- 9
- Citations by year
- 2026: 16 · 2025: 17 · 2024: 32 · 2023: 40 · 2022: 54 · 2021: 52 · 2020: 31 · 2019: 19 · 2018: 21 · 2017: 16 · 2016: 23 · 2015: 18 · 2014: 9 · 2013: 10
- FWCI
- 96.77
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Labor Economics (publishedVersion)
- Topics
- Social Sciences › Education › Online and Blended Learning
- Social Sciences › Education › Innovations in Educational Methods
- Social Sciences › Education › Education during COVID-19 pandemic
- Keywords
- online instruction, live lectures, student learning, microeconomics education, instructional media, Hispanic students, gender differences, academic performance, randomized field experiment, higher education
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.