Teaching Courses Online: A Review of the Research
The DOI matches its Crossref record; 103 of the 103 references it cites were found in a registry or an index.
Abstract
This literature review summarizes research on online teaching and learning. It is organized into four topics: course environment, learners’ outcomes, learners’ characteristics, and institutional and administrative factors. The authors found little consistency of terminology, discovered some conclusive guidelines, and identified developing lines of inquiry. The conclusions overall suggest that most of the studies reviewed were descriptive and exploratory, that most online students are nontraditional and Anglo American, and that few universities have written policies, guidelines, or technical support for faculty members or students. Asynchronous communication seemed to facilitate in-depth communication (but not more than in traditional classes), students liked to move at their own pace, learning outcomes appeared to be the same as in traditional courses, and students with prior training in computers were more satisfied with online courses. Continued research is needed to inform learner outcomes, learner characteristics, course environment, and institutional factors related to delivery system variables in order to test learning theories and teaching models inherent in course design.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The current literature overwhelmingly confirms an early research review by Tallent-Runnels et al. (2006), which puts the average age of online students above the traditional college age range of 18–24 years.”
From Post-secondary online learning in the U.S.: an integrative review of the literature on undergraduate student characteristics (2022) · cites this paper as Tallent-Runnels et al. (2006)
Citations
Cites
(1978) · Medical Entomology and Zoology · Cited by 53,488
(2001) · Cited by 13,930
Educational Research: An Introduction
Dale, R. R., & Borg, W. R. (1965) · British Journal of Educational Studies · doi:10.2307/3119062 · Cited by 7,198
Educational Research: Competencies for Analysis and Application
Mills, G. E., & Airasian, P. W. (1995) · Medical Entomology and Zoology · Cited by 5,395
Skinner, B. F. (1938) · Cited by 3,571
Basic Principles of Curriculum and Instruction
Tyler, R. W. (1969) · University of Chicago Press eBooks · doi:10.7208/chicago/9780226820323.001.0001 · Cited by 3,027
Reconsidering Research on Learning from Media
Clark, R. E. (1983) · Review of Educational Research · doi:10.3102/00346543053004445 · Cited by 2,715 · cited 2×
“For example, as some researchers indicated (Clark, 1983, 1994), differences in learning outcomes observed between face-to-face and online courses could be attributed to so many variables that interpretation of any differences becomes virtually impossible.”
Background(2007) · Achieving Excellence in Medical Education · doi:10.1007/978-1-84628-317-8_10 · Cited by 2,368
Educational Research: Competencies for Analysis and Applications
GayMills (2014) · Cited by 1,907
U.S. News and World ReportPreprint
Hefner, B. E., Timke, E. E., & Hegg, K. J. (2020) · OSF Preprints (OSF Preprints) · Cited by 1,692
Inquiry, modeling, and metacognition: making science accessible to all students
White, B. Y., & Frederiksen, J. R. (1998) · Cognition and Instruction · doi:10.1207/s1532690xci1601_2 · Cited by 1,394 · cited 1×
“When discovery learning activities were carefully planned and structured, students were led to make correct interpretations of information and produce solutions to problems presented to them (Hickey, 1997; Minstrell & Stimpson, 1996; White & Frederiksen, 1998).”
BackgroundMayer, R. E., Heiser, J., & Lonn, S. (2001) · Journal of Educational Psychology · doi:10.1037/0022-0663.93.1.187 · Cited by 1,029
Berge, Z. L. (1999) · Wiley Encyclopedia of Electrical and Electronics Engineering · doi:10.1002/047134608x.w3353 · Cited by 863
Mayer, R. E., & Chandler, P. (2001) · Journal of Educational Psychology · doi:10.1037/0022-0663.93.2.390 · Cited by 762 · cited 1×
“Mayer and Chandler (2001) explored the benefits of computer-user interactivity to determine the pace of the presentation.”
Background(1998) · Cited by 530
Quality on the Line: Benchmarks for Success in Internet-Based Distance Education.
Phipps, R. A., & Merisotis, J. P. (2000) · Cited by 522
Learning Style and Effectiveness of Online and Face-to-Face Instruction
Neuhauser, C. (2002) · American Journal of Distance Education · doi:10.1207/s15389286ajde1602_4 · Cited by 484
Learning within incoherent structures: the space of online discussion forums
Thomas, M. J. W. (2002) · Journal of Computer Assisted Learning · doi:10.1046/j.0266-4909.2002.03800.x · Cited by 475
Swan, K., Shea, P., Fredericksen, E., Pickett, A., Pelz, W., & Maher, G. (2000) · Journal of Educational Computing Research · doi:10.2190/w4g6-hy52-57p1-ppne · Cited by 433
Belief revision in children: The role of prior knowledge and strategies for generating evidence
Schauble, L. (1990) · Journal of Experimental Child Psychology · doi:10.1016/0022-0965(90)90048-d · Cited by 420 · cited 4×
“Shiratuddin’s (2001) study with students who learned multimedia design either in traditional or online classrooms in a Malaysian university showed similar results. Students in the online classroom outperformed students in the traditional classroom in course work, final examination grades, and course grades. To better…”
BackgroundResultInfluentialBasic Principles of Curriculum and Instruction
(2010) · Encyclopedia of Curriculum Studies · doi:10.4135/9781412958806.n36 · Cited by 409
Can Web Courses Replace the Classroom in Principles of Microeconomics?
Brown, B. W., & Liedholm, C. E. (2002) · American Economic Review · doi:10.1257/000282802320191778 · Cited by 408
Measurement and Assessment in Education
Reynolds, C. R., Livingston, R. B., & Willson, V. L. (2005) · Cited by 407
Discovery Learning and Discovery Teaching
Hammer, D. (1997) · Cognition and Instruction · doi:10.1207/s1532690xci1504_2 · Cited by 312
Computer‐mediated communication in the university classroom: An experiment with on‐line discussions
Althaus, S. L. (1997) · Communication Education · doi:10.1080/03634529709379088 · Cited by 304
Maki, R. H., Maki, W. S., Patterson, M., & Whittaker, P. D. (2000) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03207788 · Cited by 279
Bocchi, J., Eastman, J. K., & Swift, C. O. (2004) · Journal of Education for Business · doi:10.3200/joeb.79.4.245-253 · Cited by 260
Questioning the Author: A Yearlong Classroom Implementation to Engage Students with Text
Beck, I. L., McKeown, M. G., Sandora, C., Kucan, L., & Worthy, J. (1996) · The Elementary School Journal · doi:10.1086/461835 · Cited by 235
Research on Teaching: Concepts, Findings, and Implications
MacKay, A., Peterson, P. L., & Walberg, H. J. (1980) · Canadian Journal of Education / Revue canadienne de l'éducation · doi:10.2307/1494318 · Cited by 209
ETHICS AND DISTANCE EDUCATION: STRATEGIES FOR MINIMIZING ACADEMIC DISHONESTY IN ONLINE ASSESSMENT
Olt, M. R. (2002) · Online journal of distance learning administration · Cited by 206
Motivation and contemporary socio-constructivist instructional perspectives
Hickey, D. T. (1997) · Educational Psychologist · doi:10.1207/s15326985ep3203_3 · Cited by 198
Rockwell, S. K., Schauer, J., Fritz, S. M., & Marx, D. B. (1999) · Lincoln (University of Nebraska) · Cited by 196
Roblyer, M. D. (1999) · Journal of Research on Computing in Education · doi:10.1080/08886504.1999.10782621 · Cited by 181
Teacher's handbook for elementary social studies
Taba, H. (1967) · Addison-Wesley eBooks · Cited by 167
Clark, R. E. (1994) · Educational Technology Research and Development · doi:10.1007/bf02298090 · Cited by 167
Buckey, K. M. (2003) · Journal of Nursing Education · doi:10.3928/0148-4834-20030801-09 · Cited by 163
Kozma, R. B. (1994) · Educational Technology Research and Development · doi:10.1007/bf02298091 · Cited by 162
Raising the bar:Encouraging high level thinking in online discussion forums
Christopher, M. M., Thomas, J. A., & Tallent‐Runnels, M. K. (2004) · Roeper Review · doi:10.1080/02783190409554262 · Cited by 159
Self-citationSocial interaction as apprenticeship in thinking: Guided participation in spatial planning.
Rogoff, B. (1991) · Perspectives on socially shared cognition. · doi:10.1037/10096-015 · Cited by 145 · cited 1×
“Contemporary Vygotskian theories emphasize the importance of guided participation (Radziszewska & Rogoff, 1991; Rogoff, 1991).”
BackgroundLearning from web‐based instructional systems and cognitive style
Graff, M. (2003) · British Journal of Educational Technology · doi:10.1111/1467-8535.00338 · Cited by 142
Greene, B. A., & Land, S. M. (2000) · Journal of Educational Computing Research · doi:10.2190/1gub-8ue9-nw80-cqad · Cited by 138
A Comparison of Using the Internet versus Lectures to Teach Social Work History
Faux, T. L., & Black-Hughes, C. (2000) · Research on Social Work Practice · doi:10.1177/104973150001000406 · Cited by 135
Online Learning in Sociocultural Context
Warschauer, M. (1998) · Anthropology & Education Quarterly · doi:10.1525/aeq.1998.29.1.68 · Cited by 133
Pedagogical Implications of Online Discussion for Preservice Teacher Training
Im, Y., & Lee, O. (2003) · Journal of Research on Technology in Education · doi:10.1080/15391523.2003.10782410 · Cited by 132
Correlates of learning in a virtual classroom
Hiltz, S. R. (1993) · International Journal of Man-Machine Studies · doi:10.1006/imms.1993.1054 · Cited by 126
Children's guided participation in planning imaginary errands with skilled adult or peer partners.
Radziszewska, B., & Rogoff, B. (1991) · Developmental Psychology · doi:10.1037//0012-1649.27.3.381 · Cited by 124
Individualizing instruction in a web-based hypermedia learning environment
McManus, T. F. (2000) · The Journal of Interactive Learning Research · Cited by 121
Student and Teacher Perceptions of Interaction in Online Computer‐Mediated Communication
McIsaac, M. S., Blocher, J. M., Mahes, V., & Vrasidas, C. (1999) · Educational Media International · doi:10.1080/0952398990360206 · Cited by 120
Elementary Classroom Management: Lessons from Research and Practice
Weinstein, C. S., Romano, M. E., & Mignano, A. J. (1992) · Cited by 116
Student Perceptions of Web-Assisted Teaching Strategies
Frey, A. J., Faul, A. C., & Yankeelov, P. A. (2003) · Journal of Social Work Education · doi:10.1080/10437797.2003.10779148 · Cited by 108
Dellana, S. A., Collins, W. H., & West, D. (2000) · Journal of Education for Business · doi:10.1080/08832320009599049 · Cited by 101
Approaches to studying and perceptions of academic quality in a short web‐based course
Richardson, J. T. E. (2003) · British Journal of Educational Technology · doi:10.1111/1467-8535.00340 · Cited by 96
Sullivan, P. J. (2002) · Innovative Higher Education · doi:10.1023/a:1021109410893 · Cited by 95
Smith, S. B., Smith, S. J., & Boone, R. (2000) · Journal of Special Education Technology · doi:10.1177/016264340001500204 · Cited by 91
Measuring study time distributions: Implications for designing computer-based courses
Taraban, R., Maki, W. S., & Rynearson, K. (1999) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03207718 · Cited by 88
The Effect of Communication on Nursing Student Outcomes in a Web-Based Course
Frith, K. H., & Kee, C. C. (2003) · Journal of Nursing Education · doi:10.3928/0148-4834-20030801-06 · Cited by 87
Bata-Jones, B., & Avery, M. D. (2004) · Journal of Nursing Education · doi:10.3928/01484834-20040401-01 · Cited by 87
Online vs. On-Campus Learning in Teacher Education
Caywood, K., & Duckett, J. (2003) · Teacher Education and Special Education The Journal of the Teacher Education Division of the Council for Exceptional Children · doi:10.1177/088840640302600203 · Cited by 86
Elementary classroom management
Senter, G. W., & Charles, C. M. (1983) · Medical Entomology and Zoology · Cited by 80
Online Compared to Face-to-Face Teacher Preparation for Learning Standards-Based Planning Skills
Peterson, C. L., & Bond, N. (2004) · Journal of Research on Technology in Education · doi:10.1080/15391523.2004.10782419 · Cited by 79
Comparing Web-Based and Classroom-Based Learning: A Quantitative Study
Thirunarayanan, M. O., & Perez-Prado, A. (2001) · Journal of Research on Technology in Education · doi:10.1080/15391523.2001.10782340 · Cited by 78
A Case Study on Technology Use in Distance Learning
Zhang, P. (1998) · Journal of Research on Computing in Education · doi:10.1080/08886504.1998.10782235 · Cited by 77
Parker, D., & Gemino, A. (2019) · Online Learning · doi:10.24059/olj.v5i2.1879 · Cited by 75
How to Engage Students in Learning.
Perrone, V. (1994) · Educational leadership · Cited by 74
Using Technology To Enhance a Course: The Importance of Interaction
Keefe, T. J. (2003) · The EDUCAUSE quarterly/EDUCAUSE quarterly · Cited by 60
Multiplicity in Learning and Teaching: A Framework for Developing Innovative Online Education
Levin, J. A., Levin, S. R., & Waddoups, G. L. (1999) · Journal of Research on Computing in Education · doi:10.1080/08886504.1999.10782277 · Cited by 56
Learning in cyberspace:shaping the future
Gilliver, R. S., Randall, B., & Pok, Y. M. (1998) · Journal of Computer Assisted Learning · doi:10.1046/j.1365-2729.1998.143058.x · Cited by 55
Mikulecky, L. J. (1998) · Journal of Adolescent & Adult Literacy · Cited by 54
Measuring Faculty Participation in Asynchronous Discussion Forums
Blignaut, A. S., & Trollip, S. R. (2003) · Journal of Education for Business · doi:10.1080/08832320309598625 · Cited by 54
Improving the Instructional Congruency of a Computer-Mediated Small-Group Discussion
Ahern, T. C., & El-Hindi, A. E. (2000) · Journal of Research on Computing in Education · doi:10.1080/08886504.2000.10782287 · Cited by 53
Self-citationRemoving Barriers to Professional Development
Feist, L. (2003) · The journal · Cited by 51
Cooper, L. W. (1999) · The journal · Cited by 48
Young, S. S. (2004) · Journal of Computer Assisted Learning · doi:10.1111/j.1365-2729.2004.00073.x · Cited by 48
Gunawardena, C. N., & Duphorne, P. L. (2001) · American Educational Research Association Annual Meeting · Cited by 44
Monitoring the on‐line behaviour of distance learning students
Wilson, T., & Whitelock, D. M. (1998) · Journal of Computer Assisted Learning · doi:10.1046/j.1365-2729.1998.1420091.x · Cited by 44
Twelve Important Questions To Answer Before You Offer a Web Based Curriculum
McAlister, M., Rivera, J. C., & Hallam, S. F. (2001) · Online journal of distance learning administration · Cited by 42
Online, Directed Journaling in Community Health Advanced Practice Nursing Clinical Education
Daroszewski, E. B., Kinser, A. G., & Lloyd, S. (2004) · Journal of Nursing Education · doi:10.3928/01484834-20040401-05 · Cited by 41
Gibson, J. W., & Herrera, J. M. (1999) · NSUWorks (Nova Southeastern University) · Cited by 39
Sonnenwald, D. H., & Li, B. (2003) · British Journal of Educational Technology · doi:10.1111/1467-8535.00339 · Cited by 39
Online Discussion: How Do Students Participate?.
Davidson-Shivers, G. V., Tanner, E., & Muilenburg, L. (2000) · Cited by 37
Technical Communication on the Web: A Profile of Learners and Learning Environments
Schneider, S. P., & Germann, C. (1999) · Technical Communication Quarterly · doi:10.1080/10572259909364647 · Cited by 37
Wells, J. G. (2000) · Journal of STEM Teacher Education · Cited by 35
Mastery quizzes on the Web: Results from a Web-based introductory psychology course
Maki, W. S., & Maki, R. H. (2001) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03195367 · Cited by 34
Redesigning Schools To Meet 21st Century Learning Needs.
Fulton, K. P. (2003) · The journal · Cited by 33
Wells, J. G. (2000) · Journal of industrial teacher education · Cited by 33
Evaluation of Three Educational Online Delivery Approaches.
Edwards, C., & Fritz, J. H. (1997) · Cited by 33
Hantula, D. A. (1998) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03200645 · Cited by 33
The Role of Visual Fidelity in Computer-Based Instruction
Christel, M. G. (1994) · Human-Computer Interaction · doi:10.1207/s15327051hci0902_2 · Cited by 33
Teaching statistics from a distance: what have we learned?
Brown, S. W., & Kulikowich, J. M. (2004) · International journal of instructional media · Cited by 29
Teaching Graduate Psychology Seminars Using Electronic Mail: Creative Distance Education
Hansen, N. E., & GLADFELTER, J. H. (1996) · Teaching of Psychology · doi:10.1207/s15328023top2304_16 · Cited by 28
Lan, W. Y., Tallent‐Runnels, M. K., Fryer, W., Thomas, J., Cooper, S., & Wang, K. (2003) · The Internet and Higher Education · doi:10.1016/j.iheduc.2003.07.003 · Cited by 23
Self-citationDistance Technology: A National Study of Graduate Higher Education Programs.
Butner, B. K., Smith, A. B., & Murray, J. M. (1999) · Online journal of distance learning administration · Cited by 22
Ahern, T. C., & Durrington, V. A. (1995) · Journal of Research on Computing in Education · doi:10.1080/08886504.1995.10782156 · Cited by 22
Self-citationConstructing Community in a Postsecondary Virtual Classroom
Bielman, V. A., Putney, L. G., & Strudler, N. (2003) · Journal of Educational Computing Research · doi:10.2190/p84l-r8ak-0xv6-w3vl · Cited by 21
Internet Instructional Method: Effects on Students' Performance
Shiratuddin, N. (2001) · Universiti Utara Malaysia Institutional Repository (Universiti Utara Malaysia) · Cited by 16
Ridley, D. R., Bailey, B. L., Davies, E. S., Hash, S. G., & Varner, D. A. (1997) · Cited by 14
Changes in Student Attitudes Regarding a Web-Based Health Profession Course.
Lesh, S. G., Guffey, J. S., & Rampp, L. C. (2000) · Cited by 11
Online Courses: What Have We Learned?.
Schrum, L. (1995) · Cited by 10
Pethokoukis, J. M. (2002) · PubMed · Cited by 10
Reed, K. (2005) · PubMed · Cited by 9
The Potential for Electronic Educational Environments: Ensuring Student Success
Schrum, L. (2001) · NSUWorks (Nova Southeastern University) · Cited by 9
Distance Education Goes On-Line in the 21st Century.
Jones, C. A., & Gower, D. S. (1997) · Cited by 4
Long-term blues. Nursing homes to Congress: we really need Medicare.
Sherrid, P. (2002) · PubMed · Cited by 2
Research works printed but not linked: 37
- Bee RH, 1998, College Student Journal, 32, 258
- Bielman V, 2000, Paper presented at the annual meeting of the American Educational Research Association
- Biggs J, 1982, Evaluating the quality of learning: The SOLO Taxonomy
- Broad MC, 1999, Electronic Journal of Instructional Science and Technology, 3
- Brown SW, 2004, International Journal of Instructional Media, 31, 19
- Butner BK, 1999, Online Journal of Distance Learning Administration, 2
- Cooper L, 1999, T.H.E. Journal, 26, 49
- Dahl J, 2003, Distance Education Report, 7, 5
- Davidson-Shivers G, 2000, Paper presented at the annual meeting of the American Educational Research Association
- Feist L, 2003, T.H.E. Journal, 30, 30
- Gibson JW, 1999, T.H.E. Journal, 26, 57
- Gunawardena CN, 2001, Paper presented at the annual meeting of the American Educational Research Association
- Jennings SE, 2003, Delta Pi Epsilon Journal, 45, 183
- Jones CA, 1997, Paper presented at the annual meeting of the Mid-South Educational Research Association
- Kanuka H, 1998, Journal of Distance Education, 13, 57
- Katz-Stone A, 2000, Washington Business Journal, 18, 35
- Keefe TJ, 2003, EDUCAUSE Quarterly, 1, 24
- McAlister MK, 2002, Online Journal of Distance Learning Administration, 4
- McManus TF, 2000, Journal of Interactive Learning Research, 11, 219
- Mikulecky L, 1998, Journal of Adolescent & Adult Literacy, 42, 84
- Minstrell J, 1996, Innovations in learning: New environments for education, 175
- Mortensen M, 2000, Texas Technology Connection, 12
- Olt MR, 2002, Online Journal of Distance Learning Administration, 5
- Parker D, 2001, JALN, 5, 64
- Pearson J, 2004, Acquiring and constructing knowledge through human-computer interaction: Creating new visions for the future of learning
- Richards CN, 1997, College Student Journal, 490
- Ridley DR, 1997, Paper presented at the annual forum of the Association for Institutional Research
- Ridley DR, 1998, Journal of Instructional Psychology, 25, 184
- Rockwell SK, 1999, Online Journal of Distance Learning Administration, 2
- Schrum L, 1995, Paper presented at the World Conference on Computers in Education
- Schrum L, 2001, Paper presented at the annual meeting of the American Educational Research Association
- Shiratuddin N, 2001, Educational Technology & Society, 4, 72
- Swan K, 2001, Paper presented at the annual meeting of the American Educational Research Association
- Trinidad S, 2004, Paper presented at Beyond the Comfort Zone: Proceedings of the 21st ASCILITE Conference
- Vallejo IN, 2001, Paper presented at the annual meeting of the American Educational Research Association
- Wells JG, 2000, Journal of Industrial Teacher Education, 37, 22
- Winograd D, 2000, Paper presented at the annual meeting of Association for Educational Communication and Technology
Cited by
(2009) · US Department of Education · Cited by 3,654
Covid-19 pandemic and online learning: the challenges and opportunities
Adedoyin, O. B., & Soykan, E. (2023) · Interactive Learning Environments · doi:10.1080/10494820.2020.1813180 · Cited by 2,729
Researching the community of inquiry framework: Review, issues, and future directions
Garrison, D. R., & Arbaugh, J. B. (2007) · The Internet and Higher Education · doi:10.1016/j.iheduc.2007.04.001 · Cited by 1,653
The effectiveness of online and blended learning: A meta-analysis of the empirical literature
Means, B., Toyama, Y., Murphy, R., & Baki, M. (2013) · Teachers College Record: The Voice of Scholarship in Education · doi:10.1177/016146811311500307 · Cited by 1,638
Online formative assessment in higher education: A review of the literature
Gikandi, J. W., Morrow, D., & Davis, N. E. (2011) · Computers & Education · doi:10.1016/j.compedu.2011.06.004 · Cited by 1,260
Metadata
- Authors
- Tallent-Runnels, M. K., Thomas, J. A., Lan, W. Y., Cooper, S., Ahern, T. C., Shaw, S. M., & Liu, X.
- Affiliations
- Texas Tech University
- Texas Tech University (US)
- West Virginia University (US)
- Venue
- Review of Educational Research
- Published
- 2006-03
- Volume
- 76
- Issue
- 1
- Pages
- 93-135
- ISSN
- 0034-6543 (ISSN-L)
- 1935-1046
- OpenAlex
- W2133401708
- Cited by
- 1,267
- References
- 103
- Citations by year
- 2026: 11 · 2025: 18 · 2024: 43 · 2023: 64 · 2022: 88 · 2021: 95 · 2020: 80 · 2019: 46 · 2018: 50 · 2017: 44 · 2016: 65 · 2015: 74 · 2014: 75 · 2013: 71 · 2012: 76
- FWCI
- 247.35
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Review of Educational Research (publishedVersion)
- Lincoln (University of Nebraska) (submittedVersion)
- Topics
- Social Sciences › Education › Online and Blended Learning
- Social Sciences › Education › Technology-Enhanced Education Studies
- Social Sciences › Education › Evaluation of Teaching Practices
- Keywords
- online learning, student outcomes, learner characteristics, institutional factors, asynchronous communication, non-traditional students, student satisfaction, computer literacy, online course design, faculty support, institutional policy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.