Artificial Intelligence Education Programs for Health Care Professionals: Scoping Review
Open accessPublished version of a preprint
The DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
Abstract
Background: As the adoption of artificial intelligence (AI) in health care increases, it will become increasingly crucial to involve health care professionals (HCPs) in developing, validating, and implementing AI-enabled technologies. However, because of a lack of AI literacy, most HCPs are not adequately prepared for this revolution. This is a significant barrier to adopting and implementing AI that will affect patients. In addition, the limited existing AI education programs face barriers to development and implementation at various levels of medical education. Objective: With a view to informing future AI education programs for HCPs, this scoping review aims to provide an overview of the types of current or past AI education programs that pertains to the programs’ curricular content, modes of delivery, critical implementation factors for education delivery, and outcomes used to assess the programs’ effectiveness. Methods: After the creation of a search strategy and keyword searches, a 2-stage screening process was conducted by 2 independent reviewers to determine study eligibility. When consensus was not reached, the conflict was resolved by consulting a third reviewer. This process consisted of a title and abstract scan and a full-text review. The articles were included if they discussed an actual training program or educational intervention, or a potential training program or educational intervention and the desired content to be covered, focused on AI, and were designed or intended for HCPs (at any stage of their career). Results: Of the 10,094 unique citations scanned, 41 (0.41%) studies relevant to our eligibility criteria were identified. Among the 41 included studies, 10 (24%) described 13 unique programs and 31 (76%) discussed recommended curricular content. The curricular content of the unique programs ranged from AI use, AI interpretation, and cultivating skills to explain results derived from AI algorithms. The curricular topics were categorized into three main domains: cognitive, psychomotor, and affective. Conclusions: This review provides an overview of the current landscape of AI in medical education and highlights the skills and competencies required by HCPs to effectively use AI in enhancing the quality of care and optimizing patient outcomes. Future education efforts should focus on the development of regulatory strategies, a multidisciplinary approach to curriculum redesign, a competency-based curriculum, and patient-clinician interaction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“The United States of America and Canada make up for 43% of all research published in this field (Charow et al., 2021;Faruqe et al., 2021;Lee et al., 2022;Long & Magerko, 2020;McCoy et al., 2020;Pucchio et al., 2021;Register & Ko, 2020;Teng et al., 2022;Vazhayil et al., 2019;Wiljer et al., 2021;Wiljer & Hakim, 2019;Wood et al., 2021;Xu & Babaian, 2021).”
From Artificial intelligence literacy in higher and adult education: A scoping literature review (2022) · cites this paper as Charow et al., 2021
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Despite the support for including AI education, financial barriers, resistance of educators to change curricula, lack of staff with teaching experience in AI, and limited digitalization are some of the main barriers for implementing AI into the medical curriculum [3,10,12,13].”
From An evidence-based approach to artificial intelligence education for medical students: A systematic review (2023) · cites this paper as [13]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In particular, knowledge related to data stewardship [12,13,37,41], data preprocessing and acquisition [13], standardization [13], data analytics [13,17,39], health data infrastructure [45], programming [39,41], and big data [13,45], may help physicians appreciate the obstacles faced by data scientists and improve the multidisciplinary collaboration [13,39].”
From An evidence-based approach to artificial intelligence education for medical students: A systematic review (2023) · cites this paper as [13]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Eleven studies suggest that physicians should understand the role of data science in AI [12,13,16,37,39,41,42,45].”
From An evidence-based approach to artificial intelligence education for medical students: A systematic review (2023) · cites this paper as [13]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Overall, this includes learning the AI terminology [13,37,45], strengths and limitations of AI [12,13,16,37,42], risks of AI [12,13,17,37,39,42], controlling for bias [42], critical appraisal AI literature and tools [12,13,34,37,39,45,46], and shared decision-making [12,13,37,41,45].”
From An evidence-based approach to artificial intelligence education for medical students: A systematic review (2023) · cites this paper as [13]
Experimental — accuracy not yet measured
33 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation
Tricco, A. C., Lillie, E., Zarin, W., O'Brien, K. K., Colquhoun, H., Levac, D., Moher, D., Peters, M. D. J., Horsley, T., Weeks, L., et al. (2018) · Annals of Internal Medicine · doi:10.7326/m18-0850 · Cited by 43,565
Scoping studies: towards a methodological framework
Arksey, H., & O'Malley, L. (2005) · International Journal of Social Research Methodology · doi:10.1080/1364557032000119616 · Cited by 36,742
High-performance medicine: the convergence of human and artificial intelligence
Topol, E. J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0300-7 · Cited by 10,450
Scoping reviews: Time for clarity in definition, methods, and reporting
Colquhoun, H. L., Levac, D., O'Brien, K. K., Straus, S., Tricco, A. C., Perrier, L., Kastner, M., & Moher, D. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.03.013 · Cited by 2,783
The practical implementation of artificial intelligence technologies in medicine
He, J., Baxter, S. L., Xu, J., Xu, J., Zhou, X., & Zhang, K. (2019) · Nature Medicine · doi:10.1038/s41591-018-0307-0 · Cited by 2,246
Do no harm: a roadmap for responsible machine learning for health care
Wiens, J., Saria, S., Sendak, M., Ghassemi, M., Liu, V. X., Doshi-Velez, F., Jung, K., Heller, K., Kale, D., Saeed, M., et al. (2019) · Nature Medicine · doi:10.1038/s41591-019-0548-6 · Cited by 1,266
Barriers and solutions to online learning in medical education – an integrative review
O’Doherty, D., Dromey, M., Lougheed, J., Hannigan, A., Last, J., & McGrath, D. (2018) · BMC Medical Education · doi:10.1186/s12909-018-1240-0 · Cited by 1,032
Chan, K. S., & Zary, N. (2019) · JMIR Medical Education · doi:10.2196/13930 · Cited by 877
Artificial Intelligence in Medicine: Today and Tomorrow
Briganti, G., & Le Moine, O. (2020) · Frontiers in Medicine · doi:10.3389/fmed.2020.00027 · Cited by 743
Introducing artificial intelligence training in medical education
Paranjape, K., Schinkel, M., Nannan Panday, R., Car, J., & Nanayakkara, P. (2019) · JMIR Medical Education · doi:10.2196/16048 · Cited by 634
Artificial Intelligence in Health Care: A Report From the National Academy of Medicine
Matheny, M. E., Whicher, D., & Thadaney Israni, S. (2020) · JAMA · doi:10.1001/jama.2019.21579 · Cited by 628
Medical Education Must Move From the Information Age to the Age of Artificial Intelligence
Wartman, S. A., & Combs, C. D. (2018) · Academic Medicine · doi:10.1097/acm.0000000000002044 · Cited by 585
Canadian Association of Radiologists White Paper on Artificial Intelligence in Radiology
Tang, A., Tam, R., Cadrin-Chênevert, A., Guest, W., Chong, J., Barfett, J., Chepelev, L., Cairns, R., Mitchell, J. R., Cicero, M. D., et al. (2018) · Canadian Association of Radiologists Journal · doi:10.1016/j.carj.2018.02.002 · Cited by 522
Sit, C., Srinivasan, R., Amlani, A., Muthuswamy, K., Azam, A., Monzon, L., & Poon, D. S. (2020) · Insights into Imaging · doi:10.1186/s13244-019-0830-7 · Cited by 507
Artificial intelligence in medical education
Masters, K. (2019) · Medical Teacher · doi:10.1080/0142159x.2019.1595557 · Cited by 469
Han, E.-R., Yeo, S., Kim, M.-J., Lee, Y.-H., Park, K.-H., & Roh, H. (2019) · BMC Medical Education · doi:10.1186/s12909-019-1891-5 · Cited by 393
Sapci, A. H., & Sapci, H. A. (2020) · JMIR Medical Education · doi:10.2196/19285 · Cited by 377
Machine learning and medical education
Kolachalama, V. B., & Garg, P. S. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0061-1 · Cited by 320
Denning, P. J., & Tedre, M. (2019) · doi:10.7551/mitpress/11740.001.0001 · Cited by 296
Reimagining Medical Education in the Age of AI
(2019) · AMA Journal of Ethics · doi:10.1001/amajethics.2019.146 · Cited by 263
Singh, R. P., Hom, G. L., Abramoff, M. D., Campbell, J. P., Chiang, M. F., & on behalf of the AAO Task Force on Artificial Intelligence (2020) · Translational Vision Science & Technology · doi:10.1167/tvst.9.2.45 · Cited by 259
Artificial intelligence in radiation oncology: A specialty-wide disruptive transformation?
Thompson, R. F., Valdes, G., Fuller, C. D., Carpenter, C. M., Morin, O., Aneja, S., Lindsay, W. D., Aerts, H. J. W. L., Agrimson, B., Deville, C., et al. (2018) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2018.05.030 · Cited by 258
What do medical students actually need to know about artificial intelligence?
McCoy, L. G., Nagaraj, S., Morgado, F., Harish, V., Das, S., & Celi, L. A. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0294-7 · Cited by 240
What should medical students know about artificial intelligence in medicine?
Park, S. H., Do, K.-H., Kim, S., Park, J. H., & Lim, Y.-S. (2019) · Journal of Educational Evaluation for Health Professions · doi:10.3352/jeehp.2019.16.18 · Cited by 196
Wiljer, D., & Hakim, Z. (2019) · Journal of Medical Imaging and Radiation Sciences · doi:10.1016/j.jmir.2019.09.010 · Cited by 170
Self-citationHolm, E. A. (2019) · Science · doi:10.1126/science.aax0162 · Cited by 150
Collado-Mesa, F., Alvarez, E., & Arheart, K. (2018) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2017.12.021 · Cited by 137
Artificial Intelligence in Medicine: Chances and Challenges for Wide Clinical Adoption
Varghese, J. (2020) · Visceral Medicine · doi:10.1159/000511930 · Cited by 113
Tajmir, S. H., & Alkasab, T. K. (2018) · Academic Radiology · doi:10.1016/j.acra.2018.03.007 · Cited by 94
Artificial intelligence and medical imaging 2018: French Radiology Community white paper
(2018) · Diagnostic and Interventional Imaging · doi:10.1016/j.diii.2018.10.003 · Cited by 94
The Empirical Challenge of 21st-Century Medical Education
Wartman, S. A. (2019) · Academic Medicine · doi:10.1097/acm.0000000000002866 · Cited by 82
Oxford Textbook of Medical Education
Weller, J. M. (2014) · British Journal of Anaesthesia · doi:10.1093/bja/aeu210 · Cited by 80
Chamunyonga, C., Edwards, C. R., Caldwell, P. J., Rutledge, P., & Burbery, J. (2020) · Journal of medical imaging and radiation sciences · doi:10.1016/j.jmir.2020.01.008 · Cited by 77
Health informatics: a required skill for 21st century clinicians
Fridsma, D. B. (2018) · BMJ · doi:10.1136/bmj.k3043 · Cited by 59
AI added to the curriculum for doctors-to-be
Brouillette, M. (2019) · Nature Medicine · doi:10.1038/s41591-019-0648-3 · Cited by 56
Big Data and Nursing: Implications for the Future
Topaz, M., & Pruinelli, L. (2017) · Studies in health technology and informatics · doi:10.3233/978-1-61499-738-2-165 · Cited by 52
Why We Needn’t Fear the Machines: Opportunities for Medicine in a Machine Learning World
Li, D., Kulasegaram, K., & Hodges, B. D. (2019) · Academic Medicine · doi:10.1097/acm.0000000000002661 · Cited by 50
Artificial Intelligence in Critical Care
Mathur, P., & Burns, M. L. (2019) · International Anesthesiology Clinics · doi:10.1097/aia.0000000000000221 · Cited by 48
How will “democratization of artificial intelligence” change the future of radiologists?
Kobayashi, Y., Ishibashi, M., & Kobayashi, H. (2018) · Japanese Journal of Radiology · doi:10.1007/s11604-018-0793-5 · Cited by 45
Preparing Next-Generation Scientists for Biomedical Big Data: Artificial Intelligence Approaches
Moore, J. H., Boland, M. R., Camara, P. G., Chervitz, H., Gonzalez, G., Himes, B. E., Kim, D., Mowery, D. L., Ritchie, M. D., Shen, L., et al. (2019) · Personalized Medicine · doi:10.2217/pme-2018-0145 · Cited by 40
The Need for a Machine Learning Curriculum for Radiologists
Wood, M. J., Tenenholtz, N., Geis, J. R., Michalski, M. H., & Andriole, K. P. (2018) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2018.10.008 · Cited by 38
Artificial Intelligence in Radiology Residency Training
Forney, M. C., & McBride, A. F. (2020) · Seminars in Musculoskeletal Radiology · doi:10.1055/s-0039-3400270 · Cited by 38
Artificial Intelligence and Machine Learning: Opportunities for Radiologists in Training
Nguyen, G. K., & Shetty, A. S. (2018) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2018.05.024 · Cited by 31
Kang, J., Thompson, R. F., Aneja, S., Lehman, C., Trister, A., Zou, J., Obcemea, C., & El Naqa, I. (2021) · Practical Radiation Oncology · doi:10.1016/j.prro.2020.06.001 · Cited by 30
Artificial Intelligence in Health Care: Insights From an Educational Forum
Barbour, A. B., Frush, J. M., Gatta, L. A., McManigle, W. C., Keah, N. M., Bejarano-Pineda, L., & Guerrero, E. M. (2019) · Journal of Medical Education and Curricular Development · doi:10.1177/2382120519889348 · Cited by 30
Srivastava, T. K., & Waghmare, L. (2020) · JOURNAL OF CLINICAL AND DIAGNOSTIC RESEARCH · doi:10.7860/jcdr/2020/43293.13565 · Cited by 29
Machine Learning for the Interventional Radiologist
Meek, R. D., Lungren, M. P., & Gichoya, J. W. (2019) · American Journal of Roentgenology · doi:10.2214/ajr.19.21527 · Cited by 26
Use of Diagnostic Decision Support Systems in Medical Education
McGowan, J. J., & Berner, E. S. (2010) · Methods of Information in Medicine · doi:10.3414/me9309 · Cited by 25
Shen, N., Yufe, S. J., Saadatfard, O., Sockalingam, S., & Wiljer, D. (2017) · Journal of Continuing Education in the Health Professions · doi:10.1097/ceh.0000000000000154 · Cited by 22
Self-citationBhavnani, S. P., Muñoz, D., & Bagai, A. (2016) · Circulation Cardiovascular Quality and Outcomes · doi:10.1161/circoutcomes.116.003081 · Cited by 20
Data Science and Graduate Nursing Education: A Critical Literature Review
Foster, M., & Tasnim, Z. (2020) · Clinical Nurse Specialist · doi:10.1097/nur.0000000000000516 · Cited by 18
How I learned to stop worrying and love machine learning
Mattessich, S., Tassavor, M., Swetter, S. M., & Grant-Kels, J. M. (2018) · Clinics in Dermatology · doi:10.1016/j.clindermatol.2018.06.003 · Cited by 16
Integrating Bayesian reasoning into medical education using smartphone apps
Kinnear, B., Hagedorn, P. A., Kelleher, M., Ohlinger, C., & Tolentino, J. (2019) · Diagnosis · doi:10.1515/dx-2018-0065 · Cited by 16
Balthazar, P., Tajmir, S., Ortiz, D., Herse, C. C., Shea, L., Seals, K. F., Cohen-Addad, D. I., Purkayastha, S., & Gichoya, J. W. (2019) · Academic Radiology · doi:10.1016/j.acra.2019.10.005 · Cited by 15
Residents’ Introduction to Comparative Effectiveness Research and Big Data Analytics
Kang, S. K., Lee, C. I., Pandharipande, P. V., Sanelli, P. C., & Recht, M. P. (2017) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2016.10.032 · Cited by 13
Transitions in medical education
Westerman, M., & Teunissen, P. W. (2013) · Oxford University Press eBooks · doi:10.1093/med/9780199652679.003.0032 · Cited by 13
How artificial intelligence is transforming healthcare
Houlton, S. (2018) · Prescriber · doi:10.1002/psb.1708 · Cited by 12
Mendiola, M. S., Martínez-Franco, A. I., Lobato, M., Saldívar, F. F., Vives-Varela, T., & Martínez-González, A. (2015) · BMC Medical Education · doi:10.1186/s12909-015-0349-7 · Cited by 11
Should we teach computational thinking and big data principles to medical students?
Saqr, M., & Tedre, M. (2019) · PubMed · doi:10.13140/rg.2.2.16827.05926 · Cited by 11
The Role of Accreditation in Achieving the Quadruple Aim
Cox, M., Blouin, A. S., The Joint Commission, Cuff, P. A., National Academies of Sciences, E., Paniagua, M. A., Phillips, S., & Vlasses, P. H. (2017) · NAM Perspectives · doi:10.31478/201710a · Cited by 9
Medical Graduates, Truthful and Useful Analytics With Big Data, and the Art of Persuasion
Gorman, D. F., & Kashner, T. M. (2017) · Academic Medicine · doi:10.1097/acm.0000000000002109 · Cited by 7
Jeffery, A. D. (2019) · CIN Computers Informatics Nursing · doi:10.1097/cin.0000000000000504 · Cited by 4
Career Enrichment Opportunities at the Scientific Frontier in Radiation Oncology
Thompson, R. F., Fuller, C. D., Berman, A. T., Aneja, S., & Thomas, C. R. (2019) · JCO Clinical Cancer Informatics · doi:10.1200/cci.18.00126 · Cited by 4
Global health and data science: future needs for tomorrow’s cardiologist
Evans, J., & Banerjee, A. (2016) · British Journal of Cardiology · doi:10.5837/bjc.2016.026 · Cited by 2
Murali, N. (2019) · Oxford University Press eBooks · doi:10.1093/med/9780198755791.003.0020 · Cited by 2
O’Donohue, W., Byrd, M. R., Cummings, N. A., & Henderson, D. A. (2005) · Routledge eBooks · doi:10.4324/9780203997987-5 · Cited by 1
(1945) · Public Health Economics · doi:10.1177/107755874500200529 · Cited by 1
Research works printed but not linked: 8
- HoqueMThree domains of learning: cognitive, affective and psychomotorAcademic Research - What the research project is intended to achieve20172021-10-20https://www.researchgate.net/publication/330811334_Three_Domains_of_Learning_Cognitive_Affective_and_Psychomotor
- Topaz, M, 2017, Stud Health Technol Inform, 232, 165
- SybengaAZreikRTMohammadARaoABig Data: bioinformatics education during residency demonstrates immediate valueNature Publishing Group2021-11-24https://www.nature.com/articles/labinvest20168.pdf?proof=t
- Saqr, M, 2019, Int J Health Sci (Qassim), 13, 1
- Strosahl, K, 2005, Behavioral Integrative Care: Treatments That Work in the Primary Care Setting
- SchneeweissSAhmedSBurhanACampbellCCompetency-based CPD: implications for physicians, CPD providers and health care institutionsCanada: Royal College of Physicians and Surgeons of Canada2021-10-20https://journals.sagepub.com/doi/abs/10.1177/1039856219859279 · DOI
- Ghassemi, M, 2019, Health Law Canada, 40, 38
- Park, JY, 2014, MERLOT J Online Learn Teach, 10, 299
Cited by
Bond, M., Khosravi, H., De Laat, M., Bergdahl, N., Negrea, V., Oxley, E., Pham, P., Chong, S. W., & Siemens, G. (2024) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-023-00436-z · Cited by 852
Artificial intelligence literacy in higher and adult education: A scoping literature review
Laupichler, M. C., Aster, A., Schirch, J., & Raupach, T. (2022) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2022.100101 · Cited by 658
Drawbacks of artificial intelligence and their potential solutions in the healthcare sector.
khan, B., Fatima, H., Qureshi, A., Kumar, S., Hanan, A., Hussain, J., & Abdullah, S. (2023) · Biomedical Materials & Devices · doi:10.1007/s44174-023-00063-2 · Cited by 461
Esmaeilzadeh, P. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.102861 · Cited by 377
Pinski, M., & Benlian, A. (2024) · Computers in Human Behavior: Artificial Humans · doi:10.1016/j.chbah.2024.100062 · Cited by 243
Metadata
- Authors
- Charow, R., Jeyakumar, T., Younus, S., Dolatabadi, E., Salhia, M., Al-Mouaswas, D., Anderson, M., Balakumar, S., Clare, M., Dhalla, A., Gillan, C., Haghzare, S., Jackson, E., Lalani, N., Mattson, J., Peteanu, W., Tripp, T., Waldorf, J., Williams, S., Tavares, W., & Wiljer, D.
- Affiliations
- University Health Network (CA)
- University of Toronto (CA)
- Vector Institute (CA)
- Corresponding author
- Wiljer, David
- ORCID
- Charow, Rebecca
- Jeyakumar, Tharshini
- Younus, Sarah
- Dolatabadi, Elham
- Salhia, Mohammad
- Al-Mouaswas, Dalia
- Anderson, Melanie
- Balakumar, Sarmini
- Clare, Megan
- Dhalla, Azra
- Gillan, Caitlin
- Haghzare, Shabnam
- Jackson, Ethan
- Lalani, Nadim
- Mattson, Jane
- Peteanu, Wanda
- Tripp, Tim
- Waldorf, Jacqueline
- Williams, Spencer
- Tavares, Walter
- Wiljer, David
- Venue
- JMIR Medical Education
- Publisher
- JMIR Publications Inc.
- Published
- 2021-12-13
- Volume
- 7
- Issue
- 4
- Pages
- e31043
- ISSN
- 2369-3762 (ISSN-L)
- PMC
- PMC8713099
- OpenAlex
- W4200037840
- Cited by
- 291
- References
- 67
- Citations by year
- 2026: 90 · 2025: 116 · 2024: 52 · 2023: 28 · 2022: 5
- FWCI
- 1.77
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Medical Education (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- Government of Canada
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Education › Innovations in Medical Education
- Social Sciences › Education › Artificial Intelligence in Education
- Keywords
- artificial intelligence in healthcare, AI literacy, healthcare workers, medical education, curriculum content, competency-based curriculum, explainable AI, AI adoption barriers, patient-clinician interaction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.