Assessing AI Awareness and Identifying Essential Competencies: Insights From Key Stakeholders in Integrating AI Into Medical Education
Open accessThe DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
Abstract
Background: The increasing importance of artificial intelligence (AI) in health care has generated a growing need for health care professionals to possess a comprehensive understanding of AI technologies, requiring an adaptation in medical education. Objective: This paper explores stakeholder perceptions and expectations regarding AI in medicine and examines their potential impact on the medical curriculum. This study project aims to assess the AI experiences and awareness of different stakeholders and identify essential AI-related topics in medical education to define necessary competencies for students. Methods: The empirical data were collected as part of the TüKITZMed project between August 2022 and March 2023, using a semistructured qualitative interview. These interviews were administered to a diverse group of stakeholders to explore their experiences and perspectives of AI in medicine. A qualitative content analysis of the collected data was conducted using MAXQDA software. Results: Semistructured interviews were conducted with 38 participants (6 lecturers, 9 clinicians, 10 students, 6 AI experts, and 7 institutional stakeholders). The qualitative content analysis revealed 6 primary categories with a total of 24 subcategories to answer the research questions. The evaluation of the stakeholders’ statements revealed several commonalities and differences regarding their understanding of AI. Crucial identified AI themes based on the main categories were as follows: possible curriculum contents, skills, and competencies; programming skills; curriculum scope; and curriculum structure. Conclusions: The analysis emphasizes integrating AI into medical curricula to ensure students’ proficiency in clinical applications. Standardized AI comprehension is crucial for defining and teaching relevant content. Considering diverse perspectives in implementation is essential to comprehensively define AI in the medical context, addressing gaps and facilitating effective solutions for future AI use in medical studies. The results provide insights into potential curriculum content and structure, including aspects of AI in medicine.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures

Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Figure 2 shows that recent literature has largely prioritized user-level competencies for medical students and practicing health professionals [2,6-8].”
From Role-Differentiated AI Competencies and Curriculum Implications for Health Professions Education: Qualitative Study (2026) · cites this paper as [7]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“In contrast, a few of them employed either qualitative methods [38–40] or a mixed-methods approach [41–45].”
From Artificial intelligence in undergraduate medical education: an updated scoping review (2025) · cites this paper as [39]
The cited source says what the claim attributes to it.
In the citing paper
“Multiple articles have recommended various AI-related competencies or identified areas for learning about AI literacy in UGME [39, 74, 159, 160].”
From Artificial intelligence in undergraduate medical education: an updated scoping review (2025) · cites this paper as [39]
The cited source says what the claim attributes to it.
In the citing paper
“These included a lack of standard definitions for AI [38, 39]”
From Artificial intelligence in undergraduate medical education: an updated scoping review (2025) · cites this paper as [39]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Existing frameworks offer valuable multilevel and system-based guidance but are less often organized around healthcare professionals’ functional responsibilities in AI-enabled practice [2,6-8,11,13].”
From Role-Differentiated AI Competencies and Curriculum Implications for Health Professions Education: Qualitative Study (2026) · cites this paper as [7]
Experimental — accuracy not yet measured
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Standards for Reporting Qualitative Research: A Synthesis of Recommendations
O’Brien, B. C., Harris, I. B., Beckman, T. J., Reed, D. A., & Cook, D. A. (2014) · Academic Medicine · doi:10.1097/acm.0000000000000388 · Cited by 12,211 · cited 1×
“This qualitative study approach followed the Standards for Reporting Qualitative Research [33].”
MethodKallio, H., Pietilä, A., Johnson, M., & Kangasniemi, M. (2016) · Journal of Advanced Nursing · doi:10.1111/jan.13031 · Cited by 4,295 · cited 1×
“The interview guide followed the guiding research questions for the needs assessment [34].”
MethodRajpurkar, P., Chen, E., Banerjee, O., & Topol, E. J. (2022) · Nature Medicine · doi:10.1038/s41591-021-01614-0 · Cited by 3,212 · cited 1×
“As technology rapidly advances, AI will increasingly play a crucial role in the future of health care [12,13].”
BackgroundThe rise of artificial intelligence in healthcare applications
Bohr, A., & Memarzadeh, K. (2020) · Artificial Intelligence in Healthcare · doi:10.1016/b978-0-12-818438-7.00002-2 · Cited by 1,636 · cited 1×
“Interactions related to the introduction of AI in health care can significantly impact how patients are treated and how medical information is used [52].”
BackgroundCurriculum development for medical education a six-step approach
Thomas, P. A., Kern, D. E., Hughes, M. T., Tackett, S. A., & Chen, B. Y. (2022) · Cited by 1,241
Sarker, I. H. (2022) · SN Computer Science · doi:10.1007/s42979-022-01043-x · Cited by 1,208 · cited 1×
“A clear definition of this complex term helps prevent misunderstandings, as the field of AI is expansive, encompassing various technologies and methodologies [45,46].”
BackgroundUnintended consequences of machine learning in medicine
Cabitza, F., Rasoini, R., & Gensini, G. F. (2017) · JAMA · doi:10.1001/jama.2017.7797 · Cited by 1,066
Encyclopedia of Personality and Individual Differences
(2018) · Springer eBooks · doi:10.1007/978-3-319-28099-8 · Cited by 985
Nadarzynski, T., Miles, O., Cowie, A., & Ridge, D. (2019) · DIGITAL HEALTH · doi:10.1177/2055207619871808 · Cited by 810 · cited 1×
“Dictation systems with speech recognition powered by AI are also used, and AI chatbots are deployed to assist doctors and patients by providing appointments and information [8-10].”
MethodThe impact of artificial intelligence in medicine on the future role of the physician
Ahuja, A. S. (2019) · PeerJ · doi:10.7717/peerj.7702 · Cited by 789 · cited 1×
“As technology rapidly advances, AI will increasingly play a crucial role in the future of health care [12,13].”
BackgroundArtificial Intelligence in Medicine: Today and Tomorrow
Briganti, G., & Le Moine, O. (2020) · Frontiers in Medicine · doi:10.3389/fmed.2020.00027 · Cited by 743 · cited 1×
“These intelligent systems can improve health care efficiency, accuracy, and quality while potentially reducing the burden on medical personnel [5,6].”
BackgroundOn Defining Artificial Intelligence
Wang, P. (2019) · Journal of Artificial General Intelligence · doi:10.2478/jagi-2019-0002 · Cited by 740
Large Language Models in Medical Education: Opportunities, Challenges, and Future Directions
Abd-alrazaq, A., AlSaad, R., Alhuwail, D., Ahmed, A., Healy, P. M., Latifi, S., Aziz, S., Damseh, R., Alabed Alrazak, S., & Sheikh, J. (2023) · JMIR Medical Education · doi:10.2196/48291 · Cited by 722 · cited 1×
“The experience of educators— especially those familiar with medical students—is therefore imperative in the process [35,36].”
BackgroundThe Social Construction of Technology: Structural Considerations
Klein, H. K., & Kleinman, D. L. (2002) · Science, Technology, & Human Values · doi:10.1177/016224390202700102 · Cited by 592 · cited 1×
“Technology development is shaped by social construction and negotiation processes, where technology emerges as a social construct through human action and influences societal structures and institutions [51].”
BackgroundMedical Education Must Move From the Information Age to the Age of Artificial Intelligence
Wartman, S. A., & Combs, C. D. (2018) · Academic Medicine · doi:10.1097/acm.0000000000002044 · Cited by 585 · cited 1×
“Additionally, institutional stakeholders provide an important framework for continuously monitoring and reevaluating the implementation of AI in medical curricula to ensure its utility and quality [18,40,41].”
BackgroundHan, E.-R., Yeo, S., Kim, M.-J., Lee, Y.-H., Park, K.-H., & Roh, H. (2019) · BMC Medical Education · doi:10.1186/s12909-019-1891-5 · Cited by 393 · cited 1×
“Additionally, the effective use of AI in the medical field requires not only developing the necessary technological advances in AI applications but also ensuring that future physicians possess the required skills and expertise to effectively apply these technologies [16-18].”
BackgroundSapci, A. H., & Sapci, H. A. (2020) · JMIR Medical Education · doi:10.2196/19285 · Cited by 377 · cited 1×
“Medical students should also develop skills in interpreting AI models and be familiar with machine learning, deep learning, and data analytics to apply AI in clinical practice [29].”
BackgroundKaraca, O., Çalışkan, S. A., & Demir, K. (2021) · BMC Medical Education · doi:10.1186/s12909-021-02546-6 · Cited by 377 · cited 1×
“Several studies emphasize the importance of understanding the fundamentals of AI and data science, mathematical concepts, and related ethical and social issues [26,28].”
BackgroundSHIFTing artificial intelligence to be responsible in healthcare: a systematic review
Siala, H., & Wang, Y. (2022) · Social Science & Medicine · doi:10.1016/j.socscimed.2022.114782 · Cited by 358 · cited 1×
“Therefore, ethical compatibility and adherence to societal standards are fundamental [53].”
BackgroundLeitfaden- und Experteninterviews
Helfferich, C. (2019) · Handbuch Methoden der empirischen Sozialforschung · doi:10.1007/978-3-658-21308-4_44 · Cited by 324 · cited 1×
“Semistructured guided interviews were chosen as they allow a flexible participation-centered approach and in-depth exploration of the topic, capturing the diverse perspectives of the stakeholders involved [42].”
BackgroundReimagining Medical Education in the Age of AI
(2019) · AMA Journal of Ethics · doi:10.1001/amajethics.2019.146 · Cited by 263 · cited 3×
“Therefore, assessing their current state of knowledge, attitudes, and heterogeneity across different student populations is an important step in adequately addressing the educational needs for medical AI and integrating it such that students will benefit from it [18,37].”
BackgroundHandbuch Methoden der empirischen Sozialforschung
(2019) · Springer eBooks · doi:10.1007/978-3-658-21308-4 · Cited by 250
Qualitative Inhaltsanalyse – Abgrenzungen, Spielarten, Weiterentwicklungen
Mayring, P. (2019) · Forum Qualitative Sozialforschung / Forum: Qualitative Social Research · doi:10.17169/fqs-20.3.3343 · Cited by 249 · cited 1×
“This step enabled flexibility and openness to new insights that transcended the initially defined structure (deductive approach) [44].”
BackgroundWhat do medical students actually need to know about artificial intelligence?
McCoy, L. G., Nagaraj, S., Morgado, F., Harish, V., Das, S., & Celi, L. A. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0294-7 · Cited by 240 · cited 1×
“Therefore, it is crucial to consider integrating AI into the medical curriculum and determine how this technology can be effectively incorporated to benefit students and patients [19-21].”
BackgroundA sociotechnical perspective for the future of AI: narratives, inequalities, and human control
Sartori, L., & Theodorou, A. (2022) · Ethics and Information Technology · doi:10.1007/s10676-022-09624-3 · Cited by 237 · cited 1×
“Since the 1980s, it has been recognized that the introduction of new technologies such as AI does not occur in isolation or independent of societal influences, contrary to the earlier assumption of technological determinism [49,50].”
BackgroundMinding the gap(s): public perceptions of AI and socio-technical imaginaries
Sartori, L., & Bocca, G. (2023) · AI & SOCIETY · doi:10.1007/s00146-022-01422-1 · Cited by 214
Chen, B. Y., Kern, D. E., Kearns, R. M., Thomas, P. A., Hughes, M. T., & Tackett, S. (2019) · Academic Medicine · doi:10.1097/acm.0000000000002580 · Cited by 203
Moldt, J.-A., Festl-Wietek, T., Madany Mamlouk, A., Nieselt, K., Fuhl, W., & Herrmann-Werner, A. (2023) · Medical Education Online · doi:10.1080/10872981.2023.2182659 · Cited by 186
Self-citationNeeds, Challenges, and Applications of Artificial Intelligence in Medical Education Curriculum
Grunhut, J., Marques, O., & Wyatt, A. T. M. (2022) · JMIR Medical Education · doi:10.2196/35587 · Cited by 166 · cited 2×
“These experts offer a thorough understanding of AI concepts, applications, and their potential impact on health care [36,38].”
BackgroundGrunhut, J., Wyatt, A. T., & Marques, O. (2021) · Journal of Medical Education and Curricular Development · doi:10.1177/23821205211036836 · Cited by 161 · cited 1×
“However, studies indicate that the integration of AI into the medical curriculum to enhance understanding of AI algorithms and optimize their use remains in its early stages, particularly in Germany [22-24].”
BackgroundCurrent challenges of implementing artificial intelligence in medical imaging
Saw, S. N., & Ng, K. H. (2022) · Physica Medica · doi:10.1016/j.ejmp.2022.06.003 · Cited by 149 · cited 1×
“For instance, they are used in imaging diagnostics where AI algorithms help analyze medical images [7].”
MethodThe fundamentals of Artificial Intelligence in medical education research: AMEE Guide No. 156.
Tolsgaard, M. G., Pusic, M. V., Sebok-Syer, S. S., Gin, B., Svendsen, M. B., Syer, M. D., Brydges, R., Cuddy, M. M., & Boscardin, C. K. (2023) · Medical Teacher · doi:10.1080/0142159x.2023.2180340 · Cited by 137 · cited 1×
“While it is a hot topic among AI experts, health care students are not yet fully aware of the significance of AI, although the technology is expected to enter their professional lives in the future [31,54].”
BackgroundThe need for health AI ethics in medical school education
Katznelson, G., & Gerke, S. (2021) · Advances in Health Sciences Education · doi:10.1007/s10459-021-10040-3 · Cited by 125 · cited 1×
“These experts offer a thorough understanding of AI concepts, applications, and their potential impact on health care [36,38].”
BackgroundGetting Clarity by Defining Artificial Intelligence—A Survey
Monett, D., & Lewis, C. W. P. (2018) · Studies in applied philosophy, epistemology and rational ethics · doi:10.1007/978-3-319-96448-5_21 · Cited by 118 · cited 1×
“This lack of clarity can hinder the development of standardized curricula and educational programs related to AI in medical education, especially when different stakeholders with different backgrounds might be mixing the AI terminologies “strong AI” and “weak AI” [47,48].”
BackgroundGrounded in reality: artificial intelligence in medical education
Krive, J., Isola, M., Chang, L., Patel, T., Anderson, M., & Sreedhar, R. (2023) · JAMIA Open · doi:10.1093/jamiaopen/ooad037 · Cited by 93 · cited 1×
“Some institutions have developed specific courses and training programs to enhance medical students’ knowledge and skills in AI [25-27].”
BackgroundArtificial Intelligence in medical imaging practice: looking to the future
Lewis, S. J., Gandomkar, Z., & Brennan, P. C. (2019) · Journal of Medical Radiation Sciences · doi:10.1002/jmrs.369 · Cited by 92 · cited 1×
“However, studies indicate that the integration of AI into the medical curriculum to enhance understanding of AI algorithms and optimize their use remains in its early stages, particularly in Germany [22-24].”
BackgroundIntegrating Al Algorithms into the Clinical Workflow
Juluru, K., Shih, H.-H., Murthy, K. N. K., Elnajjar, P., El-Rowmeim, A., Roth, C. J., Genereaux, B. W., Fox, J. J., Siegel, E. L., & Rubin, D. L. (2021) · Radiology Artificial Intelligence · doi:10.1148/ryai.2021210013 · Cited by 92
Lin, B., & Wu, S. (2021) · OMICS A Journal of Integrative Biology · doi:10.1089/omi.2021.0037 · Cited by 89 · cited 1×
“The health care sector is currently undergoing a significant transformation process characterized by the increased integration of digital technologies [2-4].”
BackgroundBusch, F., Adams, L. C., & Bressem, K. K. (2023) · Medical Science Educator · doi:10.1007/s40670-023-01815-x · Cited by 88 · cited 2×
“For instance, this becomes particularly important when determining which AI applications can enhance the learning experience in specific medical specialties [41].”
BackgroundBlease, C., Kharko, A., Bernstein, M., Bradley, C., Houston, M., Walsh, I., Hägglund, M., DesRoches, C., & Mandl, K. D. (2022) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2021-100480 · Cited by 81 · cited 1×
“Therefore, assessing their current state of knowledge, attitudes, and heterogeneity across different student populations is an important step in adequately addressing the educational needs for medical AI and integrating it such that students will benefit from it [18,37].”
BackgroundMagaldi, D., & Berler, M. (2018) · Springer eBooks · doi:10.1007/978-3-319-28099-8_857-1 · Cited by 65
Dumić-Čule, I., Orešković, T., Brkljačić, B., Kujundžić Tiljak, M., & Orešković, S. (2020) · Croatian Medical Journal · doi:10.3325/cmj.2020.61.457 · Cited by 61 · cited 1×
“Therefore, it is crucial to consider integrating AI into the medical curriculum and determine how this technology can be effectively incorporated to benefit students and patients [19-21].”
BackgroundInsights from teaching artificial intelligence to medical students in Canada
Hu, R., Fan, K. Y., Pandey, P., Hu, Z., Yau, O., Teng, M., Wang, P., Li, T., Ashraf, M., & Singla, R. (2022) · Communications Medicine · doi:10.1038/s43856-022-00125-4 · Cited by 58 · cited 1×
“Several studies emphasize the importance of understanding the fundamentals of AI and data science, mathematical concepts, and related ethical and social issues [26,28].”
BackgroundDigitalisierung im Gesundheitswesen: heute und in Zukunft
Stachwitz, P., & Debatin, J. F. (2023) · Bundesgesundheitsblatt - Gesundheitsforschung - Gesundheitsschutz · doi:10.1007/s00103-022-03642-8 · Cited by 55
How Artificial Intelligence Will Change Medicine
Wallis, C. (2019) · Nature · doi:10.1038/d41586-019-03845-1 · Cited by 43
How will artificial intelligence change medical training?
Kundu, S. (2021) · Communications Medicine · doi:10.1038/s43856-021-00003-5 · Cited by 43
Ganapathi, S., & Duggal, S. (2023) · PLOS ONE · doi:10.1371/journal.pone.0282415 · Cited by 40 · cited 1×
“Thus, their perspectives are relevant to the integration of AI into education and practice since they can inspire other medical workers to engage with it [39].”
BackgroundDolata, U. (2008) · Zeitschrift für Soziologie · doi:10.1515/zfsoz-2008-0103 · Cited by 35 · cited 1×
“Since the 1980s, it has been recognized that the introduction of new technologies such as AI does not occur in isolation or independent of societal influences, contrary to the earlier assumption of technological determinism [49,50].”
BackgroundFrom wearables to THINKables: artificial intelligence-enabled sensors for health monitoring
Mirmomeni, M., Fazio, T., von Cavallar, S., & Harrer, S. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-819246-7.00012-7 · Cited by 23 · cited 1×
“Based on this information, personalized recommendations can be made to help individuals improve their well-being [11].”
BackgroundArtificial Intelligence in Undergraduate Medical Education
Mosch, L. K., Agha-Mir-Salim, L., Sarica, M. M., Balzer, F., & Poncette, A.-S. (2022) · Studies in health technology and informatics · doi:10.3233/shti220597 · Cited by 23 · cited 1×
“This also requires restructuring medical curricula to adapt to dynamic technological advances to prepare students for the changing structures of medical practice [14,15].”
BackgroundA clarion call to introduce artificial intelligence (AI) in postgraduate medical physics curriculum
Ng, K. H., & Wong, J. H. D. (2022) · Physical and Engineering Sciences in Medicine · doi:10.1007/s13246-022-01099-2 · Cited by 13 · cited 1×
“This also requires restructuring medical curricula to adapt to dynamic technological advances to prepare students for the changing structures of medical practice [14,15].”
Background(2021) · Springer eBooks · doi:10.1007/978-3-658-35779-5 · Cited by 11
Lohmann, A., & Schömig, A. (2020) · Nomos Verlagsgesellschaft mbH & Co. KG eBooks · doi:10.5771/9783748920984-345 · Cited by 2 · cited 1×
“German clinics have been incorporating com-puter-driven clinical decision systems, such as the electronic patient record and other digital health tools, that can analyze data, identify patterns, and make decisions based on that data [3].”
BackgroundDurch KI wird die Medizin effizienter, individueller und präventiver
Joachim Hornegger, A. (2021) · Springer eBooks · doi:10.1007/978-3-658-35779-5_33 · Cited by 2 · cited 1×
“Dictation systems with speech recognition powered by AI are also used, and AI chatbots are deployed to assist doctors and patients by providing appointments and information [8-10].”
Method
Cited by
Artificial intelligence in undergraduate medical education: an updated scoping review
Simoni, J., Urtubia-Fernandez, J., Mengual, E., Simoni, D. A., Royo, M., Egaña-Yin, D., Hertog, O. L. A., López-Ortiz, L., Muñoz-Tomás, A., Santiago-Martínez, P., et al. (2025) · BMC Medical Education · doi:10.1186/s12909-025-08188-2 · Cited by 62
McCoy, L., Ganesan, N., Rajagopalan, V., McKell, D., Niño, D. F., & Swaim, M. C. (2025) · Journal of Medical Education and Curricular Development · doi:10.1177/23821205251339226 · Cited by 40
Kumar, R., Singh, A., Kassar, A., Humaida, M., Joshi, S., & Sharma, M. (2025) · Frontiers in Public Health · doi:10.3389/fpubh.2025.1558772 · Cited by 32
El‐Sayed, A. A. I., Alsenany, S. A., Almalki, R. S. E., & Asal, M. G. R. (2025) · Nurse Education Today · doi:10.1016/j.nedt.2025.106734 · Cited by 32
Enhancing risk management in hospitals: leveraging artificial intelligence for improved outcomes
Guerra, R. (2024) · Italian Journal of Medicine · doi:10.4081/itjm.2024.1721 · Cited by 24
Metadata
- Authors
- Moldt, J.-A., Festl-Wietek, T., Fuhl, W., Zabel, S., Claassen, M., Wagner, S., Nieselt, K., & Herrmann-Werner, A.
- Affiliations
- University of Tübingen (DE)
- Universitätsklinikum Tübingen (DE)
- Corresponding author
- Moldt, Julia-Astrid
- ORCID
- Venue
- JMIR Medical Education
- Publisher
- JMIR Publications Inc.
- Published
- 2024-06-12
- Volume
- 10
- Pages
- e58355-e58355
- ISSN
- 2369-3762 (ISSN-L)
- PMC
- PMC11238140
- OpenAlex
- W4396700068
- Cited by
- 47
- References
- 51
- Citations by year
- 2026: 24 · 2025: 21 · 2024: 2
- FWCI
- 4.39
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Medical Education (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Deutsche Forschungsgemeinschaft
- Eberhard Karls Universität Tübingen
- Bundesministerium für Bildung und Forschung
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Education › Innovations in Medical Education
- Social Sciences › Education › Artificial Intelligence in Education
- Keywords
- artificial intelligence in healthcare, AI awareness, medical education, medical curriculum, AI competencies, stakeholder perspectives, curriculum content, programming skills, AI literacy
- MeSH terms
- Stakeholder Participation, Adult, Artificial Intelligence, Awareness, Clinical Competence, Curriculum, Education, Medical, Female, Humans, Interviews as Topic, Male, Students, Medical, Qualitative Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.