Health Care Professionals’ Experience of Using AI: Systematic Review With Narrative Synthesis
Open accessPublished version of a preprint
The DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.
Abstract
Background: There has been a substantial increase in the development of artificial intelligence (AI) tools for clinical decision support. Historically, these were mostly knowledge-based systems, but recent advances include non–knowledge-based systems using some form of machine learning. The ability of health care professionals to trust technology and understand how it benefits patients or improves care delivery is known to be important for their adoption of that technology. For non–knowledge-based AI tools for clinical decision support, these issues are poorly understood. Objective: The aim of this study is to qualitatively synthesize evidence on the experiences of health care professionals in routinely using non–knowledge-based AI tools to support their clinical decision-making. Methods: In June 2023, we searched 4 electronic databases, MEDLINE, Embase, CINAHL, and Web of Science, with no language or date limit. We also contacted relevant experts and searched reference lists of the included studies. We included studies of any design that reported the experiences of health care professionals using non–knowledge-based systems for clinical decision support in their work settings. We completed double independent quality assessment for all included studies using the Mixed Methods Appraisal Tool. We used a theoretically informed thematic approach to synthesize the findings. Results: After screening 7552 titles and 182 full-text articles, we included 25 studies conducted in 9 different countries. Most of the included studies were qualitative (n=13), and the remaining were quantitative (n=9) and mixed methods (n=3). Overall, we identified 7 themes: health care professionals’ understanding of AI applications, level of trust and confidence in AI tools, judging the value added by AI, data availability and limitations of AI, time and competing priorities, concern about governance, and collaboration to facilitate the implementation and use of AI. The most frequently occurring are the first 3 themes. For example, many studies reported that health care professionals were concerned about not understanding the AI outputs or the rationale behind them. There were issues with confidence in the accuracy of the AI applications and their recommendations. Some health care professionals believed that AI provided added value and improved decision-making, and some reported that it only served as a confirmation of their clinical judgment, while others did not find it useful at all. Conclusions: Our review identified several important issues documented in various studies on health care professionals’ use of AI tools in real-world health care settings. Opinions of health care professionals regarding the added value of AI tools for supporting clinical decision-making varied widely, and many professionals had concerns about their understanding of and trust in this technology. The findings of this review emphasize the need for concerted efforts to optimize the integration of AI tools in real-world health care settings. Trial Registration: PROSPERO CRD42022336359; https://tinyurl.com/2yunvkmb
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This lack of understanding was explicitly linked to diminished trust and acceptance of AI, increased difficulty integrating AI tools into existing clinical workflows, and confusion over specific AI alerts [51].”
From Explainable AI for Clinical Decision Support Systems: Literature Review, Key Gaps, and Research Synthesis (2025) · cites this paper as [51]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“For example, a 2024 review by Ayorinde et al. [51] found widespread reports of healthcare professionals struggling to understand AI outputs and rationale due to the AI's opacity.”
From Explainable AI for Clinical Decision Support Systems: Literature Review, Key Gaps, and Research Synthesis (2025) · cites this paper as [51]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The PRISMA 2020 statement: An updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n71 · Cited by 108,283
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496
Methods for the thematic synthesis of qualitative research in systematic reviews
Thomas, J., & Harden, A. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-45 · Cited by 9,312
Expectancy-value theory of achievement motivation
Wigfield, A., & Eccles, J. S. (2000) · Contemporary Educational Psychology · doi:10.1006/ceps.1999.1015 · Cited by 7,383
The Mixed Methods Appraisal Tool (MMAT) version 2018 for information professionals and researchers
Hong, Q. N., Fàbregues, S., Bartlett, G., Boardman, F., Cargo, M., Dagenais, P., Gagnon, M.-P., Griffiths, F., Nicolau, B., O’Cathain, A., et al. (2018) · Education for Information · doi:10.3233/efi-180221 · Cited by 4,737
Self-citationThe potential for artificial intelligence in healthcare
Davenport, T., & Kalakota, R. (2019) · Future Healthcare Journal · doi:10.7861/futurehosp.6-2-94 · Cited by 3,800
Updating guidance for reporting systematic reviews: development of the PRISMA 2020 statement
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., & Moher, D. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.02.003 · Cited by 3,490
An overview of clinical decision support systems: Benefits, risks, and strategies for success
Sutton, R. T., Pincock, D., Baumgart, D. C., Sadowski, D. C., Fedorak, R. N., & Kroeker, K. I. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0221-y · Cited by 3,019
Greenhalgh, T., Wherton, J., Papoutsi, C., Lynch, J., Hughes, G., A'Court, C., Hinder, S., Fahy, N., Procter, R., & Shaw, S. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.8775 · Cited by 2,887
Kawamoto, K., Houlihan, C. A., Balas, E. A., & Lobach, D. F. (2005) · BMJ · doi:10.1136/bmj.38398.500764.8f · Cited by 2,703
Dwivedi, Y. K., Rana, N. P., Jeyaraj, A., Clement, M., & Williams, M. D. (2019) · Information Systems Frontiers · doi:10.1007/s10796-017-9774-y · Cited by 2,137
Artificial intelligence in healthcare: transforming the practice of medicine
Bajwa, J., Munir, U., Nori, A., & Williams, B. (2021) · Future Healthcare Journal · doi:10.7861/fhj.2021-0095 · Cited by 1,856
Chao, C.-M. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.01652 · Cited by 1,041
Ross, J., Stevenson, F., Lau, R., & Murray, E. (2016) · Implementation Science · doi:10.1186/s13012-016-0510-7 · Cited by 1,011
Sun, T. Q., & Medaglia, R. (2019) · Government Information Quarterly · doi:10.1016/j.giq.2018.09.008 · Cited by 948
with the HITEC Investigators, Ancker, J. S., Edwards, A., Nosal, S., Hauser, D., Mauer, E., & Kaushal, R. (2017) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-017-0430-8 · Cited by 709
Lebovitz, S., Lifshitz-Assaf, H., & Levina, N. (2022) · Organization Science · doi:10.1287/orsc.2021.1549 · Cited by 632
Antoniadi, A. M., Du, Y., Guendouz, Y., Wei, L., Mazo, C., Becker, B. A., & Mooney, C. (2021) · Applied Sciences · doi:10.3390/app11115088 · Cited by 629
Bias in artificial intelligence algorithms and recommendations for mitigation
Nazer, L. H., Zatarah, R., Waldrip, S., Ke, J. X. C., Moukheiber, M., Khanna, A. K., Hicklen, R. S., Moukheiber, L., Moukheiber, D., Ma, H., et al. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000278 · Cited by 621
Beede, E., Baylor, E., Hersch, F., Iurchenko, A., Wilcox, L., Ruamviboonsuk, P., & Vardoulakis, L. M. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376718 · Cited by 614
Petersson, L., Larsson, I., Nygren, J. M., Nilsen, P., Neher, M., Reed, J. E., Tyskbo, D., & Svedberg, P. (2022) · BMC Health Services Research · doi:10.1186/s12913-022-08215-8 · Cited by 434
Fan, W., Liu, J., Zhu, S., & Pardalos, P. M. (2020) · Annals of Operations Research · doi:10.1007/s10479-018-2818-y · Cited by 346
Strohm, L., Hehakaya, C., Ranschaert, E. R., Boon, W. P. C., & Moors, E. H. M. (2020) · European Radiology · doi:10.1007/s00330-020-06946-y · Cited by 329
Čartolovni, A., Tomičić, A., & Lazić Mosler, E. (2022) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2022.104738 · Cited by 267
Dwivedi, Y. K., Rana, N. P., Tamilmani, K., & Raman, R. (2020) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2020.03.008 · Cited by 266
Amann, J., Vetter, D., Blomberg, S. N., Christensen, H. C., Coffee, M., Gerke, S., Gilbert, T. K., Hagendorff, T., Holm, S., Livne, M., et al. (2022) · PLOS Digital Health · doi:10.1371/journal.pdig.0000016 · Cited by 251
Primer on an ethics of AI-based decision support systems in the clinic
Braun, M., Hummel, P., Beck, S., & Dabrock, P. (2021) · Journal of Medical Ethics · doi:10.1136/medethics-2019-105860 · Cited by 238
Randomized Clinical Trials of Machine Learning Interventions in Health Care: A Systematic Review
Plana, D., Shung, D. L., Grimshaw, A. A., Saraf, A., Sung, J. J. Y., & Kann, B. H. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2022.33946 · Cited by 236
Henry, K. E., Kornfield, R., Sridharan, A., Linton, R. C., Groh, C., Wang, T., Wu, A., Mutlu, B., & Saria, S. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00597-7 · Cited by 207
Artificial intelligence: opportunities and implications for the health workforce
Hazarika, I. (2020) · International Health · doi:10.1093/inthealth/ihaa007 · Cited by 203
A Path for Translation of Machine Learning Products into Healthcare Delivery
(2020) · EMJ Innovations · doi:10.33590/emjinnov/19-00172 · Cited by 172
Integrating a Machine Learning System Into Clinical Workflows: Qualitative Study
Sandhu, S., Lin, A. L., Brajer, N., Sperling, J., Ratliff, W., Bedoya, A. D., Balu, S., O'Brien, C., & Sendak, M. P. (2020) · Journal of Medical Internet Research · doi:10.2196/22421 · Cited by 168
d’Elia, A., Gabbay, M., Rodgers, S., Kierans, C., Jones, E., Durrani, I., Thomas, A., & Frith, L. (2022) · Family Medicine and Community Health · doi:10.1136/fmch-2022-001670 · Cited by 166
Hogg, H. D. J., Al-Zubaidy, M., Technology Enhanced Macular Services Study Reference Group, Talks, J., Denniston, A. K., Kelly, C. J., Malawana, J., Papoutsi, C., Teare, M. D., Keane, P. A., et al. (2023) · Journal of Medical Internet Research · doi:10.2196/39742 · Cited by 163
Ginestra, J. C., Giannini, H. M., Schweickert, W. D., Meadows, L., Lynch, M. J., Pavan, K., Chivers, C. J., Draugelis, M., Donnelly, P. J., Fuchs, B. D., et al. (2019) · Critical Care Medicine · doi:10.1097/ccm.0000000000003803 · Cited by 159
Implementing AI in healthcare—the relevance of trust: a scoping review
Steerling, E., Siira, E., Nilsén, P., Svedberg, P., & Nygren, J. (2023) · Frontiers in Health Services · doi:10.3389/frhs.2023.1211150 · Cited by 159
Shinners, L., Aggar, C., Grace, S., & Smith, S. (2020) · Health Informatics Journal · doi:10.1177/1460458219874641 · Cited by 148
Romero-Brufau, S., Wyatt, K. D., Boyum, P., Mickelson, M., Moore, M., & Cognetta-Rieke, C. (2020) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2019.104072 · Cited by 143
PRISMA AI reporting guidelines for systematic reviews and meta-analyses on AI in healthcare
Cacciamani, G. E., Chu, T. N., Sanford, D. I., Abreu, A., Duddalwar, V., Oberai, A., Kuo, C.-C. J., Liu, X., Denniston, A. K., Vasey, B., et al. (2023) · Nature Medicine · doi:10.1038/s41591-022-02139-w · Cited by 143
Three Problems with Big Data and Artificial Intelligence in Medicine
Chin-Yee, B. H., & Upshur, R. E. G. (2019) · Perspectives in biology and medicine · doi:10.1353/pbm.2019.0012 · Cited by 133
Upadhyay, S., & Hu, H.-F. (2022) · Health Services Insights · doi:10.1177/11786329211070722 · Cited by 111
Wu, C., Xu, H., Bai, D., Chen, X., Gao, J., & Jiang, X. (2023) · BMJ Open · doi:10.1136/bmjopen-2022-066322 · Cited by 102
Attitudes Toward Artificial Intelligence Among Radiologists, IT Specialists, and Industry
Jungmann, F., Jorg, T., Hähn, F., dos Santos, D. P., Jungmann, S. M., Düber, C., Mildenberger, P., & Kloeckner, R. (2020) · Academic Radiology · doi:10.1016/j.acra.2020.04.011 · Cited by 98
Explainability in medicine in an era of AI-based clinical decision support systems
Pierce, R. L., Van Biesen, W., Van Cauwenberge, D., Decruyenaere, J., & Sterckx, S. (2022) · Frontiers in Genetics · doi:10.3389/fgene.2022.903600 · Cited by 95
Frymoyer, A. R., Schwenk, H. T., Zorn, Y., Bio, L. L., Moss, J. D., Chasmawala, B., Faulkenberry, J., Goswami, S., Keizer, R. J., & Ghaskari, S. (2020) · Frontiers in Pharmacology · doi:10.3389/fphar.2020.00551 · Cited by 93
Barriers and facilitators perceived by physicians when using prediction models in practice
Kappen, T. H., van Loon, K., Kappen, M. A. M., van Wolfswinkel, L., Vergouwe, Y., van Klei, W. A., Moons, K. G. M., & Kalkman, C. J. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.09.008 · Cited by 87
Choudhury, A., Asan, O., & Medow, J. E. (2022) · Applied Ergonomics · doi:10.1016/j.apergo.2022.103708 · Cited by 86
Tackling bias in AI health datasets through the STANDING TOGETHER initiative
Ganapathi, S., Palmer, J., Alderman, J. E., Calvert, M., Espinoza, C., Gath, J., Ghassemi, M., Heller, K., Mckay, F., Karthikesalingam, A., et al. (2022) · Nature Medicine · doi:10.1038/s41591-022-01987-w · Cited by 82
Sbaffi, L., Walton, J., Blenkinsopp, J., & Walton, G. (2020) · Journal of Medical Internet Research · doi:10.2196/19126 · Cited by 76
Van Dort, B. A., Zheng, W. Y., Sundar, V., & Baysari, M. T. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa279 · Cited by 75
Nehme, F., Coronel, E. S., Barringer, D. A., Romero, L. G., Shafi, M. A., Ross, W. A., & Ge, P. S. (2023) · Gastrointestinal Endoscopy · doi:10.1016/j.gie.2023.02.016 · Cited by 75
Chen, W., O’Bryan, C. M., Gorham, G., Howard, K., Balasubramanya, B., Coffey, P., Abeyaratne, A., & Cass, A. (2022) · Implementation Science Communications · doi:10.1186/s43058-022-00326-x · Cited by 73
Zhang, J., Whebell, S. F., Gallifant, J., Budhdeo, S., Mattie, H., Lertvittayakumjorn, P., Lopez, M. D. P. A., Tiangco, B. J., Gichoya, J. W., Ashrafian, H., et al. (2022) · The Lancet Digital Health · doi:10.1016/s2589-7500(22)00032-2 · Cited by 64
Implementation of an Artificial Intelligence Algorithm for sepsis detection
Gonçalves, L. S., Amaro, M. L. D. M., Romero, A. D. L. M., Schamne, F. K., Fressatto, J. L., & Bezerra, C. W. (2020) · Revista Brasileira de Enfermagem · doi:10.1590/0034-7167-2018-0421 · Cited by 63
Miller, D. D. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0138-5 · Cited by 62
Jauk, S., Kramer, D., Avian, A., Berghold, A., Leodolter, W., & Schulz, S. (2021) · Journal of Medical Systems · doi:10.1007/s10916-021-01727-6 · Cited by 59
Twelve years' experience of computer-aided diagnosis in a district general hospital.
McADAM, W. A. F., Brock, B. M., Armitage, T. G., Davenport, P., Chan, M., & de Dombal, F. T. (1990) · PubMed Central · Cited by 53
Joshi, M., Mecklai, K., Rozenblum, R., & Samal, L. (2022) · JAMIA Open · doi:10.1093/jamiaopen/ooac022 · Cited by 46
Marwaha, A., Chitayat, D. A., Meyn, M. S., Mendoza‐Londono, R., & Chad, L. (2021) · American Journal of Medical Genetics Part A · doi:10.1002/ajmg.a.62092 · Cited by 45
Jordan, M., Hauser, J., Cota, S., Li, H., & Wolf, L. (2023) · Journal of Transcultural Nursing · doi:10.1177/10436596221129226 · Cited by 37
Singer, S. J., Kellogg, K. C., Galper, A. B., & Viola, D. (2021) · Health Care Management Review · doi:10.1097/hmr.0000000000000324 · Cited by 32
Shiang, T., Garwood, E., & Debenedectis, C. M. (2022) · Clinical Imaging · doi:10.1016/j.clinimag.2022.09.003 · Cited by 25
Henkel, M., Horn, T., Leboutte, F., Trotsenko, P., Dugas, S. G., Sutter, S. U., Ficht, G., Engesser, C., Matthias, M., Stalder, A., et al. (2022) · PLOS ONE · doi:10.1371/journal.pone.0271183 · Cited by 24
Cruz Noa, P., Lea, C., García, M. J., Bernardino, P., & Ignacio, A. (2019) · Studies in Health Technology and Informatics · doi:10.3233/shti190285 · Cited by 19
Saunders, S., Downar, J., Subramaniam, S., Embuldeniya, G., van Walraven, C., & Wegier, P. (2021) · BMJ Quality & Safety · doi:10.1136/bmjqs-2020-012461 · Cited by 18
External Validation of a Machine Learning Based Delirium Prediction Software in Clinical Routine
Jauk, S., Veeranki, S. P. K., Kramer, D., Högler, S., Mühlecker, D., Eberhartl, E., Schueler, A., Chvosta, C., Straßer, W., Strasser, R., et al. (2022) · Studies in health technology and informatics · doi:10.3233/shti220353 · Cited by 13
Rabinovich, D., Mosquera, C., Torrens, P., Aineseder, M., & Benítez, S. (2022) · Studies in health technology and informatics · doi:10.3233/shti220386 · Cited by 12
Wang, S. M., Hogg, H. D. J., Sangvai, D. G., Patel, M. R., Weissler, E. H., Kellogg, K. C., Ratliff, W., Balu, S., & Sendak, M. (2023) · JMIR Formative Research · doi:10.2196/43963 · Cited by 11
Government pins hopes on £250m AI centre for faster diagnosis and treatment
O’Dowd, A. (2019) · BMJ · doi:10.1136/bmj.l5106 · Cited by 9
Research works printed but not linked: 1
- McAdam, WA, 1990, Ann R Coll Surg Engl, 72, 140
Cited by
Osonuga, A., Osonuga, A. A., Fidelis, S. C., Osonuga, G. C., Juckes, J., & Olawade, D. B. (2025) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2025.106051 · Cited by 110
Scipion, C. E. A., Manchester, M., Federman, A. D., Wang, Y., & Arias, J. J. (2025) · BMJ Open · doi:10.1136/bmjopen-2024-092624 · Cited by 101
“This scoping review systematically examines patterns in the barriers to and facilitators of clinician acceptance and use of AI in healthcare, categorising these factors by both the type of AI healthcare applications and the income levels of the countries where the reviewed studies were conducted.”
Artificial intelligence tool development: what clinicians need to know?
Chew, B.-H., & Ngiam, K. Y. (2025) · BMC Medicine · doi:10.1186/s12916-025-04076-0 · Cited by 41
“Clinicians who are more than aware of the full cycle of AI tools development delineated in this paper could facilitate the development, reporting, assessment and smoother transitions from bench to bedside of these tools [96, 97].”
Salimparsa, M., Sedig, K., Lizotte, D. J., Abdullah, S. S., Chalabianloo, N., & Muanda, F. T. (2025) · Informatics · doi:10.3390/informatics12040119 · Cited by 39
“The ‘black-box’ nature of many AI systems remains a significant hurdle, limiting transparency and hindering trust among clinicians who require understandable justifications for AI-driven recommendations, especially in high-stakes decisions [51].”
InfluentialEthical and practical challenges of generative AI in healthcare and proposed solutions: a survey
Tung, T., Hasnaeen, S. M. N., & Zhao, X. (2025) · Frontiers in Digital Health · doi:10.3389/fdgth.2025.1692517 · Cited by 40
Metadata
- Authors
- Ayorinde, A., Mensah, D. O., Walsh, J., Ghosh, I., Ibrahim, S. A., Hogg, J., Peek, N., & Griffiths, F.
- Affiliations
- University of Warwick (GB)
- University of Cambridge (GB)
- Corresponding author
- Ayorinde, Abimbola
- ORCID
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2024-10-30
- Volume
- 26
- Pages
- e55766
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC11561443
- OpenAlex
- W4400984022
- Cited by
- 55
- References
- 69
- Citations by year
- 2026: 33 · 2025: 22
- FWCI
- 1.24
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- University of Birmingham Research Portal (University of Birmingham) (publishedVersion, cc-by)
- Warwick Research Archive Portal (University of Warwick) (acceptedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Institute for Health and Care Research (NIHR200174, NIHR301467, NIHR200165)
- Department of Health and Social Care
- University of Warwick
- Warwick Medical School
- National Institute for Health Research Applied Research Collaboration West (NIHR 200165)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- artificial intelligence in clinical decision support, health professionals' experiences, trust in AI, clinical decision-making, artificial intelligence adoption, AI governance, explainable AI, human-AI collaboration, AI implementation, time constraints in clinical practice
- MeSH terms
- Clinical Decision-Making, Artificial Intelligence, Health Personnel, Humans, Decision Support Systems, Clinical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

