Randomized Controlled Trials of Artificial Intelligence in Clinical Practice: Systematic Review
Open accessThe DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index; 14 of the 22 sources its claims cite were checked for support.
Abstract
BACKGROUND: The number of artificial intelligence (AI) studies in medicine has exponentially increased recently. However, there is no clear quantification of the clinical benefits of implementing AI-assisted tools in patient care. OBJECTIVE: This study aims to systematically review all published randomized controlled trials (RCTs) of AI-assisted tools to characterize their performance in clinical practice. METHODS: CINAHL, Cochrane Central, Embase, MEDLINE, and PubMed were searched to identify relevant RCTs published up to July 2021 and comparing the performance of AI-assisted tools with conventional clinical management without AI assistance. We evaluated the primary end points of each study to determine their clinical relevance. This systematic review was conducted following the updated PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) 2020 guidelines. RESULTS: Among the 11,839 articles retrieved, only 39 (0.33%) RCTs were included. These RCTs were conducted in an approximately equal distribution from North America, Europe, and Asia. AI-assisted tools were implemented in 13 different clinical specialties. Most RCTs were published in the field of gastroenterology, with 15 studies on AI-assisted endoscopy. Most RCTs studied biosignal-based AI-assisted tools, and a minority of RCTs studied AI-assisted tools drawn from clinical data. In 77% (30/39) of the RCTs, AI-assisted interventions outperformed usual clinical care, and clinically relevant outcomes improved with AI-assisted intervention in 70% (21/30) of the studies. Small sample size and single-center design limited the generalizability of these studies. CONCLUSIONS: There is growing evidence supporting the implementation of AI-assisted tools in daily clinical practice; however, the number of available RCTs is limited and heterogeneous. More RCTs of AI-assisted tools integrated into clinical practice are needed to advance the role of AI in medicine. TRIAL REGISTRATION: PROSPERO CRD42021286539; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=286539.
Overview
CoChat Summary
TL;DR
This systematic review identified only 39 RCTs (0.33% of 11,839 retrieved articles) of AI-assisted tools in clinical practice up to July 2021. Most (77%, 30/39) reported AI-assisted interventions outperforming usual care, but the evidence base was limited and heterogeneous.
Key findings
- Among 11,839 articles retrieved, only 39 (0.33%) RCTs were included; 77% (30/39) reported positive outcomes for AI-assisted interventions, and clinically relevant outcomes improved in 70% (21/30) of those positive studies.
- Gastroenterology dominated the field: 16/39 (41%) RCTs were related to gastroenterology, with 15 studies on AI-assisted endoscopy; biosignal-based AI tools were more common than clinical data–based tools, and endoscopic images were the most common biosignal (15/26, 58%).
- Risk of bias was low in 20% (8/39), some concerns in 31% (12/39), and high in 49% (19/39); missing outcome data and outcome measurement were the most common risk factors.
- Common study limitations were single-center design (22/39, 56%) and small sample size (n<1000; 33/39, 85%); 15/39 (38%) were open-label, and 7 studies were underpowered.
Methods
- Systematic review following PRISMA 2020 guidelines; searched CINAHL, Cochrane Central, Embase, MEDLINE, and PubMed from inception to July 14, 2021, for RCTs comparing AI-assisted tools with conventional clinical management without AI assistance; registered on PROSPERO (CRD42021286539).
- Two authors independently screened articles and extracted data, with disagreements resolved by consensus or senior author consultation; risk of bias was assessed using the Cochrane risk-of-bias tool for randomized trials (RoB 2), and primary end points were evaluated for clinical relevance.
Limitations
- Paper-stated: small sample size and single-center design limited generalizability; the number of available RCTs was limited and heterogeneous; among included studies, common author-listed limitations were single-center design (22/39, 56%) and small sample size (n<1000; 33/39, 85%), with open-label design (15/39, 38%) and 7 underpowered studies; 49% had high risk of bias.
- Evident from the text: the search ended July 2021, so later RCTs are not captured; 18% (7/39) were conference abstracts only; no meta-analysis or pooled effect estimates were reported.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
11 Valid · 1 Not valid · 5 Not checked · 99 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“The adenoma detection algorithm appears to be easier for cross-compatibility because of the distinct difference in appearance between adenoma (or polyp) and normal mucosa [56].”
§ Randomized Controlled Trials of Artificial Intelligence in Clinical Practice: Systematic Review > Discussion > Principal Findings
What the sources say
- Supportedcites [56] source
The section “Pitfall No. 4: Cross-compatibility and external validation” says colon polyp detection appears easier to make cross-compatible because the visual differences between a polyp and normal colonic mucosa are distinct. This supports the citing sentence’s paraphrase. (LLM, conf=0.94)
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Another obstacle to the implementation of AI or ML in daily clinical practice is the regulation of these technologies [8].”
§ Randomized Controlled Trials of Artificial Intelligence in Clinical Practice: Systematic Review > Discussion > Conclusions and Recommendations
What the sources say
- Supportedcites [8] source
The Introduction identifies regulation as a crucial element shaping obstacles to implementing AI/ML in daily clinical practice. The Discussion likewise attributes challenges in adopting these technologies in medical practice partly to regulatory frameworks. (LLM, conf=0.95)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“there have been well-designed studies where more “complex” ML approaches have outperformed regression-derived clinical risk scores on external validation [7,59,60].”
§ Randomized Controlled Trials of Artificial Intelligence in Clinical Practice: Systematic Review > Discussion > Principal Findings
What the sources say
- Supportedcites [7] source
The Methods (Study Design) identify the final model as XGBoost, a gradient-boosted decision-tree algorithm. The Results (Performance of the ML Model, External Validation) report that it outperformed all three clinical risk scores on the composite endpoint. The Strengths section describes a large, prospective, multicenter cohort with external validation. (LLM, conf=0.92)
- Supportedcites [59] source
The Results > External Validation section reports that the support-vector-machine risk calculator, trained on MESA and tested on the external FLEMENGHO cohort, outperformed the ACC/AHA calculator in sensitivity, specificity, and accuracy. The Methods > External Validation section describes the separate validation cohort. Page numbers are not available in our copy. (LLM, conf=0.93)
- Partly supportedcites [60] sourceExperimental — accuracy not yet measured
The Abstract reports validation of a naïve Bayes sepsis model, and Overall model performance reports that it identified more additional cases than the triage-nurse process. That process was not a regression-derived clinical risk score. Practical observations during model development also identifies single-center validation as a limitation, so this paper does not establish the claimed outperformance of regression-derived scores on external validation. (LLM, conf=0.86)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Most RCTs were published in the field of gastroenterology, with 15 studies on AI-assisted endoscopy.”
§ Randomized Controlled Trials of Artificial Intelligence in Clinical Practice: Systematic Review > Abstract > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Most RCTs were published in the field of gastroenterology, with 15 studies on AI-assisted endoscopy.”
§ Randomized Controlled Trials of Artificial Intelligence in Clinical Practice: Systematic Review > Abstract > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
59 more claims
Create a free account to see all 116 claims and every source verdict.
- Probably not a substantial claim. 38
- It may state two separate claims as one. 18
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
“PPx—AI: 17% (54/224) versus control: 8% (26/318)”
§ Randomized Controlled Trials of Artificial Intelligence in Clinical Practice: Systematic Review > Results > Study Outcomes
Reported 17 · recomputed 24.107143
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
“A total of 147 full manuscripts were individually assessed, of which 34 (23.1%) met the inclusion criteria. In addition, 4 more articles were identified by examining the references of the listed articles and manual searches (Figure 1). A total of 39 articles were included in this systematic review [6,17-54] as listed in Table 1.”
§ Randomized Controlled Trials of Artificial Intelligence in Clinical Practice: Systematic Review > Results > Overview
Reported 39 · recomputed 38
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Randomized Controlled Trials of Artificial Intelligence in Clinical Practice: Systematic Review > Results > Study Outcomes
“ENDOANGEL was an effective and robust system to improve the quality of EGD and has the potential to detect electrocardiogram in real time”
§ Randomized Controlled Trials of Artificial Intelligence in Clinical Practice: Systematic Review > Results > Study End Points
“To verify the effectiveness of ENDOANGEL in improving endoscopy quality and pretest its performance in detecting EGCae in a multicenter randomized controlled trial”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Randomized Controlled Trials of Artificial Intelligence in Clinical Practice: Systematic Review > Results > Study Outcomes
“El Solh et al [17], 2019”
§ Randomized Controlled Trials of Artificial Intelligence in Clinical Practice: Systematic Review > Results > Overview
“El Solh et al [17], 2009”
Citations
Cites
The PRISMA 2020 statement: An updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n71 · Cited by 108,283
RoB 2: a revised tool for assessing risk of bias in randomised trials
Sterne, J. A. C., Savović, J., Page, M. J., Elbers, R. G., Blencowe, N. S., Boutron, I., Cates, C. J., Cheng, H.-Y., Corbett, M. S., Eldridge, S. M., et al. (2019) · BMJ · doi:10.1136/bmj.l4898 · Cited by 34,787 · cited 1×
“Risk of bias was assessed using the Cochrane risk-of-bias tool for randomized trials [16].”
The PRISMA 2020 statement: an updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J., Bossuyt, P., Boutron, I., Hoffmann, T., mulrow, C., Shamseer, L., Tetzlaff, J., Akl, E., Brennan, S. E., et al. (2020) · doi:10.31222/osf.io/v7gm2 · Cited by 5,177
A Proposal for the Dartmouth Summer Research Project on Artificial Intelligence, August 31, 1955
McCarthy, J., Minsky, M., Rochester, N., et al. (2006) · The AI Magazine · doi:10.1609/aimag.v27i4.1904 · Cited by 2,029 · cited 1×
“Artificial intelligence (AI) was first described in the 1950s as a theory of human intelligence being exhibited by machines, including but not limited to learning, reasoning, and problem-solving [1].”
Benjamens, S., Dhunnoo, P., & Meskó, B. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-00324-0 · Cited by 1,215
Wang, P., Berzin, T. M., Glissen Brown, J. R., Bharadwaj, S., Becq, A., Xiao, X., Liu, P., Li, L., Song, Y., Zhang, D., et al. (2019) · Gut · doi:10.1136/gutjnl-2018-317500 · Cited by 865 · cited 1×
“Real-time automatic detection system increases colonoscopic polyp and adenoma detection rates: a prospective randomised controlled study Wang et al [28], 2019”
Trends in Chronic Kidney Disease in China
Zhang, L., Long, J., Jiang, W., Shi, Y., He, X., Zhou, Z., Li, Y., Yeung, R. O., Wang, J., Matsushita, K., et al. (2016) · New England Journal of Medicine · doi:10.1056/nejmc1602469 · Cited by 765 · cited 1×
“Another obstacle to the implementation of AI or ML in daily clinical practice is the regulation of these technologies [8].”
Brown, J. M., Campbell, J. P., Beers, A., Chang, K., Ostmo, S., Chan, R. V. P., Dy, J., Erdogmus, D., Ioannidis, S., Kalpathy-Cramer, J., et al. (2018) · JAMA Ophthalmology · doi:10.1001/jamaophthalmol.2018.1934 · Cited by 657
Efficacy of real-time computer-aided detection of colorectal neoplasia in a randomized trial
Repici, A., Badalamenti, M., Maselli, R., Correale, L., Radaelli, F., Rondonotti, E., Ferrara, E., Spadaccini, M., Alkandari, A., Fugazza, A., et al. (2020) · Gastroenterology · doi:10.1053/j.gastro.2020.04.062 · Cited by 646 · cited 2×
“Original article Italy Efficacy of real-time computer-aided detection of colorectal neoplasia in a randomized trial Repici et al [38], 2020”
Wijnberge, M., Geerts, B. F., Hol, L., Lemmers, N., Mulder, M. P., Berge, P., Schenk, J., Terwindt, L. E., Hollmann, M. W., Vlaar, A. P., et al. (2020) · JAMA · doi:10.1001/jama.2020.0592 · Cited by 586 · cited 2×
“…care on depth and duration of intraoperative hypotension during elective noncardiac surgery: the HYPE randomized clinical trial Wijnberge et al [42], 2020 Neurology Abstract Israel Artificial intelligence-powered non-invasive and frequency-tuned electromagnetic field therapy improves upper…”
Research works printed but not linked: 1
- Pouska, J, 2019, Intensive Care Med Exp, 7, 001525
Cited by
Han, R., Acosta, J. N., Shakeri, Z., Ioannidis, J. P. A., Topol, E. J., & Rajpurkar, P. (2024) · The Lancet Digital Health · doi:10.1016/s2589-7500(24)00047-5 · Cited by 336
Deisenhofer, I., Albenque, J.-P., Busch, S., Gitenay, E., Mountantonakis, S., Roux, A., Horvilleur, J., Bakouboula, B., Oza, S. R., Abbey, S., et al. (2025) · Nature Medicine · doi:10.1038/s41591-025-03517-w · Cited by 162
El Arab, R. A., Abu-Mahfouz, M. S., Abuadas, F. H., Alzghoul, H., Almari, M., Ghannam, A., & Seweid, M. M. (2025) · Healthcare · doi:10.3390/healthcare13070701 · Cited by 108
Artificial intelligence in digital pathology — time for a reality check
Aggarwal, A., Bharadwaj, S., Corredor, G., Pathak, T. B., Badve, S., & Madabhushi, A. (2025) · Nature Reviews Clinical Oncology · doi:10.1038/s41571-025-00991-6 · Cited by 96
“Despite the increasing efforts to incorporate AI into digital pathology, especially within prospective clinical trials, these initiatives remain limited in both scope and number 103 .”
Singareddy, S., SN, V. P., Jaramillo, A. P., Yasir, M., Iyer, N., Hussein, S., & Nath, T. S. (2023) · Cureus · doi:10.7759/cureus.46066 · Cited by 57
Martindale, A. P. L., Llewellyn, C. D., de Visser, R. O., Ng, B., Ngai, V., Kale, A. U., di Ruffano, L. F., Golub, R. M., Collins, G. S., Moher, D., et al. (2024) · Nature Communications · doi:10.1038/s41467-024-45355-3 · Cited by 58
Prinster, D., Mahmood, A., Saria, S., Jeudy, J. J., Lin, C. T., Yi, P. H., & Huang, C. (2024) · Radiology · doi:10.1148/radiol.233261 · Cited by 80
Transforming sepsis management: AI-driven innovations in early detection and tailored therapies
Papareddy, P., Lobo, T. J., Holub, M., Bouma, H., Maca, J., Strodthoff, N., & Herwald, H. (2025) · Critical Care · doi:10.1186/s13054-025-05588-0 · Cited by 49
Enhancing randomized clinical trials with digital twins
Akbarialiabad, H., Pasdar, A., Murrell, D. F., Mostafavi, M., Shakil, F., Safaee, E., Leachman, S. A., Haghighi, A., Tarbox, M. B., Bunick, C. G., et al. (2025) · npj Systems Biology and Applications · doi:10.1038/s41540-025-00592-0 · Cited by 71
Henzler, D., Schmidt, S., Koçar, A., Herdegen, S., Lindinger, G. L., Maris, M. T., Bak, M. A. R., Willems, D. L., Tan, H. L., Lauerer, M., et al. (2025) · BMC Health Services Research · doi:10.1186/s12913-025-12664-2 · Cited by 54
Prognostic potentials of AI in ophthalmology: systemic disease forecasting via retinal imaging
Tan, Y. Y., Kang, H. G., Lee, C. J., Kim, S. S., Park, S., Thakur, S., Soh, Z. D., Cho, Y., Peng, Q., Lee, K., et al. (2024) · Eye and Vision · doi:10.1186/s40662-024-00384-3 · Cited by 66
Artificial Intelligence in Atrial Fibrillation: From Early Detection to Precision Therapy
Karakasis, P., Theofilis, P., Sagris, Μ., Pamporis, K., Stachteas, P., Sidiropoulos, G., Vlachakis, P. K., Patoulias, D., Antoniadis, A. P., & Fragakis, N. (2025) · Journal of Clinical Medicine · doi:10.3390/jcm14082627 · Cited by 61
“…advancements, the direct application of AI-driven software in therapeutic decision making and procedural AI and machine learning have emerged as transformative tools in modern cardiology, offering unprecedented capabilities in diagnosing and managing AF (Figure 1) [10]. potential innovation [8,9].”
Boverhof, B.-J., Redekop, K., Bos, D., Starmans, M. P. A., Birch, J. V., Rockall, A., & Visser, J. J. (2024) · Insights into Imaging · doi:10.1186/s13244-023-01599-z · Cited by 57
Morone, G., De Angelis, L., Martino Cinnera, A., Carbonetti, R., Bisirri, A., Ciancarelli, I., Iosa, M., Negrini, S., Kiekens, C., & Negrini, F. (2025) · Frontiers in Digital Health · doi:10.3389/fdgth.2025.1550731 · Cited by 41
Ethical Considerations in the Design and Conduct of Clinical Trials of Artificial Intelligence
Youssef, A., Nichol, A. A., Martinez‐Martin, N., Larson, D. B., Abràmoff, M. D., Wolf, R. M., & Char, D. S. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.32482 · Cited by 56
Artificial intelligence in medicine: Ethical, social and legal perspectives
Sung, J. J. �. (2023) · Annals of the Academy of Medicine Singapore · doi:10.47102/annals-acadmedsg.2023103 · Cited by 40
Self-citationKhan, S. D., Hoodbhoy, Z., Raja, M. H. R., Kim, J. Y., Hogg, H. D. J., Manji, A. A. A., Gulamali, F., Hasan, A., Shaikh, A., Tajuddin, S., et al. (2024) · PLOS Digital Health · doi:10.1371/journal.pdig.0000514 · Cited by 36
Functional Foods in Clinical Trials and Future Research Directions
Hajzer, Z. E., Alibrahem, W., Helu, N. K., Oláh, C., & Prokisch, J. (2025) · Foods · doi:10.3390/foods14152675 · Cited by 52
Tao, B. K.-L., Hua, N. J., Milkovich, J., & Micieli, J. A. (2024) · Eye · doi:10.1038/s41433-024-03037-w · Cited by 38
“In clinical practice, growing evidence demonstrates instances of clinical benefit (e.g., AI-assisted interventions out-performing usual care) from AI-implementation, although the available trials are limited in number and heterogenous [28].”
Comprehensive AI assessment framework: Enhancing educational evaluation with ethical AI integration
Kılınç, S. (2024) · Journal of Educational Technology and Online Learning · doi:10.31681/jetol.1492695 · Cited by 66
Evaluating Large Language Models in Ophthalmology: Systematic Review
Zhang, Z., Zhang, H., Pan, Z., Bi, Z., Wan, Y., Song, X., & Fan, X. (2025) · Journal of Medical Internet Research · doi:10.2196/76947 · Cited by 48
Kareemi, H., Yadav, K., Price, C. M., Bobrovitz, N., Meehan, A., Li, H., Goel, G., Masood, S., Grant, L., Ben‐Yakov, M., et al. (2025) · Academic Emergency Medicine · doi:10.1111/acem.15099 · Cited by 33
“9,10 Concerningly, one of these reviews found an increasing number of AI-CDS tools had achieved FDA approval without a randomized trial to show efficacy or potential generalizability.”
The Promises and Perils of Foundation Models in Dermatology
Gui, H., Omiye, J. A., Chang, C. T., & Daneshjou, R. (2024) · Journal of Investigative Dermatology · doi:10.1016/j.jid.2023.12.019 · Cited by 29
Giebel, G. D., Raszke, P., Nowak, H., Palmowski, L., Adamzik, M., Heinz, P., Tokic, M. C., Timmesfeld, N., Brunkhorst, F. M., Wasem, J., et al. (2025) · JMIR Medical Informatics · doi:10.2196/69688 · Cited by 39
Zeltzer, D., Kugler, Z., Hayat, L., Brufman, T., Ber, R. I., Leibovich, K., Beer, T., Frank, I., Shaul, R., Goldzweig, C. L., et al. (2025) · Annals of Internal Medicine · doi:10.7326/annals-24-03283 · Cited by 37
MacKay, C., Klement, W., Vanberkel, P. T., Lamond, N. W. D., Urquhart, R., & Rigby, M. H. (2023) · Healthcare Analytics · doi:10.1016/j.health.2023.100155 · Cited by 27
Adeoye, J., & Su, Y. (2023) · International Journal of Surgery · doi:10.1097/js9.0000000000000979 · Cited by 24
Arshi, B., Cowley, L., Rijnhart, E., Reeve, K. A., Smits, L. J. M., & Wynants, L. (2025) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2025.111902 · Cited by 33
Chatting with artificial intelligence to combat antibiotic resistance: Opportunities and challenges
Abavisani, M., Khoshrou, A., Foroushan, S. K., & Sahebkar, A. (2024) · Current Research in Biotechnology · doi:10.1016/j.crbiot.2024.100197 · Cited by 23
Hirosawa, T., Suzuki, T., Shiraishi, T., Hayashi, A., Fujii, Y., Harada, T., & Shimizu, T. (2024) · International Journal of General Medicine · doi:10.2147/ijgm.s497753 · Cited by 26
Artificial intelligence in clinical trials of lung cancer: Current and future prospects
Zhang, Y., You, P., Liu, R., Lu, Y., Li, J., Lei, Y., Wu, S., & Zhou, H. (2024) · Intelligent Oncology · doi:10.1016/j.intonc.2024.11.003 · Cited by 19
Vázquez, B., Rojas-García, M., Rodríguez-Esquivel, J. I., Márquez-Acosta, J., Aranda-Flores, C. E., Cetina, L., Soto-López, S., Estévez, J. A., Bahena-Román, M., Madrid‐Marina, V., et al. (2025) · Diagnostics · doi:10.3390/diagnostics15121543 · Cited by 31
An in-depth review of AI-powered advancements in cancer drug discovery
Le, M. H. N., Nguyen, P. K., Nguyen, T. P. T., Nguyen, H. Q., Tam, D. N. H., Huynh, H. H., Huynh, P. K., & Le, N. Q. K. (2025) · Biochimica et Biophysica Acta (BBA) - Molecular Basis of Disease · doi:10.1016/j.bbadis.2025.167680 · Cited by 15
Randomized Controlled Trials Evaluating AI in Clinical Practice: A Scoping EvaluationPreprint
Han, R., Acosta, J., Shakeri, Z., Ioannidis, J. P. A., Topol, E. J., & Rajpurkar, P. (2023) · medRxiv · doi:10.1101/2023.09.12.23295381 · Cited by 14
“36–39 While such a high success rate lends credibility to the promise of clinical AI, this should be tempered by recognition of the nascency of the field and the likeliness of publication bias.”
BackgroundEditorial: Surfacing best practices for AI software development and integration in healthcare
Sendak, M., Vidal, D. E., Trujillo, S., Singh, K., Liu, X., & Balu, S. (2023) · Frontiers in Digital Health · doi:10.3389/fdgth.2023.1150875 · Cited by 16
Demonstrating Trustworthiness to Patients in Data‐Driven Health Care
Nong, P. (2023) · The Hastings Center Report · doi:10.1002/hast.1526 · Cited by 13
Sung, J. J. �., Savulescu, J., Ngiam, K. Y., An, B., Ang, T. L., Yeoh, K. G., Cham, T., Tsao, S. K. K., & Chua, T. (2023) · Journal of Gastroenterology and Hepatology · doi:10.1111/jgh.16241 · Cited by 14
Self-citationBark, D., Basu, J., Toumpanakis, D., Nyberg, J. B., Bjerner, T., Rostami, E., & Fällmar, D. (2024) · Neurotrauma Reports · doi:10.1089/neur.2024.0017 · Cited by 9
Broadening the HTA of medical AI: A review of the literature to inform a tailored approach
Boverhof, B.-J., Redekop, K., Visser, J. J., Groot, C. A. U., & Mölken, M. R. (2024) · Health Policy and Technology · doi:10.1016/j.hlpt.2024.100868 · Cited by 11
Rise of the machines: trends and challenges of implementing AI in biomedical scientific writing
Fornalik, M., Makuch, M., Lemanska, A., Moska, S., Wiczuk-Wiczewska, M., Anderko, I., Stochaj, L., Szczygieł, M. B., & Zielińska, A. (2024) · Exploration of Digital Health Technologies · doi:10.37349/edht.2024.00024 · Cited by 10
Overview of artificial intelligence in hand surgery
Ryhänen, J., Wong, G. C., Anttila, T., & Chung, K. C. (2025) · Journal of Hand Surgery (European Volume) · doi:10.1177/17531934251322723 · Cited by 10
“Large-scale randomized controlled trials are needed to compare the performance of the AI model with that of the most experienced specialists (Lam et al., 2022).”
Artificial Intelligence in U.S. Health Care Delivery
Chen, Y.-C., Chiang, H., & Kuo, C. (2023) · New England Journal of Medicine · doi:10.1056/nejmc2310288 · Cited by 7
Syed, M. A., Zainel, A. A., Alnuaimi, A. S., Veettil, S. T., & Syed, M. A. (2025) · BMJ Public Health · doi:10.1136/bmjph-2024-001969 · Cited by 10
“This encouraged a more open and unbiased discussion with HCPs and persons with diabetes.”
Regulating, implementing and evaluating AI in Singapore healthcare: AI governance roundtable’s view
Goh, W. W. B., Tan, C. H., Tan, C. M., Prahl, A., Lwin, M. O., & Sung, J. J. �. (2025) · Annals of the Academy of Medicine Singapore · doi:10.47102/annals-acadmedsg.202556 · Cited by 11
Self-citationCangelosi, G., Sacchini, F., Palomares, S. M., Sguanci, M. E., Biondini, F., Mancin, S., Amendola, A., Ferrara, G., Caggianelli, G., & Petrelli, F. (2025) · International Journal for Vitamin and Nutrition Research · doi:10.31083/ijvnr36342 · Cited by 9
Emerging role of artificial intelligence in gastroenterology and hepatology
Shrestha, U. K. (2025) · World Journal of Gastroenterology · doi:10.3748/wjg.v31.i39.111495 · Cited by 11
Kale, A. U., Hogg, H. D. J., Pearson, R. V., Glocker, B., Golder, S., Coombe, A., Waring, J. J., Liu, X., Moore, D., & Denniston, A. K. (2024) · JMIR Research Protocols · doi:10.2196/51614 · Cited by 8
AI-enhanced patient-centric clinical trial design
Gupta, Y., Srivastava, V. P., & Singh, R. K. (2025) · AIP conference proceedings · doi:10.1063/5.0247858 · Cited by 6
Ampong, J., Agyekum, S., Eisenbarth, W., Andoh, A. K. A., Duah, I. O., Amankwah, G., Agbeshie, G. K., Acquah, E. A., Afari, C., Assan, E., et al. (2025) · PLOS Digital Health · doi:10.1371/journal.pdig.0000904 · Cited by 6
“Current guidelines emphasize that regulatory approval for AI devices requires validation through multicenter randomized controlled trials using standardized methods to ensure reliability and clinical applicability [111].”
Chen, D. C., He, E., Pace, K., Chekay, M., & Raman, S. (2025) · The Oncologist · doi:10.1093/oncolo/oyaf112 · Cited by 6
Bejerano-Blázquez, I., & Familiar-Cabero, M. (2025) · Information · doi:10.3390/info16080684 · Cited by 9
Maru, S., Kuwatsuru, R., Matthias, M. D., & Simpson, R. J. (2025) · Journal of Medical Internet Research · doi:10.2196/60148 · Cited by 6
Zdziechowski, A., Gluba-Brzózka, A., Rysz, J., & Woldańska-Okońska, M. (2023) · International Journal of Molecular Sciences · doi:10.3390/ijms24098109 · Cited by 4
Framework for AI integration into the undergraduate medical curricula: a scoping review
Cheng, D., Chan, E. Y. S., Song, Y., Cui, A., Chang, A., & Wang, W. (2026) · BMC Medical Education · doi:10.1186/s12909-026-08620-1 · Cited by 4
“…reveals significant geographical concentration in AI medical education, with publications predominantly originating from North America and Europe, limited global consensus framework, and insufficient guidance for pedagogical implementation across diverse cultural and resource contexts [13, 14].”
Can artificial intelligence models provide reliable medical counselling to fertility patients?
Alcalay, I., Weissman, A., Herman, H. G., Tsafrir, A., Friedman, M., Weiner, E., Orvieto, R., Polyzos, N. P., Dahan, M. H., Polyakov, A., et al. (2025) · Reproductive BioMedicine Online · doi:10.1016/j.rbmo.2025.105237 · Cited by 5
Huang, P., Liu, Y., Li, N., Zhang, Q., Luo, Y., Zhang, Y., Zhou, Y., Mu, W., Yuan, M., Liu, Y., et al. (2025) · BMC Pulmonary Medicine · doi:10.1186/s12890-025-03899-0 · Cited by 4
Wang, X., Bampton, T. J., Dharmaprani, D., Mahajan, R., & Palmer, L. J. (2025) · BMJ Digital Health & AI · doi:10.1136/bmjdhai-2025-000154 · Cited by 4
Gudi, N., Raj, E. A., Jahn, B., Siebert, U., & Brand, A. M. (2024) · International Journal of Technology Assessment in Health Care · doi:10.1017/s026646232400045x · Cited by 5
Almunifi, A. (2025) · Open Access Surgery · doi:10.2147/oas.s482690 · Cited by 3
Generalisation and reliability of deep learning for digital pathology in a clinical setting
Pocevičiūtė, M. (2023) · Linköping studies in science and technology. Dissertations · doi:10.3384/9789180753005 · Cited by 6
“However, it is worth noting that this type of validation is more expensive, comprising the minority of validation trials for DL diagnostic tools in medicine [69, 104].”
BackgroundArtificial Intelligence in Cardiovascular Medicine: A Comprehensive Clinical ReviewPreprint
Ganipineni, V. D. P., Gutlapalli, S. D., Paramsothy, J., Okorie, I. J., Ugwendum, D. F., Farid, M., Fabián, D., Kailayanathan, T., Piccione, G., Idavalapati, A. S. K. K., et al. (2023) · Preprints.org · doi:10.20944/preprints202305.1061.v1 · Cited by 2
Innovations in Digital Health From a Global Perspective: Proceedings of PRC‐HI 2024
Feng, X., Sun, Y., Wu, Y., Wang, H., & Wu, Y. (2025) · Health care science · doi:10.1002/hcs2.128 · Cited by 2
“He provided examples from gastroenterology, including AI ‐ powered colonoscopy tools that improve detection rates for abnormalities and reduce colorectal cancer mortality [21].”
Guo, E., Sanguinetti, R. D., Boone, L., Deng, J., Shakil, H., & Gupta, M. (2025) · Brain and Spine · doi:10.1016/j.bas.2025.104271 · Cited by 3
“Prospective clinical trials comparing AI models with clinician performance can provide evidence of utility and build trust in AI tools (Lam et al., 2022).”
Kolasa, K., Baliga-Nicholson, K., Waśniewski, J., Laskowska, N., Milian, K., & Ciupek, D. (2025) · Health Policy · doi:10.1016/j.healthpol.2025.105379 · Cited by 4
Kaur, P., Chand, T., & Rani, S. (2025) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-025-10368-8 · Cited by 5
Kanapari, A., Lorenzoni, G., Ocagli, H., & Gregori, D. (2025) · Digital Health · doi:10.1177/20552076251393272 · Cited by 3
Li, Y., Li, Y., Zhang, W., & Li, J. (2026) · Worldviews on Evidence-Based Nursing · doi:10.1111/wvn.70117 · Cited by 3
Yuan, Y., Liu, B., Wei, X., Ye, L., & Feng, B. (2026) · BMC Health Services Research · doi:10.1186/s12913-026-14366-9 · Cited by 2
How to critically appraise and direct the trajectory of AI development and application in oncology
Fehrmann, R. S. N., van Kruchten, M., & de Vries, E. G. E. (2024) · ESMO Real World Data and Digital Oncology · doi:10.1016/j.esmorw.2024.100066 · Cited by 3
Rinne, S. T., Brunner, J., Hogan, T. P., Ferguson, J. M., Helmer, D. A., Hysong, S. J., McKee, G. B., Midboe, A. M., Shepherd‐Banigan, M. E., & Elwy, A. R. (2024) · Frontiers in Digital Health · doi:10.3389/fdgth.2024.1426057 · Cited by 3
Comparative Evaluation of GPT Models in FHIR Proficiency
Pope, T., & Patooghy, A. (2025) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3718095 · Cited by 3
Navigating the Transformative Impact of Artificial Intelligence in Health Services Research
Wu, G., & Yang, F. (2025) · Health Science Reports · doi:10.1002/hsr2.70793 · Cited by 3
“Moreover, AI expedites the drug discovery process by identifying potential candidates, forecasting patient responses, and streamlining clinical trials [19, 20].”
A quantitative analysis of global AI medical studies: gaps in randomized controlled trials
Wang, Q., Yang, Y., Qiu, L., Xu, Y., Sun, R., Xue, P., & Qiao, Y. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02698-z · Cited by 4
Tekin, A., Herasevich, S., Minteer, S. A., Gajic, O., & Barwise, A. K. (2024) · Applied Clinical Informatics · doi:10.1055/a-2451-9046 · Cited by 1
Lam, T. Y. T., Hu, Y., Yi, Y., Schulz, P. J., Lwin, M. O., Kee, K. M., Goh, W. W. B., Cheung, M. F. K., Lee, H. S., Fan, A. S. H., et al. (2025) · Journal of Gastroenterology and Hepatology · doi:10.1111/jgh.17042 · Cited by 5
Self-citationToward Integrated Clinical-Computational Nuclear Medicine
Farhadi, F., Esfahani, S. A., Yousefirizi, F., Luo, M., Fernandez, P. E., Sitek, A., Sabet, H., Saboury, B., Rahmim, A., & Heidari, P. (2025) · PET Clinics · doi:10.1016/j.cpet.2025.09.003 · Cited by 3
Huang, Y. C., Zhao, B., Yan, R., Zhang, C., Geng, Z., Mei, P., Li, K., & Liao, Y. (2025) · Frontiers in Oncology · doi:10.3389/fonc.2025.1687360 · Cited by 3
Kareemi, H., Colak, A., Yadav, K., Michalowski, W., & Vaillancourt, C. (2026) · Canadian Journal of Emergency Medicine · doi:10.1007/s43678-026-01189-0 · Cited by 2
Dong, C., Liu, Y., Yin, J., Yan, W., Sun, J., Zhang, X., Huo, S., Yu, F., & Zhou, Y. (2026) · Digital Health · doi:10.1177/20552076261474637 · Cited by 3
Ong, Q. C., Ang, C., Bojić, I., Johnson, C. L., Aggour, H., Ng, F. S., Car, J., Leeson, P., Gonçalves, J., & Lai, N. M. (2026) · EClinicalMedicine · doi:10.1016/j.eclinm.2026.104123 · Cited by 4
Intelligenza Artificiale per la cura del diabete mellito: opportunità e prospettive future
(2024) · il Diabete · doi:10.30682/ildia2304g · Cited by 1
Cho, U., Gwon, Y. N., Chong, S. R., Han, J. Y., Kim, D. K., Doo, S. W., Yang, W. J., Kim, K. H., Shim, S. R., Jung, J., et al. (2024) · Journal of Medical Internet Research · doi:10.2196/56039 · Cited by 3
“The widespread use of tools based on AI in routine clinical work has been described in a recent publication by Lam et al [17], with applications identified in 13 clinical disciplines.”
The Role of Multimodal AI in Revolutionizing Healthcare: A Perspective
Chodvadiya, K. (2025) · National Journal of Medical Research · doi:10.55489/njmr.150120251057 · Cited by 2
Rastogi, A., & Mentor, D. S. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825148 · Cited by 3
PRIMENA VEŠTAČKE INTELIGENCIJE U BIOTEHNOLOGIJI I MEDICINI
Popović, V., Bošković, J., Filipović, A., & Popović, M. B. (2025) · Limes plus. · doi:10.69899/limes-plus24212-3043p · Cited by 1
Andreoletti, M., Senkalfa, B., & Blasimme, A. (2024) · medRxiv · doi:10.1101/2024.07.09.24310133 · Cited by 2
Ho, K., Park, S., Lai, M., & Krakovsky, S. (2024) · Elsevier eBooks · doi:10.1016/b978-0-323-95068-8.00006-6
Healthcare\'s digital revolution: AI at the forefront
Tamboli, F. A. (2024) · Journal of Pharmaceutical and Biological Sciences · doi:10.18231/j.jpbs.2024.001
Gwon, Y. N., Cho, U., Chong, S. R., Han, J. Y., Kim, D. K., Doo, S. W., Yang, W. J., Kim, K. H., Shim, S. R., Jung, J., et al. (2024) · The World Journal of Men s Health · doi:10.5534/wjmh.240191 · Cited by 1
“The use of AI-supported instruments has recently been demonstrated in routine clinical domains [26].”
Papadopoulou, P., & Lytras, M. D. (2024) · Advances in medical technologies and clinical practice book series · doi:10.4018/979-8-3693-4422-4.ch003
Ren, W., & Liu, X. (2025) · Journal of Radiation Research and Applied Sciences · doi:10.1016/j.jrras.2025.101360
Letter to the Editor: Bridging the Implementation Gap in Emergency AI ‐ CDSS Research
Boğa, E. (2025) · Academic Emergency Medicine · doi:10.1111/acem.70092
High-speed quantum random-number generation based on frequency-division multiplexing
Li, J., Fan, X., Chen, Y., Mu, T., Guo, J., Huang, J., Liu, M., Huang, Z., Liu, B., & Sun, S. (2025) · Physical Review Applied · doi:10.1103/zm23-pyfd · Cited by 2
Quality Evaluation of Voice AI Software
Das, S. (2026) · Springer eBooks · doi:10.1007/978-3-032-03134-1_9
Implementation Science for AI Projects
Liebe, J.-D., & Hübner, U. H. (2026) · Health informatics · doi:10.1007/978-3-032-11938-4_5
Kuo, B., Wang, T.-A., Chu, T. C., et al. (2026) · doi:10.2196/preprints.91699
Vinnakota, A., Hodgman, M. W., & Ehrmann, D. E. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1734400
“Indeed, few CDS systems have improved patient outcomes in randomized controlled trials (24).”
Mahmoud, A. M., Touti, J. P., Zaidi, S. R., Kodipad, A. A., & Deambrogi, C. (2026) · Cancers · doi:10.3390/cancers18071173
Clinical Artificial Intelligence and Machine Learning Metrics 101
Hur, B., Elangovan, A., & Hardefeldt, L. Y. (2026) · Veterinary Clinics of North America Small Animal Practice · doi:10.1016/j.cvsm.2026.03.010
Zhilenkova, A. V., Орлова, Е. В., & Sekacheva, M. I. (2026) · Современные проблемы науки и образования · doi:10.17513/spno.34595
Metadata
- Authors
- Lam, T. Y. T., Cheung, M. F. K., Munro, Y. L., Lim, K. M., Shung, D., & Sung, J. J. Y.
- Affiliations
- Chinese University of Hong Kong (HK)
- Nanyang Technological University (SG)
- Yale University (US)
- Corresponding author
- Sung, Joseph J Y
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2022-08-25
- Volume
- 24
- Issue
- 8
- Pages
- e37188
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC9459941
- OpenAlex
- W4288467884
- Cited by
- 120
- References
- 64
- Citations by year
- 2026: 33 · 2025: 46 · 2024: 29 · 2023: 12
- FWCI
- 1.49
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- DR-NTU (Nanyang Technological University) (submittedVersion, cc-by)
- Funders
- Yale University
- National Institutes of Health (UL1TR001863)
- Raymond and Beverly Sackler Institute for Biological, Physical and Engineering Sciences, Yale University
- National Center for Advancing Translational Sciences
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Keywords
- artificial intelligence, AI-assisted tools, clinical practice, randomized controlled trials, clinical outcomes, endoscopy, gastroenterology
- MeSH terms
- Artificial Intelligence, Europe, Humans, North America, Randomized Controlled Trials as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-01, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-01 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.