Role of Artificial Intelligence Applications in Real-Life Clinical Practice: Systematic Review
Open accessPublished version of a preprint
The DOI matches its Crossref record; 86 of the 86 references it cites were found in a registry or an index.
Abstract
Background: Artificial intelligence (AI) applications are growing at an unprecedented pace in health care, including disease diagnosis, triage or screening, risk analysis, surgical operations, and so forth. Despite a great deal of research in the development and validation of health care AI, only few applications have been actually implemented at the frontlines of clinical practice. Objective: The objective of this study was to systematically review AI applications that have been implemented in real-life clinical practice. Methods: We conducted a literature search in PubMed, Embase, Cochrane Central, and CINAHL to identify relevant articles published between January 2010 and May 2020. We also hand searched premier computer science journals and conferences as well as registered clinical trials. Studies were included if they reported AI applications that had been implemented in real-world clinical settings. Results: We identified 51 relevant studies that reported the implementation and evaluation of AI applications in clinical practice, of which 13 adopted a randomized controlled trial design and eight adopted an experimental design. The AI applications targeted various clinical tasks, such as screening or triage (n=16), disease diagnosis (n=16), risk analysis (n=14), and treatment (n=7). The most commonly addressed diseases and conditions were sepsis (n=6), breast cancer (n=5), diabetic retinopathy (n=4), and polyp and adenoma (n=4). Regarding the evaluation outcomes, we found that 26 studies examined the performance of AI applications in clinical settings, 33 studies examined the effect of AI applications on clinician outcomes, 14 studies examined the effect on patient outcomes, and one study examined the economic impact associated with AI implementation. Conclusions: This review indicates that research on the clinical implementation of AI applications is still at an early stage despite the great potential. More research needs to assess the benefits and challenges associated with clinical AI applications through a more rigorous methodology.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“A recent systematic review examined all studies of AI application in clinical practice, but was limited by restriction to English language and only searching full manuscripts published between January 2010 and May 2020 [13].”
From Randomized Controlled Trials of Artificial Intelligence in Clinical Practice: Systematic Review (2022) · cites this paper as [13]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Of these, 6 were related to diabetes.”
From An Assessment of How Clinicians and Staff Members Use a Diabetes Artificial Intelligence Prediction Tool: Mixed Methods Study (2023) · cites this paper as [31]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These applications used computer vision to diagnose diabetic retinopathy from retinal images and EHR data to predict those at risk for hyperglycemia.”
From An Assessment of How Clinicians and Staff Members Use a Diabetes Artificial Intelligence Prediction Tool: Mixed Methods Study (2023) · cites this paper as [31]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Unfortunately, the implementation of AI tools for diabetes has lagged, and few tools are used in practice, limiting their impact.”
From An Assessment of How Clinicians and Staff Members Use a Diabetes Artificial Intelligence Prediction Tool: Mixed Methods Study (2023) · cites this paper as [31]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Despite the ongoing development and testing of AI applications in healthcare, the implementation of medical AI systems in clinical care remains in its early stages [2, 3].”
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042
Cochrane Handbook for Systematic Reviews of Interventions
(2019) · doi:10.1002/9781119536604 · Cited by 14,828
High-performance medicine: the convergence of human and artificial intelligence
Topol, E. J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0300-7 · Cited by 10,450
Cumpston, M., Li, T., Page, M. J., Chandler, J., Welch, V. A., Higgins, J. P., & Thomas, J. (2019) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.ed000142 · Cited by 7,218
Artificial intelligence in healthcare: past, present and future
Jiang, F., Jiang, Y., Zhi, H., Dong, Y., Li, H., Ma, S., Wang, Y., Dong, Q., Shen, H., & Wang, Y. (2017) · Stroke and Vascular Neurology · doi:10.1136/svn-2017-000101 · Cited by 4,837
Key challenges for delivering clinical impact with artificial intelligence
Kelly, C. J., Karthikesalingam, A., Suleyman, M., Corrado, G., & King, D. (2019) · BMC Medicine · doi:10.1186/s12916-019-1426-2 · Cited by 3,136
Artificial intelligence in healthcare
Yu, K.-H., Beam, A. L., & Kohane, I. S. (2018) · Nature Biomedical Engineering · doi:10.1038/s41551-018-0305-z · Cited by 2,817
The practical implementation of artificial intelligence technologies in medicine
He, J., Baxter, S. L., Xu, J., Xu, J., Zhou, X., & Zhang, K. (2019) · Nature Medicine · doi:10.1038/s41591-018-0307-0 · Cited by 2,246
A Proposal for the Dartmouth Summer Research Project on Artificial Intelligence, August 31, 1955
McCarthy, J., Minsky, M., Rochester, N., et al. (2006) · The AI Magazine · doi:10.1609/aimag.v27i4.1904 · Cited by 2,029
Resistance to Medical Artificial Intelligence
Longoni, C., Bonezzi, A., & Morewedge, C. K. (2019) · Journal of Consumer Research · doi:10.1093/jcr/ucz013 · Cited by 2,015
Liu, X., Faes, L., Kale, A. U., Wagner, S. K., Fu, D. J., Bruynseels, A., Mahendiran, T., Moraes, G., Shamdas, M., Kern, C., et al. (2019) · The Lancet Digital Health · doi:10.1016/s2589-7500(19)30123-2 · Cited by 1,883
Abràmoff, M. D., Lavin, P. T., Birch, M., Shah, N., & Folk, J. C. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0040-6 · Cited by 1,638
Big data and machine learning algorithms for health-care delivery
Ngiam, K. Y., & Khor, I. W. (2019) · The Lancet Oncology · doi:10.1016/s1470-2045(19)30149-4 · Cited by 1,424
Self-citationNagendran, M., Chen, Y., Lovejoy, C. A., Gordon, A. C., Komorowski, M., Harvey, H., Topol, E. J., Ioannidis, J. P. A., Collins, G. S., & Maruthappu, M. (2020) · BMJ · doi:10.1136/bmj.m689 · Cited by 1,152
Wang, P., Berzin, T. M., Glissen Brown, J. R., Bharadwaj, S., Becq, A., Xiao, X., Liu, P., Li, L., Song, Y., Zhang, D., et al. (2019) · Gut · doi:10.1136/gutjnl-2018-317500 · Cited by 865
Fiske, A., Henningsen, P., & Buyx, A. (2019) · Journal of Medical Internet Research · doi:10.2196/13216 · Cited by 857
Bien, N., Rajpurkar, P., Ball, R. L., Irvin, J., Park, A., Jones, E., Bereket, M., Patel, B. N., Yeom, K. W., Shpanskaya, K., et al. (2018) · PLOS Medicine · doi:10.1371/journal.pmed.1002699 · Cited by 734 · cited 6×
“From our review, 16 studies demonstrated that AI applications could enhance clinical decision-making capacity [31-33,45-47,50,55,58,59,63,64,67,69,71,74,75].”
BackgroundInfluentialDeep neural network improves fracture detection by clinicians
Lindsey, R., Daluiski, A., Chopra, S., Lachapelle, A., Mozer, M., Sicular, S., Hanel, D., Gardner, M., Gupta, A., Hotchkiss, R., et al. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1806905115 · Cited by 640
Wijnberge, M., Geerts, B. F., Hol, L., Lemmers, N., Mulder, M. P., Berge, P., Schenk, J., Terwindt, L. E., Hollmann, M. W., Vlaar, A. P., et al. (2020) · JAMA · doi:10.1001/jama.2020.0592 · Cited by 586
Artificial intelligence for diabetes management and decision support: Literature review
Contreras, I., & Vehi, J. (2018) · Journal of Medical Internet Research · doi:10.2196/10775 · Cited by 560
Mori, Y., Kudo, S.-E., Misawa, M., Saito, Y., Ikematsu, H., Hotta, K., Ohtsuka, K., Urushibara, F., Kataoka, S., Ogawa, Y., et al. (2018) · Annals of Internal Medicine · doi:10.7326/m18-0249 · Cited by 509
Artificial intelligence and machine learning in clinical development: a translational perspective
Shah, P., Kendall, F., Khozin, S., Goosen, R., Hu, J., Laramie, J., Ringel, M., & Schork, N. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0148-3 · Cited by 498
Steiner, D. F., MacDonald, R., Liu, Y., Truszkowski, P., Hipp, J. D., Gammage, C., Thng, F., Peng, L., & Stumpe, M. C. (2018) · American Journal of Surgical Pathology · doi:10.1097/pas.0000000000001151 · Cited by 489
The “inconvenient truth” about AI in healthcare
Panch, T., Mattie, H., & Celi, L. A. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0155-4 · Cited by 473
Automated deep-neural-network surveillance of cranial images for acute neurologic events
Titano, J. J., Badgeley, M., Schefflein, J., Pain, M., Su, A., Cai, M., Swinburne, N., Zech, J., Kim, J., Bederson, J., et al. (2018) · Nature Medicine · doi:10.1038/s41591-018-0147-y · Cited by 458
Arbabshirani, M. R., Fornwalt, B. K., Mongelluzzo, G. J., Suever, J. D., Geise, B. D., Patel, A. A., & Moore, G. J. (2018) · npj Digital Medicine · doi:10.1038/s41746-017-0015-z · Cited by 443
Wang, P., Liu, X., Berzin, T. M., Glissen Brown, J. R., Liu, P., Zhou, C., Lei, L., Li, L., Guo, Z., Lei, S., et al. (2020) · The Lancet Gastroenterology & Hepatology · doi:10.1016/s2468-1253(19)30411-x · Cited by 415
Artificial intelligence and the implementation challenge
Shaw, J., Rudzicz, F., Jamieson, T., & Goldfarb, A. (2019) · Journal of Medical Internet Research · doi:10.2196/13659 · Cited by 389 · cited 2×
“Examples of key challenges that need to be addressed include data sharing and privacy issues, lack of algorithm transparency, the changing nature of health care work, financial concerns, and the demanding regulatory environment [1,3,9-13].”
BackgroundShimabukuro, D. W., Barton, C. W., Feldman, M. D., Mataraso, S. J., & Das, R. (2017) · BMJ Open Respiratory Research · doi:10.1136/bmjresp-2017-000234 · Cited by 382
Artificial Intelligence Versus Clinicians in Disease Diagnosis: Systematic Review
Shen, J., Zhang, C. J. P., Jiang, B., Chen, J., Song, J., Liu, Z., He, Z., Wong, S. Y., Fang, P.-H., & Ming, W.-K. (2019) · JMIR Medical Informatics · doi:10.2196/10010 · Cited by 373
Lysaght, T., Lim, H. Y., Xafis, V., & Ngiam, K. Y. (2019) · Asian Bioethics Review · doi:10.1007/s41649-019-00096-0 · Cited by 332
Self-citationImpact of a deep learning assistant on the histopathologic classification of liver cancer
Kiani, A., Uyumazturk, B., Rajpurkar, P., Wang, A., Gao, R., Jones, E., Yu, Y., Langlotz, C. P., Ball, R. L., Montine, T. J., et al. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0232-8 · Cited by 325 · cited 7×
“CO (accuracy) Stanford University Medical Center (United Kingdom) 11 pathologists Experimental study (within subjects) Kiani et al, 2020 [42]”
BackgroundMethodInfluentialWu, L., Zhang, J., Zhou, W., An, P., Shen, L., Liu, J., Jiang, X., Huang, X., Mu, G., Wan, X., et al. (2019) · Gut · doi:10.1136/gutjnl-2018-317366 · Cited by 316
The legal and ethical concerns that arise from using complex predictive analytics in health care
Cohen, I. G., Amarasingham, R., Shah, A., Xie, B., & Lo, B. (2014) · Health Affairs · doi:10.1377/hlthaff.2014.0048 · Cited by 300
Su, J.-R., Li, Z., Shao, X.-J., Ji, C.-R., Ji, R., Zhou, R.-C., Li, G.-C., Liu, G.-Q., He, Y.-S., Zuo, X.-L., et al. (2020) · Gastrointestinal Endoscopy · doi:10.1016/j.gie.2019.08.026 · Cited by 286
Giannini, H. M., Ginestra, J. C., Chivers, C., Draugelis, M., Hanish, A., Schweickert, W. D., Fuchs, B. D., Meadows, L., Lynch, M., Donnelly, P. J., et al. (2019) · Critical Care Medicine · doi:10.1097/ccm.0000000000003891 · Cited by 269
Breast Cancer Detection and Diagnosis Using Mammographic Data: Systematic Review
Gardezi, S. J. S., Elazab, A., Lei, B., & Wang, T. (2019) · Journal of Medical Internet Research · doi:10.2196/14464 · Cited by 268
Natural and Artificial Intelligence in Neurosurgery: A Systematic Review
Senders, J. T., Arnaout, O., Karhade, A. V., Dasenbrock, H. H., Gormley, W. B., Broekman, M. L., & Smith, T. R. (2018) · Neurosurgery · doi:10.1093/neuros/nyx384 · Cited by 264
Systematic Review of Economic Impact Studies of Artificial Intelligence in Health Care
Wolff, J., Pauling, J., Keck, A., & Baumbach, J. (2020) · Journal of Medical Internet Research · doi:10.2196/16866 · Cited by 261
Deep Learning–Assisted Diagnosis of Cerebral Aneurysms Using the HeadXNet Model
Park, A., Chute, C., Rajpurkar, P., Lou, J., Ball, R. L., Shpanskaya, K., Jabarkheel, R., Kim, L. H., McKenna, E., Tseng, J., et al. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.5600 · Cited by 258
Sim, Y., Chung, M. J., Kotter, E., Yune, S., Kim, M., Do, S., Han, K., Kim, H., Yang, S., Lee, D.-J., et al. (2020) · Radiology · doi:10.1148/radiol.2019182465 · Cited by 248
Applications of Machine Learning in Real-Life Digital Health Interventions: Review of the Literature
Triantafyllidis, A. K., & Tsanas, A. (2019) · Journal of Medical Internet Research · doi:10.2196/12286 · Cited by 243
Framing the challenges of artificial intelligence in medicine
Yu, K.-H., & Kohane, I. S. (2019) · BMJ Quality & Safety · doi:10.1136/bmjqs-2018-008551 · Cited by 233
Natarajan, S., Jain, A., Krishnan, R., Rogye, A., & Sivaprasad, S. (2019) · JAMA Ophthalmology · doi:10.1001/jamaophthalmol.2019.2923 · Cited by 228
Keel, S., Lee, P. Y., Scheetz, J., Li, Z., Kotowicz, M. A., MacIsaac, R. J., & He, M. (2018) · Scientific Reports · doi:10.1038/s41598-018-22612-2 · Cited by 220
Relevance of deep learning to facilitate the diagnosis of HER2 status in breast cancer
Vandenberghe, M. E., Scott, M. L. J., Scorer, P. W., Söderberg, M., Balcerzak, D., & Barker, C. (2017) · Scientific Reports · doi:10.1038/srep45938 · Cited by 209
Lin, H., Li, R., Liu, Z., Chen, J., Yang, Y., Chen, H., Lin, Z., Lai, W., Long, E., Wu, X., et al. (2019) · EClinicalMedicine · doi:10.1016/j.eclinm.2019.03.001 · Cited by 199
Vollmer Dahlke, D., Fair, K., Hong, Y. A., Beaudoin, C. E., Pulczinski, J., & Ory, M. G. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3861 · Cited by 199
Wang, W., Kiik, M., Peek, N., Curcin, V., Marshall, I. J., Rudd, A. G., Wang, Y., Douiri, A., Wolfe, C. D., & Bray, B. (2020) · PLOS ONE · doi:10.1371/journal.pone.0234722 · Cited by 195
Rajpara, S. M., Botello, A. P., Townend, J., & Ormerod, A. D. (2009) · British Journal of Dermatology · doi:10.1111/j.1365-2133.2009.09093.x · Cited by 185
Evaluation of Artificial Intelligence–Based Grading of Diabetic Retinopathy in Primary Care
Kanagasingam, Y., Xiao, D., Vignarajan, J., Preetham, A., Tay-Kearney, M.-L., & Mehrotra, A. (2018) · JAMA Network Open · doi:10.1001/jamanetworkopen.2018.2665 · Cited by 185
Study on detection rate of polyps and adenomas in artificial-intelligence-aided colonoscopy
Huang, J., Liu, W.-N., Zhang, Y.-Y., Bian, X.-Q., Wang, L.-J., Yang, Q., & Zhang, X.-D. (2020) · Saudi Journal of Gastroenterology · doi:10.4103/sjg.sjg_377_19 · Cited by 179 · cited 7×
“From our review, 16 studies demonstrated that AI applications could enhance clinical decision-making capacity [31-33,45-47,50,55,58,59,63,64,67,69,71,74,75].”
BackgroundResultInfluentialHarris, M., Qi, A., Jeagal, L., Torabi, N., Menzies, D., Korobitsyn, A., Pai, M., Nathavitharana, R. R., & Ahmad Khan, F. (2019) · PLOS ONE · doi:10.1371/journal.pone.0221339 · Cited by 177
Liu, C., Liu, X., Wu, F., Xie, M., Feng, Y., & Hu, C. (2018) · Journal of Medical Internet Research · doi:10.2196/11087 · Cited by 162
Ginestra, J. C., Giannini, H. M., Schweickert, W. D., Meadows, L., Lynch, M. J., Pavan, K., Chivers, C. J., Draugelis, M., Donnelly, P. J., Fuchs, B. D., et al. (2019) · Critical Care Medicine · doi:10.1097/ccm.0000000000003803 · Cited by 159 · cited 8×
“On the other hand, the remaining two studies reported mixed or even negative evaluations of AI [37,56].”
BackgroundResultInfluentialA universal artificial intelligence platform for collaborative management of cataracts
Wu, X., Huang, Y., Liu, Z., Lai, W., Long, E., Zhang, K., Jiang, J., Lin, D., Chen, K., Yu, T., et al. (2019) · The Lancet · doi:10.1016/s0140-6736(19)32358-x · Cited by 159
McCoy, A., & Das, R. (2017) · BMJ Open Quality · doi:10.1136/bmjoq-2017-000158 · Cited by 148
Romero-Brufau, S., Wyatt, K. D., Boyum, P., Mickelson, M., Moore, M., & Cognetta-Rieke, C. (2020) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2019.104072 · Cited by 143 · cited 9×
“4 | e25759 | p. 5https://www.jmir.org/2021/4/e25759 (page number not for citation purposes) XSL•FO RenderX Evaluation outcomesHospital (country)Sample characteristicsStudy designAuthor, year AP (accuracy, PPV, NPV) CO (time to diagnosis) PO (patient satisfaction) 5 ophthalmic clinics (China)350 patientsRCTLin et al, 2…”
BackgroundResultInfluentialAuloge, P., Cazzato, R. L., Ramamurthy, N. K., Marini, P. D., Rousseau, C., Garnon, J., Charles, Y. P., Steib, J.-P., & Gangi, A. (2019) · European Spine Journal · doi:10.1007/s00586-019-06054-6 · Cited by 142
Bailey, T. C., Chen, Y., Mao, Y., Lu, C., Hackmann, G., Micek, S. T., Heard, K. M., Faulkner, K. M., & Kollef, M. H. (2013) · Journal of Hospital Medicine · doi:10.1002/jhm.2009 · Cited by 131
Brennan, M., Puri, S., Ozrazgat-Baslanti, T., Feng, Z., Ruppert, M., Hashemighouchani, H., Momcilovic, P., Li, X., Wang, D. Z., & Bihorac, A. (2019) · Surgery · doi:10.1016/j.surg.2019.01.002 · Cited by 131
Mango, V. L., Sun, M., Wynn, R. T., & Ha, R. S. (2020) · American Journal of Roentgenology · doi:10.2214/ajr.19.21872 · Cited by 122
Segal, G., Segev, A., Brom, A., Lifshitz, Y., Wasserstrum, Y., & Zimlichman, E. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz135 · Cited by 116
Why do patients derogate physicians who use a computer-based diagnostic support system?
Shaffer, V. A., Probst, C. A., Merkle, E. C., Arkes, H. R., & Medow, M. A. (2013) · Medical Decision Making · doi:10.1177/0272989x12453501 · Cited by 115
Aoki, T., Yamada, A., Aoyama, K., Saito, H., Fujisawa, G., Odawara, N., Kondo, R., Tsuboi, A., Ishibashi, R., Nakada, A., et al. (2019) · Digestive Endoscopy · doi:10.1111/den.13517 · Cited by 115
Chen, D., Wu, L., Li, Y., Zhang, J., Liu, J., Huang, L., Jiang, X., Huang, X., Mu, G., Hu, S., et al. (2019) · Gastrointestinal Endoscopy · doi:10.1016/j.gie.2019.09.016 · Cited by 98
Computer-Aided Diagnosis of Thyroid Nodules via Ultrasonography: Initial Clinical Experience
Yoo, Y. J., Ha, E. J., Cho, Y. J., Kim, H. L., Han, M., & Kang, S. Y. (2018) · Korean Journal of Radiology · doi:10.3348/kjr.2018.19.4.665 · Cited by 90
Beaudoin, M., Kabanza, F., Nault, V., & Valiquette, L. (2016) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2016.02.001 · Cited by 85
Voermans, A., Mewes, J. C., Broyles, M. R., & Steuten, L. (2019) · OMICS A Journal of Integrative Biology · doi:10.1089/omi.2019.0113 · Cited by 82
A case-based reasoning system for aiding detection and classification of nosocomial infections
Gómez-Vallejo, H. J., Latorre, B. U., Sande-Meijide, M., Villamarín-Bello, B., Pavón, R., Fdez‐Riverola, F., & Glez‐Peña, D. (2016) · Decision Support Systems · doi:10.1016/j.dss.2016.02.005 · Cited by 59
Augmenting diagnostic vision with AI
Quer, G., Muse, E. D., Nikzad, N., Topol, E. J., & Steinhubl, S. R. (2017) · The Lancet · doi:10.1016/s0140-6736(17)31764-6 · Cited by 52
Evaluation of the Parasight Platform for Malaria Diagnosis
Eshel, Y., Houri-Yafin, A., Benkuzari, H., Lezmy, N., Soni, M., Charles, M., Swaminathan, J., Solomon, H., Sampathkumar, P., Premji, Z., et al. (2017) · Journal of Clinical Microbiology · doi:10.1128/jcm.02155-16 · Cited by 50
Nicolae, A., Semple, M., Lu, L., Smith, M., Chung, H. T.-K., Loblaw, A., Morton, G., Mendez, L. C., Tseng, C., Davidson, M. T. M., et al. (2020) · Brachytherapy · doi:10.1016/j.brachy.2020.03.004 · Cited by 49
Implementation of complex adaptive chronic care: the Patient Journey Record system (PaJR)
Martin, C. M., Vogel, C., Grady, D., Zarabzadeh, A., Hederman, L., Kellett, J., Smith, K., & O’ Shea, B. (2012) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2012.01880.x · Cited by 48
Barinov, L., Jairaj, A., Becker, M. D., Seymour, S. E., Lee, E. S., Schram, A. M., Lane, E., Goldszal, A. F., Quigley, D. A., & Paster, L. (2018) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-018-0132-5 · Cited by 48
Connell, A., Montgomery, H., Martin, P., Nightingale, C., Sadeghi‐Alavijeh, O., King, D., Karthikesalingam, A., Hughes, C., Back, T., Ayoub, K., et al. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0100-6 · Cited by 42
Technology integrated health management for dementia
Rostill, H., Nilforooshan, R., Morgan, A., Barnaghi, P. M., Ream, E., & Chrysanthaki, T. (2018) · British Journal of Community Nursing · doi:10.12968/bjcn.2018.23.10.502 · Cited by 39
Grunwald, I. Q., Ragoschke-Schumm, A., Kettner, M., et al. (2016) · Cerebrovascular Diseases · doi:10.1159/000446861 · Cited by 36
Realization of a service for the long-term risk assessment of diabetes-related complications
Lagani, V., Chiarugi, F., Manousos, D., Verma, V., Fursse, J., Marias, K., & Tsamardinos, I. (2015) · Journal of Diabetes and its Complications · doi:10.1016/j.jdiacomp.2015.03.011 · Cited by 34
Evidence-Based Decision Support for Neurological Diagnosis Reduces Errors and Unnecessary Workup
Segal, M. M., Williams, M. S., Gropman, A. L., Torres, A. R., Forsyth, R. J., Connolly, A. M., El‐Hattab, A. W., Perlman, S. J., Samanta, D., Parikh, S., et al. (2013) · Journal of Child Neurology · doi:10.1177/0883073813483365 · Cited by 32
Wang, S. V., Rogers, J. R., Jin, Y., Deicicchi, D. J., Dejene, S. Z., Connors, J. M., Bates, D. W., Glynn, R. J., & Fischer, M. A. (2019) · BMJ Quality & Safety · doi:10.1136/bmjqs-2019-009367 · Cited by 22
Nagaratnam, K., Harston, G., Floßmann, E., Canavan, C., Geraldes, R. C., & Edwards, C. (2020) · Future Healthcare Journal · doi:10.7861/fhj.2020-0034 · Cited by 21
McNamara, D. M., Goldberg, S. L., Latts, L., Graham, D. M. A., Waintraub, S. E., Norden, A. D., Landstrom, C., Pecora, A. L., Hervey, J., Schultz, E. V., et al. (2019) · Cancer Medicine · doi:10.1002/cam4.2548 · Cited by 18
Segal, M. M., Rahm, A. K., Hulse, N. C., Wood, G. M., Williams, J. L., Feldman, L. K., Moore, G. J., Gehrum, D., Yefko, M., Mayernick, S., et al. (2017) · eGEMs (Generating Evidence & Methods to improve patient outcomes) · doi:10.5334/egems.244 · Cited by 15
Evidence-based decision support for pediatric rheumatology reduces diagnostic errors
Segal, M. M., Athreya, B. H., Son, M. B. F., Tirosh, I., Hausmann, J. S., Ang, E., Zurakowski, D., Feldman, L. K., & Sundel, R. P. (2016) · Pediatric Rheumatology · doi:10.1186/s12969-016-0127-z · Cited by 9
Research works printed but not linked: 1
- 10.1136/bjophthalmol-2019-314729 · DOI
Cited by
Petersson, L., Larsson, I., Nygren, J. M., Nilsen, P., Neher, M., Reed, J. E., Tyskbo, D., & Svedberg, P. (2022) · BMC Health Services Research · doi:10.1186/s12913-022-08215-8 · Cited by 434
Esmaeilzadeh, P. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.102861 · Cited by 377
Artificial Intelligence Applications in Health Care Practice: Scoping Review
Sharma, M., Savage, C., Nair, M., Larsson, I., Svedberg, P., & Nygren, J. M. (2022) · Journal of Medical Internet Research · doi:10.2196/40238 · Cited by 198
Next-generation agentic AI for transforming healthcare
Karunanayake, N. (2025) · Informatics and Health · doi:10.1016/j.infoh.2025.03.001 · Cited by 165
Hogg, H. D. J., Al-Zubaidy, M., Technology Enhanced Macular Services Study Reference Group, Talks, J., Denniston, A. K., Kelly, C. J., Malawana, J., Papoutsi, C., Teare, M. D., Keane, P. A., et al. (2023) · Journal of Medical Internet Research · doi:10.2196/39742 · Cited by 163
Metadata
- Authors
- Yin, J., Ngiam, K. Y., & Teo, H. H.
- Affiliations
- National University of Singapore (SG)
- National University Hospital (SG)
- Corresponding author
- Teo, Hock Hai
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2021-04-22
- Volume
- 23
- Issue
- 4
- Pages
- e25759
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC8103304
- OpenAlex
- W3134138028
- Cited by
- 419
- References
- 86
- Citations by year
- 2026: 75 · 2025: 126 · 2024: 106 · 2023: 69 · 2022: 34 · 2021: 6
- FWCI
- 4.50
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- National University of Singapore (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National University of Singapore
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Keywords
- artificial intelligence in healthcare, clinical implementation of AI, clinical practice, disease diagnosis, risk analysis, sepsis, breast cancer, diabetic retinopathy, patient outcomes, economic impact of AI
- MeSH terms
- Artificial Intelligence, Humans, Randomized Controlled Trials as Topic, Risk Assessment, Sepsis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.