Concordance of randomised controlled trials for artificial intelligence interventions with the CONSORT-AI reporting guidelines
Open accessThe DOI matches its Crossref record; 89 of the 89 references it cites were found in a registry or an index.
Abstract
The Consolidated Standards of Reporting Trials extension for Artificial Intelligence interventions (CONSORT-AI) was published in September 2020. Since its publication, several randomised controlled trials (RCTs) of AI interventions have been published but their completeness and transparency of reporting is unknown. This systematic review assesses the completeness of reporting of AI RCTs following publication of CONSORT-AI and provides a comprehensive summary of RCTs published in recent years. 65 RCTs were identified, mostly conducted in China (37%) and USA (18%). Median concordance with CONSORT-AI reporting was 90% (IQR 77–94%), although only 10 RCTs explicitly reported its use. Several items were consistently under-reported, including algorithm version, accessibility of the AI intervention or code, and references to a study protocol. Only 3 of 52 included journals explicitly endorsed or mandated CONSORT-AI. Despite a generally high concordance amongst recent AI RCTs, some AI-specific considerations remain systematically poorly reported. Further encouragement of CONSORT-AI adoption by journals and funders may enable more complete adoption of the full CONSORT-AI guidelines.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Second, there are also concerns about the quality and transparency of published clinical trials, which often lack the methodological rigor and detailed reporting necessary to inspire clinical confidence and enable replication9–11.”
From A quantitative analysis of global AI medical studies: gaps in randomized controlled trials (2026) · cites this paper as [9]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“However, these guidelines do not cover RAG applications in clinical settings, emphasizing the need for a more specific guideline.”
From Improving large language model applications in biomedicine with retrieval-augmented generation: a systematic review, meta-analysis, and clinical development guidelines (2025) · cites this paper as [13]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
3 retracted
Zhu, S., Niu, Y., Wang, J., Xu, D., & Li, Y. (2022) · Computational and Mathematical Methods in Medicine · doi:10.1155/2022/3021320 · Cited by 10
RetractedWang, T., Chen, Y., Du, H., Liu, Y., Zhang, L., & Meng, M. (2021) · Computational and Mathematical Methods in Medicine · doi:10.1155/2021/3584034 · Cited by 7
RetractedZhang, F., Wu, S., Qu, M., & Zhou, L. (2022) · Contrast Media & Molecular Imaging · doi:10.1155/2022/1013241 · Cited by 5
RetractedThe PRISMA 2020 statement: An updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n71 · Cited by 108,283
Self-citationCONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
the CONSORT Group, Schulz, K. F., Altman, D. G., & Moher, D. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-18 · Cited by 13,371
Self-citationCONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
Schulz, K. F., Altman, D. G., Moher, D., & for the CONSORT Group (2010) · BMJ · doi:10.1136/bmj.c332 · Cited by 9,329
Self-citationLarge Language Models Encode Clinical Knowledge
Singhal, K., Azizi, S., Tu, T., Mahdavi, S. S., Wei, J., Chung, H. W., Scales, N., Tanwani, A., Cole-Lewis, H., Pfohl, S., et al. (2022) · arXiv · doi:10.48550/arxiv.2212.13138 · Cited by 4,083
Self-citationLarge language models encode clinical knowledge
Singhal, K., Azizi, S., Tu, T., Mahdavi, S. S., Wei, J., Chung, H. W., Scales, N., Tanwani, A., Cole-Lewis, H., Pfohl, S., et al. (2023) · Nature · doi:10.1038/s41586-023-06291-2 · Cited by 4,083
Self-citationInternational evaluation of an AI system for breast cancer screening
McKinney, S. M., Sieniek, M., Godbole, V., Godwin, J., Antropova, N., Ashrafian, H., Back, T., Chesus, M., Corrado, G. S., Darzi, A., et al. (2020) · Nature · doi:10.1038/s41586-019-1799-6 · Cited by 3,287 · cited 3×
“Database search strategies and PRISMA-S checklist are included in Supplementary Information.”
BackgroundInfluentialSelf-citationCONSORT 2010 statement: Updated guidelines for reporting parallel group randomised trials
Schulz, K. F., Altman, D. G., & Moher, D. (2010) · Journal of Pharmacology and Pharmacotherapeutics · doi:10.4103/0976-500x.72352 · Cited by 2,165
Self-citationLiu, X., Faes, L., Kale, A. U., Wagner, S. K., Fu, D. J., Bruynseels, A., Mahendiran, T., Moraes, G., Shamdas, M., Kern, C., et al. (2019) · The Lancet Digital Health · doi:10.1016/s2589-7500(19)30123-2 · Cited by 1,883 · cited 1×
“One signi fi cant barrier to adoption is the lack of high-quality evidence supporting their effectiveness, such as from randomised controlled trials (RCTs) performed in relevant clinical settings 4,5 .”
Self-citationLiu, X., Cruz Rivera, S., Moher, D., Calvert, M. J., Denniston, A. K., The SPIRIT-AI and CONSORT-AI Working Group, SPIRIT-AI and CONSORT-AI Steering Group, Chan, A.-W., Darzi, A., Holmes, C., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-1034-x · Cited by 1,421
Self-citationReducing waste from incomplete or unusable reports of biomedical research
Glasziou, P., Altman, D. G., Bossuyt, P., Boutron, I., Clarke, M., Julious, S., Michie, S., Moher, D., & Wager, E. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62228-x · Cited by 1,319 · cited 1×
“Incomplete or unclear reporting results in poor transparency of bias and research waste, leading to poor decision-making and non-reproducibility of fi ndings 6 .”
Self-citationCollins, G. S., Dhiman, P., Andaur Navarro, C. L., Ma, J., Hooft, L., Reitsma, J. B., Logullo, P., Beam, A. L., Peng, L., Van Calster, B., et al. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-048008 · Cited by 852
Self-citationYao, X., Rushlow, D. R., Inselman, J. W., McCoy, R. G., Thacher, T. D., Behnken, E. M., Bernard, M. E., Rosas, S. L., Akfaly, A., Misra, A., et al. (2021) · Nature Medicine · doi:10.1038/s41591-021-01335-4 · Cited by 424
Sounderajah, V., Ashrafian, H., Golub, R. M., Shetty, S., De Fauw, J., Hooft, L., Moons, K., Collins, G., Moher, D., Bossuyt, P. M., et al. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-047709 · Cited by 333
Self-citationStrohm, L., Hehakaya, C., Ranschaert, E. R., Boon, W. P. C., & Moors, E. H. M. (2020) · European Radiology · doi:10.1007/s00330-020-06946-y · Cited by 329
The shaky foundations of large language models and foundation models for electronic health records
Wornow, M., Xu, Y., Thapa, R., Patel, B., Steinberg, E., Fleming, S., Pfeffer, M. A., Fries, J., & Shah, N. H. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00879-8 · Cited by 324
Liu, H., Peng, H., Song, X., Xu, C., & Zhang, M. (2022) · Internet Interventions · doi:10.1016/j.invent.2022.100495 · Cited by 296
Artificial intelligence and colonoscopy experience: lessons from two randomised trials
Repici, A., Spadaccini, M., Antonelli, G., Correale, L., Maselli, R., Galtieri, P. A., Pellegatta, G., Capogreco, A., Milluzzo, S. M., Lollo, G., et al. (2022) · Gut · doi:10.1136/gutjnl-2021-324471 · Cited by 248
Randomized Clinical Trials of Machine Learning Interventions in Health Care: A Systematic Review
Plana, D., Shung, D. L., Grimshaw, A. A., Saraf, A., Sung, J. J. Y., & Kann, B. H. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2022.33946 · Cited by 236
Glissen Brown, J. R., Mansour, N. M., Wang, P., Chuchuca, M. A., Minchenberg, S. B., Chandnani, M., Liu, L., Gross, S. A., Sengupta, N., & Berzin, T. M. (2022) · Clinical Gastroenterology and Hepatology · doi:10.1016/j.cgh.2021.09.009 · Cited by 235
Jayakumar, P., Moore, M. G., Furlough, K. A., Uhler, L. M., Andrawis, J. P., Koenig, K. M., Aksan, N., Rathouz, P. J., & Bozic, K. J. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.37107 · Cited by 224
Xu, H., Tang, R. S. Y., Lam, T. Y. T., Zhao, G., Lau, J. Y. W., Liu, Y., Wu, Q., Rong, L., Xu, W., Li, X., et al. (2023) · Clinical Gastroenterology and Hepatology · doi:10.1016/j.cgh.2022.07.006 · Cited by 209
Klos, M. C., Escoredo, M., Joerin, A., Lemos, V. N., Rauws, M., & Bunge, E. L. (2021) · JMIR Formative Research · doi:10.2196/20678 · Cited by 200
Artificial intelligence for caries detection: Randomized trial
Mertens, S., Krois, J., Cantu, A. G., Arsiwala, L. T., & Schwendicke, F. (2021) · Journal of Dentistry · doi:10.1016/j.jdent.2021.103849 · Cited by 191
Shamseer, L., Hopewell, S., Altman, D. G., Moher, D., & Schulz, K. F. (2016) · Trials · doi:10.1186/s13063-016-1408-z · Cited by 168 · cited 1×
“Previous research on instructions for authors in high impact factor journals, in the context of CONSORT 2010, has shown that journal endorsement is sometimes lacking – especially in the endorsement of speci fi c extensions 75 .”
BackgroundSelf-citationWu, L., He, X., Liu, M., Xie, H., An, P., Zhang, J., Zhang, H., Ai, Y., Tong, Q., Guo, M., et al. (2021) · Endoscopy · doi:10.1055/a-1350-5583 · Cited by 168
Wu, L., Shang, R., Sharma, P., Zhou, W., Liu, J., Yao, L., Dong, Z., Yuan, J., Zeng, Z. R., Yu, Y., et al. (2021) · The Lancet. Gastroenterology & hepatology · doi:10.1016/s2468-1253(21)00216-8 · Cited by 168
An artificial intelligence decision support system for the management of type 1 diabetes
Tyler, N. S., Mosquera-Lopez, C. M., Wilson, L. M., Dodier, R. H., Branigan, D. L., Gabo, V. B., Guillot, F. H., Hilts, W. W., El Youssef, J., Castle, J. R., et al. (2020) · Nature Metabolism · doi:10.1038/s42255-020-0212-y · Cited by 163
Beaulieu-Jones, B. K., Yuan, W., Brat, G. A., Beam, A. L., Weber, G., Ruffin, M., & Kohane, I. S. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00426-3 · Cited by 155
Self-citationRein, M., Ben-Yacov, O., Godneva, A., Shilo, S., Zmora, N., Kolobkov, D., Cohen-Dolev, N., Wolf, B.-C., Kosower, N., Lotan-Pompan, M., et al. (2022) · BMC Medicine · doi:10.1186/s12916-022-02254-y · Cited by 149
Shaukat, A., Lichtenstein, D. R., Somers, S. C., Chung, D. C., Perdue, D. G., Gopal, M., Colucci, D. R., Phillips, S. A., Marka, N. A., Church, T. R., et al. (2022) · Gastroenterology · doi:10.1053/j.gastro.2022.05.028 · Cited by 147
Blomberg, S. N., Christensen, H. C., Lippert, F., Ersbøll, A. K., Torp-Petersen, C., Sayre, M. R., Kudenchuk, P. J., & Folke, F. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.32320 · Cited by 138
Anan, T., Kajiki, S., Oka, H., Fujii, T., Kawamata, K., Mori, K., & Matsudaira, K. (2021) · JMIR mHealth and uHealth · doi:10.2196/27535 · Cited by 126
Levy, J., Álvarez, D., Rosenberg, A. A., Alexandrovich, A., del Campo, F., & Behar, J. A. (2021) · npj Digital Medicine · doi:10.1038/s41746-020-00373-5 · Cited by 125
Kamba, S., Tamai, N., Saitoh, I., Matsui, H., Horiuchi, H., Kobayashi, M., Sakamoto, T., Ego, M., Fukuda, A., Tonouchi, A., et al. (2021) · Journal of Gastroenterology · doi:10.1007/s00535-021-01808-w · Cited by 124
Piette, J. D., Newman, S., Krein, S. L., Marinec, N., Chen, J., Williams, D. A., Edmond, S. N., Driscoll, M., LaChappelle, K. M., Kerns, R. D., et al. (2022) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2022.3178 · Cited by 124
Randomized Controlled Trials of Artificial Intelligence in Clinical Practice: Systematic Review
Lam, T. Y. T., Cheung, M. F. K., Munro, Y. L., Lim, K. M., Shung, D., & Sung, J. J. Y. (2022) · Journal of Medical Internet Research · doi:10.2196/37188 · Cited by 120
Yao, L., Zhang, L., Liu, J., Zhou, W., He, C., Zhang, J., Wu, L., Wang, H., Xu, Y., Gong, D., et al. (2022) · Endoscopy · doi:10.1055/a-1706-6174 · Cited by 116
Approaching autonomy in medical artificial intelligence
Bitterman, D. S., Aerts, H. J. W. L., & Mak, R. H. (2020) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30187-4 · Cited by 107
Medina, R., Bouhaben, J., de Ramón, I., Cuesta, P., Antón‐Toro, L. F., Pacios, J., Quintero, J., Ramos‐Quiroga, J. A., & Maestú, F. (2021) · Journal of Medical Internet Research · doi:10.2196/25466 · Cited by 106
Liu, P., Wang, P., Glissen Brown, J. R., Berzin, T. M., Zhou, G., Liu, W., Xiao, X., Chen, Z., Zhang, Z., Zhou, C., et al. (2020) · Therapeutic Advances in Gastroenterology · doi:10.1177/1756284820979165 · Cited by 93
Self-citationEng, D. K., Khandwala, N. B., Long, J., Fefferman, N. R., Lala, S. V., Strubel, N. A., Milla, S. S., Filice, R. W., Sharp, S. E., Towbin, A. J., et al. (2021) · Radiology · doi:10.1148/radiol.2021204021 · Cited by 84
Seol, H. Y., Shrestha, P., Muth, J. F., Wi, C.-I., Sohn, S., Ryu, E., Park, M., Ihrke, K., Moon, S., King, K., et al. (2021) · PLOS ONE · doi:10.1371/journal.pone.0255261 · Cited by 82
Mathenge, W., Whitestone, N., Nkurikiye, J., Patnaik, J. L., Piyasena, P., Uwaliraye, P., Lanouette, G., Kahook, M. Y., Cherwek, D. H., Congdon, N., et al. (2022) · Ophthalmology Science · doi:10.1016/j.xops.2022.100168 · Cited by 80
Gimeno-García, A. Z., Hernández Negrin, D., Hernández, A., Nicolás-Pérez, D., Rodríguez, E., Montesdeoca, C., Alarcon, O., Romero, R., Baute Dorta, J. L., Cedrés, Y., et al. (2023) · Gastrointestinal Endoscopy · doi:10.1016/j.gie.2022.09.029 · Cited by 78
Han, S. S., Kim, Y. J., Moon, I. J., Jung, J. M., Lee, M. Y., Lee, W. J., Won, C. H., Lee, M. W., Kim, S. H., Navarrete-Dechent, C., et al. (2022) · Journal of Investigative Dermatology · doi:10.1016/j.jid.2022.02.003 · Cited by 75
MacPherson, P., Webb, E. L., Kamchedzera, W., Joekes, E., Mjoli, G., Lalloo, D. G., Divala, T. H., Choko, A. T., Burke, R. M., Maheswaran, H., et al. (2021) · PLOS Medicine · doi:10.1371/journal.pmed.1003752 · Cited by 69
Itoh, N., Mishima, H., Yoshida, Y., Yoshida, M., Oka, H., & Matsudaira, K. (2022) · JMIR mhealth and uhealth · doi:10.2196/35867 · Cited by 69
Rondonotti, E., Di Paolo, D., Rizzotto, E. R., Alvisi, C., Buscarini, E., Spadaccini, M., Tamanini, G., Paggi, S., Amato, A., Scardino, G., et al. (2022) · Endoscopy · doi:10.1055/a-1849-6878 · Cited by 66
Chiang, P.-H., Wong, M., & Dey, S. (2021) · IEEE Journal of Translational Engineering in Health and Medicine · doi:10.1109/jtehm.2021.3098173 · Cited by 64
Shen, K., Huang, C., Lin, Y., Du, J., Chen, F., Kabasawa, Y., Chen, C., & Huang, H. (2022) · Journal of Clinical Periodontology · doi:10.1111/jcpe.13675 · Cited by 64
Horne, B. D., Muhlestein, J. B., Lappé, D. L., May, H. T., Le, V. T., Bair, T. L., Babcock, D., Bride, D., Knowlton, K. U., & Anderson, J. L. (2022) · American Heart Journal · doi:10.1016/j.ahj.2021.11.001 · Cited by 63
Hassoon, A., Baig, Y., Naiman, D. Q., Celentano, D. D., Lansey, D., Stearns, V., Coresh, J., Schrack, J., Martin, S. S., Yeh, H.-C., et al. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00539-9 · Cited by 63
Yacoub, B., Varga-Szemes, A., Schoepf, U. J., Kabakus, I. M., Baruah, D., Burt, J. R., Aquino, G. J., Sullivan, A. K., Doherty, J. O., Hoelzer, P., et al. (2022) · American Journal of Roentgenology · doi:10.2214/ajr.22.27598 · Cited by 61
Xu, L., He, X., Zhou, J., Zhang, J., Mao, X., Ye, G., Chen, Q., Xu, F., Sang, J., Wang, J., et al. (2021) · Cancer Medicine · doi:10.1002/cam4.4261 · Cited by 59
Levivien, C., Cavagna, P., Grah, A., Buronfosse, A., Courseau, R., Bézie, Y., & Corny, J. (2022) · International Journal of Clinical Pharmacy · doi:10.1007/s11096-021-01366-4 · Cited by 58
Kariyawasam, D., Morin, C., Casteels, K., Le Tallec, C., Sfez, A., Godot, C., Huneker, E., Garrec, N., Benhamou, P.-Y., Polak, M., et al. (2022) · The Lancet Digital Health · doi:10.1016/s2589-7500(21)00271-5 · Cited by 57
Bai, Y., Liu, F., & Zhang, H. (2022) · Computational and Mathematical Methods in Medicine · doi:10.1155/2022/2688003 · Cited by 55
Harada, Y., Katsukura, S., Kawamura, R., & Shimizu, T. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18042086 · Cited by 44
Luštrek, M., Bohanec, M., Barca, C. C., Ciancarelli, M. C., Clays, E., Dawodu, A. A., Derboven, J., Smedt, D. D., Dovgan, E., Lampe, J., et al. (2021) · JMIR Medical Informatics · doi:10.2196/24501 · Cited by 43
Can AI make people happy? The effect of AI-based chatbot on smile and speech in Parkinson's disease
Ogawa, M., Oyama, G., Morito, K., Kobayashi, M., Yamada, Y., Shinkawa, K., Kamo, H., Hatano, T., & Hattori, N. (2022) · Parkinsonism & Related Disorders · doi:10.1016/j.parkreldis.2022.04.018 · Cited by 43
Hill, N. R., Groves, L., Dickerson, C., Ochs, A., Pang, D., Lawton, S., Hurst, M. A., Pollock, K. G., Sugrue, D., Tsang, C., et al. (2022) · European Heart Journal - Digital Health · doi:10.1093/ehjdh/ztac009 · Cited by 40
Shahzad, R., Ayub, B., & Siddiqui, M. A. R. (2022) · BMJ Open · doi:10.1136/bmjopen-2022-061519 · Cited by 38
Avari, P., Leal, Y., Herrero, P., Wos, M., Jugnee, N., Arnoriaga-Rodríguez, M., Thomas, M., Liu, C., Massana, Q., Lopez, B., et al. (2021) · Diabetes Technology & Therapeutics · doi:10.1089/dia.2020.0301 · Cited by 37
Noriega-Campero, A., Meizner, D., Camacho‐García‐Formentí, D., Enciso, J., Quiroz-Mercado, H., Morales-Cantón, V., Almaatouq, A., & Pentland, A. (2021) · JMIR Formative Research · doi:10.2196/25290 · Cited by 30
Hong, L., Cheng, X., & Zheng, D. (2021) · Contrast Media & Molecular Imaging · doi:10.1155/2021/6423398 · Cited by 30
Li, X., Tian, D., Li, W., Hu, Y., Dong, B., Wang, H., Yuan, J., Li, B., Mei, H., Tong, S., et al. (2022) · Frontiers in Pediatrics · doi:10.3389/fped.2022.929834 · Cited by 30
Lu, Y., Lu, S., Huang, Y., Cai, S., Le, P., Hsu, F., Hu, Y., Hsieh, H., Chen, W.-T., Xia, G., et al. (2022) · The American Journal of Gastroenterology · doi:10.14309/ajg.0000000000001900 · Cited by 27
Wang, X., Xie, Y., Zheng, X., Liu, B., Chen, H., Li, J., Ma, X., Xiang, J., Weng, G., Zhu, W., et al. (2022) · World Journal of Urology · doi:10.1007/s00345-022-04086-0 · Cited by 27
Chen, J., & Gao, Y. (2021) · Journal of Healthcare Engineering · doi:10.1155/2021/4845792 · Cited by 25 · cited 1×
“12,15,27,29,30,37 – 41, 43, 59 – MediansamplesizeacrossallincludedRCTswas186(IQR56-654).”
Liu, Y., & Cheng, L. (2021) · Journal of Healthcare Engineering · doi:10.1155/2021/6231116 · Cited by 25
Smart Glasses: A New Tool for Assessing the Number of Patients in Mass-Casualty Incidents
Apiratwarakul, K., Cheung, L. W., Tiamkao, S., Phungoen, P., Tientanopajai, K., Taweepworadej, W., Kanarkard, W., & Ienghong, K. (2022) · Prehospital and Disaster Medicine · doi:10.1017/s1049023x22000929 · Cited by 24
Yang, J., Cui, Z., Liao, X., He, X., Wang, L., Wei, D., Wu, S., & Chang, Y. (2023) · Journal of Global Antimicrobial Resistance · doi:10.1016/j.jgar.2023.02.006 · Cited by 23
Liu, Z., Chen, W., Guan, H., Zhen, H., Shen, J., Liu, X., Liu, A., Li, R., Geng, J., You, J., et al. (2021) · Frontiers in Oncology · doi:10.3389/fonc.2021.702270 · Cited by 21 · cited 1×
“12,15,27,29,30,37 – 41, 43, 59 – MediansamplesizeacrossallincludedRCTswas186(IQR56-654).”
Self-citationTurnin, M.-C., Gourdy, P., Martini, J., Buisson, J.-C., Chauchard, M.-C., Delaunay, J., Schirr-Bonnans, S., Taoui, S., Poncet, M.-F., Cosma, V., et al. (2021) · Diabetes Therapy · doi:10.1007/s13300-021-01095-x · Cited by 20
Portable Device Improves the Detection of Atrial Fibrillation After Ablation
Huang, S., Zhao, T., Liu, C., Qin, A., Dong, S., Yuan, B., Xing, W., Guo, Z., Huang, X., Cha, Y., et al. (2021) · International Heart Journal · doi:10.1536/ihj.21-067 · Cited by 19
Bamiou, D., Kikidis, D., Bibas, A. G., Koohi, N., Macdonald, N., Maurer, C., Wuyts, F. L., Ihtijarevic, B., Celis, L., Mucci, V., et al. (2021) · Journal of Neurology · doi:10.1007/s00415-021-10829-7 · Cited by 18
Wang, L., Song, H., Wang, M., Wang, H., Ge, R., Shen, Y., & Yu, Y. (2021) · Journal of Healthcare Engineering · doi:10.1155/2021/2773022 · Cited by 18
Beaufort, L.-M. D., Nasr, B., Corvec, T. L., Brisard, L., Guyomarch, B., Fellah, I., Postaire, B., Chaillou, P., Clough, R. E., & Maurel, B. (2021) · Annals of Vascular Surgery · doi:10.1016/j.avsg.2021.03.023 · Cited by 15
Dadon, Z., Butnaru, A., Rosenmann, D., Alper-Suissa, L., Glikson, M., & Alpert, E. A. (2022) · AEM Education and Training · doi:10.1002/aet2.10738 · Cited by 12
Huang, L., Liu, J., Wu, L., Xu, M., Yao, L., Zhang, L., Shang, R., Zhang, M., Xiong, Q., Wang, D., et al. (2021) · Frontiers in Medicine · doi:10.3389/fmed.2021.781256 · Cited by 9
Wang, J., Wu, S., Guo, Q., Lan, H., Janne, E., Wang, L., Zhang, J., Wang, Q., Song, Y., Yang, N., et al. (2021) · Intelligent Medicine · doi:10.1016/j.imed.2021.04.006 · Cited by 8
A language-matching model to improve equity and efficiency of COVID-19 contact tracing
Lu, L., Anderson, B., Ha, R., D’Agostino, A., Rudman, S. L., Ouyang, D., & Ho, D. E. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2109443118 · Cited by 8
Xu, J., Tian, F., Wang, L., & Miao, Z. (2022) · Contrast Media & Molecular Imaging · doi:10.1155/2022/5143757 · Cited by 6
Ghosh, A., Saha, A. P., Saha, S., & Das, A. (2022) · Studies in health technology and informatics · doi:10.3233/shti220352 · Cited by 5
Zhu, Y., Zhang, J., Ji, Z., Liu, W., Li, M., Xia, E., Zhang, J., & Wang, J. (2022) · Computational and Mathematical Methods in Medicine · doi:10.1155/2022/1116332 · Cited by 5
Yang, J., Cui, Z., Liao, X., He, X., Yu, S., Wei, D., Wu, S., & Chang, Y. (2022) · medRxiv · doi:10.1101/2022.07.14.22277620 · Cited by 2
Research works printed but not linked: 2
- Available from: https://link.springer.com/10.1007/s00345-022-04086-0 (2022). · DOI
- Lefebvre, C. et al. Chapter 4: Searching for and selecting studies. in Cochrane Handbook for Systematic Reviews of Interventions [Internet]. Version 6.3 (updated February 2022). Cochrane; 2022. Available from: www.training.cochrane.org/handbook.
Cited by
Tam, T. Y. C., Sivarajkumar, S., Kapoor, S., Stolyar, A. V., Polanska, K., McCarthy, K. R., Osterhoudt, H., Wu, X., Visweswaran, S., Fu, S., et al. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01258-7 · Cited by 424
AI, Health, and Health Care Today and Tomorrow: The JAMA Summit Report on Artificial Intelligence
Angus, D. C., Khera, R., Lieu, T., Liu, V., Ahmad, F. S., Anderson, B., Bhavani, S. V., Bindman, A., Brennan, T., Celi, L. A., et al. (2025) · JAMA · doi:10.1001/jama.2025.18490 · Cited by 195
Self-citationLiu, S., McCoy, A. B., & Wright, A. (2025) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaf008 · Cited by 200
“13 In addition, Tam et al. introduced QUEST, a framework specifically for human evaluation of LLMs in healthcare.”
Multimodal artificial intelligence in ophthalmology: Applications, challenges, and future directions
Jin, K., Yu, T., & Grzybowski, A. E. (2025) · Survey of Ophthalmology · doi:10.1016/j.survophthal.2025.07.003 · Cited by 52
El-Sayed, A., Lovat, L. B., & Ahmad, O. F. (2025) · Gastroenterology · doi:10.1053/j.gastro.2025.01.254 · Cited by 47
Metadata
- Authors
- Martindale, A. P. L., Llewellyn, C. D., de Visser, R. O., Ng, B., Ngai, V., Kale, A. U., di Ruffano, L. F., Golub, R. M., Collins, G. S., Moher, D., McCradden, M. D., Oakden-Rayner, L., Rivera, S. C., Calvert, M., Kelly, C. J., Lee, C. S., Yau, C., Chan, A.-W., Keane, P. A., Beam, A. L., Denniston, A. K., & Liu, X.
- Affiliations
- Brighton and Sussex Medical School (GB)
- University of Oxford (GB)
- University College London (GB)
- University Hospitals Birmingham NHS Foundation Trust (GB)
- Northwestern University (US)
- Ottawa Hospital Research Institute (CA)
- University of Toronto (CA)
- University of Birmingham (GB)
- National Institute for Health and Care Research (GB)
- Google (United Kingdom) (GB)
- University of Washington (US)
- Moorfields Eye Hospital NHS Foundation Trust (GB)
- Harvard University (US)
- Corresponding author
- Liu, Xiaoxuan
- ORCID
- Martindale, Alexander P. L.
- Llewellyn, Carrie D.
- Ng, Benjamin
- Ngai, Victoria
- Kale, Aditya U.
- di Ruffano, Lavinia Ferrante
- Collins, Gary S.
- Moher, David
- McCradden, Melissa D.
- Rivera, Samantha Cruz
- Calvert, Melanie
- Kelly, Christopher J.
- Lee, Cecilia S.
- Yau, Christopher
- Chan, An-Wen
- Keane, Pearse A.
- Beam, Andrew L.
- Denniston, Alastair K.
- Liu, Xiaoxuan
- Venue
- Nature Communications
- Published
- 2024-02-22
- Volume
- 15
- Issue
- 1
- Pages
- 1619-1619
- ISSN
- 2041-1723 (ISSN-L)
- PMC
- PMC10883966
- OpenAlex
- W4392058364
- Semantic Scholar
- 284bb9ee87010245a3237804f7f3adda2b6a327a
- Cited by
- 58
- References
- 87
- Citations by year
- 2026: 28 · 2025: 26 · 2024: 4
- FWCI
- 16.13
- Type
- journal article
- Language
- en
- Update notices
- correction (2024-07-29)
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Nature Communications (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (publishedVersion)
- University of Birmingham Research Portal (University of Birmingham) (publishedVersion, cc-by)
- UCL Discovery (University College London) (submittedVersion, cc-by)
- Adelaide Research & Scholarship (AR&S) (University of Adelaide) (submittedVersion, cc-by)
- Figshare (submittedVersion, cc-by)
- Funders
- Cancer Research UK (27294)
- National Institute for Health and Care Research (NIHR205109)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- CONSORT-AI, reporting guidelines, artificial intelligence interventions, randomized controlled trials, reporting completeness, guideline adherence, research transparency
- MeSH terms
- Artificial Intelligence, China, Humans, Research Design, Randomized Controlled Trials as Topic, Guidelines as Topic, Research Report
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.