Towards Accurate Differential Diagnosis with Large Language Models
Open accessAbstract
An accurate differential diagnosis (DDx) is a cornerstone of medical care, often reached through an iterative process of interpretation that combines clinical history, physical examination, investigations and procedures. Interactive interfaces powered by Large Language Models (LLMs) present new opportunities to both assist and automate aspects of this process. In this study, we introduce an LLM optimized for diagnostic reasoning, and evaluate its ability to generate a DDx alone or as an aid to clinicians. 20 clinicians evaluated 302 challenging, real-world medical cases sourced from the New England Journal of Medicine (NEJM) case reports. Each case report was read by two clinicians, who were randomized to one of two assistive conditions: either assistance from search engines and standard medical resources, or LLM assistance in addition to these tools. All clinicians provided a baseline, unassisted DDx prior to using the respective assistive tools. Our LLM for DDx exhibited standalone performance that exceeded that of unassisted clinicians (top-10 accuracy 59.1% vs 33.6%, [p = 0.04]). Comparing the two assisted study arms, the DDx quality score was higher for clinicians assisted by our LLM (top-10 accuracy 51.7%) compared to clinicians without its assistance (36.1%) (McNemar's Test: 45.7, p < 0.01) and clinicians with search (44.4%) (4.75, p = 0.03). Further, clinicians assisted by our LLM arrived at more comprehensive differential lists than those without its assistance. Our study suggests that our LLM for DDx has potential to improve clinicians' diagnostic reasoning and accuracy in challenging cases, meriting further real-world evaluation for its ability to empower physicians and widen patients' access to specialist-level expertise.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The LLM alone performed significantly better than both groups of humans.
“An unexpected secondary result was that the LLM alone performed significantly better than both groups of humans, similar to a recent study with different LLM technology.31”
From Large Language Model Influence on Diagnostic Reasoning: A Randomized Clinical Trial (2024) · cites this paper as [31]
The Results (p. 6) say the LLM’s accuracy exceeded clinicians’ scores in every condition, but report a statistically significant difference only against unassisted clinicians (p = 0.04). Table 1 (p. 8) also shows higher model-only accuracy than human accuracy, but does not establish significance against both human groups. (LLM, conf=0.87)
Experimental — accuracy not yet measuredThe study included 6 cases that could feasibly be completed within a single study session while remaining comparable to standard practices in national licensing and objective structured clinical examinations.
“Our study included 6 cases that could feasibly be completed within a single study session while remaining comparable to standard practices in national licensing and objective structured clinical examinations to use a small, but broad sample of clinical cases.6,46,47,48,49”
From Large Language Model Influence on Diagnostic Reasoning: A Randomized Clinical Trial (2024) · cites this paper as [46]
The six cases are described as belonging to the citing authors’ own study, not McDuff et al.’s. McDuff et al. describe a set of 302 cases spanning medical specialties (Section 2, p. 3), but our copy does not address whether six cases can be completed in one session or are comparable to national licensing or objective structured clinical examinations. Searches for those terms and for six cases found no supporting passage. (LLM, conf=0.76)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148 · see citing works
MIMIC-III, a freely accessible critical care database
Johnson, A. E. W., Pollard, T. J., Shen, L., Lehman, L.-W. H., Feng, M., Ghassemi, M., Moody, B., Szolovits, P., Anthony Celi, L., & Mark, R. G. (2016) · Scientific Data · doi:10.1038/sdata.2016.35 · Cited by 8,141 · see citing works
Dissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137 · see citing works
Large language models encode clinical knowledge
Singhal, K., Azizi, S., Tu, T., Mahdavi, S. S., Wei, J., Chung, H. W., Scales, N., Tanwani, A., Cole-Lewis, H., Pfohl, S., et al. (2023) · Nature · doi:10.1038/s41586-023-06291-2 · Cited by 4,083 · see citing works
Self-citationLlama 2: Open Foundation and Fine-Tuned Chat Models
Touvron, H., Martin, L., Stone, K., Albert, P., Almahairi, A., Babaei, Y., Bashlykov, N., Batra, S., Bhargava, P., Bhosale, S., et al. (2023) · arXiv · doi:10.48550/arxiv.2307.09288 · Cited by 2,604 · see citing works
Reasoning Foundations of Medical Diagnosis
Ledley, R. S., & Lusted, L. B. (1959) · Science · doi:10.1126/science.130.3366.9 · Cited by 998 · see citing works
Seyyed-Kalantari, L., Zhang, H., McDermott, M. B. A., Chen, I. Y., & Ghassemi, M. (2021) · Nature Medicine · doi:10.1038/s41591-021-01595-0 · Cited by 928 · see citing works
A deep learning system for differential diagnosis of skin diseases
Liu, Y., Jain, A., Eng, C., Way, D. H., Lee, K., Bui, P., Kanada, K., de Oliveira Marinho, G., Gallegos, J., Gabriele, S., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-0842-3 · Cited by 853 · see citing works
Self-citationAnil, R., Dai, A. M., Firat, O., Johnson, M., Lepikhin, D., Passos, A., Shakeri, S., Taropa, E., Bailey, P., Chen, Z., et al. (2023) · arXiv · doi:10.48550/arxiv.2305.10403 · Cited by 834 · see citing works
Self-citationJin, D., Pan, E., Oufattole, N., Weng, W.-H., Fang, H., & Szolovits, P. (2021) · Applied Sciences · doi:10.3390/app11146421 · Cited by 718 · see citing works
The Quadruple Aim: care, health, cost and meaning in work
Sikka, R., Morath, J. M., & Leape, L. L. (2015) · BMJ Quality & Safety · doi:10.1136/bmjqs-2015-004160 · Cited by 691 · see citing works
Muehlematter, U. J., Daniore, P., & Vokinger, K. N. (2021) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30292-2 · Cited by 665 · see citing works
Cai, C. J., Winter, S., Steiner, D., Wilcox, L., & Terry, M. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359206 · Cited by 594 · see citing works
LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Day
Li, C., Wong, C., Zhang, S., Usuyama, N., Liu, H., Yang, J., Naumann, T., Poon, H., & Gao, J. (2023) · neural information processing systems · doi:10.52202/075280-1240 · Cited by 590 · see citing works
Do as AI say: susceptibility in deployment of clinical decision-aids
Gaube, S., Suresh, H., Raue, M., Merritt, A., Berkowitz, S. J., Lermer, E., Coughlin, J. F., Guttag, J. V., Colak, E., & Ghassemi, M. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00385-9 · Cited by 543 · see citing works
Capabilities of GPT-4 on Medical Challenge Problems
Nori, H., King, N., McKinney, S. M., Carignan, D., & Horvitz, E. (2023) · arXiv · doi:10.48550/arxiv.2303.13375 · Cited by 509 · see citing works
Towards Generalist Biomedical AI
Tu, T., Azizi, S., Driess, D., Schaekermann, M., Amin, M., Chang, P.-C., Carroll, A., Lau, C., Tanno, R., Ktena, I., et al. (2024) · NEJM AI · doi:10.1056/aioa2300138 · Cited by 483 · see citing works
Self-citationAccuracy of a Generative Artificial Intelligence Model in a Complex Diagnostic Challenge
Kanjee, Z., Crowe, B., & Rodman, A. (2023) · JAMA · doi:10.1001/jama.2023.8288 · Cited by 449 · see citing works
Categorical and probabilistic reasoning in medical diagnosis
Szolovits, P., & Pauker, S. G. (1978) · Artificial Intelligence · doi:10.1016/0004-3702(78)90014-0 · Cited by 413 · see citing works
Towards conversational diagnostic artificial intelligence
Tu, T., Schaekermann, M., Palepu, A., Saab, K., Freyberg, J., Tanno, R., Wang, A., Li, B., Amin, M., Cheng, Y., et al. (2025) · Nature · doi:10.1038/s41586-025-08866-7 · Cited by 366 · see citing works
Self-citationUse of gpt-4 to diagnose complex clinical cases
Eriksen, A. V., Möller, S., & Ryg, J. (2024) · NEJM AI · doi:10.1056/aip2300031 · Cited by 200 · see citing works
Rauschecker, A. M., Rudie, J. D., Xie, L., Wang, J., Duong, M. T., Botzolakis, E. J., Kovalovich, A. M., Egan, J., Cook, T. C., Bryan, R. N., et al. (2020) · Radiology · doi:10.1148/radiol.2020190283 · Cited by 148 · cited 1× · see citing works
“Deep learning has been applied to promising effect for generating DDx in a number of specialties including radiology 4 , ophthalmology 5 and dermatology 3 , but such systems lack the interactive capabilities to fluently assist a user through communication in natural language.”
Dvijotham, K., Winkens, J., Barsbey, M., Ghaisas, S., Stanforth, R., Pawlowski, N., Strachan, P., Ahmed, Z., Azizi, S., Bachrach, Y., et al. (2023) · Nature Medicine · doi:10.1038/s41591-023-02437-x · Cited by 136 · see citing works
Self-citationDifferential Diagnosis Generators: an Evaluation of Currently Available Computer Programs
Bond, W. F., Schwartz, L. M., Weaver, K., Levick, D., Giuliano, M., & Graber, M. L. (2011) · Journal of General Internal Medicine · doi:10.1007/s11606-011-1804-8 · Cited by 132 · see citing works
Balas, M., & Ing, E. B. (2023) · JFO Open Ophthalmology · doi:10.1016/j.jfop.2023.100005 · Cited by 110 · see citing works
Overbooked and Overlooked: Machine Learning and Racial Bias in Medical Appointment Scheduling
Samorani, M., Harris, S. L., Blount, L. G., Lu, H., & Santoro, M. A. (2021) · Manufacturing & Service Operations Management · doi:10.1287/msom.2021.0999 · Cited by 94 · see citing works
Do Large Language Models Know What They Don’t Know?
Yin, Z., Sun, Q., Guo, Q., Wu, J., Qiu, X., & Huang, X. (2023) · Findings of the Association for Computational Linguistics: ACL 2023 · doi:10.18653/v1/2023.findings-acl.551 · Cited by 75 · see citing works
INTERNIST-I, An Experimental Computer-Based Diagnostic Consultant for General Internal Medicine
Miller, R. A., Pople, H. E., & Myers, J. D. (1985) · Computers and medicine · doi:10.1007/978-1-4612-5108-8_8 · Cited by 58 · see citing works
Automatic correction of performance drift under acquisition shift in medical image classification
Roschewitz, M., Khara, G., Yearsley, J. E., Sharma, N., James, J. J., Ambrózay, É., Heroux, A. M., Kecskemethy, P., Rijken, T., & Glocker, B. (2023) · Nature Communications · doi:10.1038/s41467-023-42396-y · Cited by 56 · see citing works
Generative Relevance Feedback with Large Language Models
Mackie, I., Chatterjee, S., & Dalton, J. (2023) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3539618.3591992 · Cited by 54 · see citing works
Multimodal foundation models exploit text to make medical image predictions
Buckley, T. A., Diao, J. A., Srivastava, C. N., Brodeur, P. G., Rajpurkar, P., Rodman, A. M., & Manrai, A. K. (2026) · Nature Communications · doi:10.1038/s41467-026-74207-5 · Cited by 18 · see citing works
Fritz, P., Kleinhans, A., Raoufi, R., Sediqi, A., Schmid, N., Schricker, S., Schanz, M., Fritz-Kuisle, C., Dalquen, P., Firooz, H., et al. (2022) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-022-01988-2 · Cited by 16 · see citing works
Active Acquisition for Multimodal Temporal Data: A Challenging Decision-Making TaskPreprint
Kossen, J., Cangea, C., Vértes, E., Jaegle, A., Pătrăucean, V., Ktena, S. I., Tomašev, N., & Belgrave, D. C. M. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2211.05039 · Cited by 2 · see citing works
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
Workshop, B., :, Scao, T. L., Fan, A., Akiki, C., Pavlick, E., Ilić, S., Hesslow, D., Castagné, R., Luccioni, A. S., et al. (2022) · arXiv · doi:10.48550/arxiv.2211.05100
Flagged first, then by citations
Research works printed but not linked: 5
- [6]6. OpenAI. GPT-4 Technical Report 2023. arXiv: 2303.08774 [cs.CL] . · arXiv
- [13]13. Buckley, T., Diao, J. A., Rodman, A. & Manrai, A. K. Accuracy of a Vision-Language Model on Challenging Medical Cases 2023. arXiv: 2311.05591 [cs.CV] . · arXiv
- [17]17. Hong, J., Levine, S. & Dragan, A. Zero-Shot Goal-Directed Dialogue via RL on Imagined Conversations. arXiv preprint arXiv:2311.05584 (2023). · arXiv
- [21]21. Miller, R. A., Pople Jr, H. E. & Myers, J. D. in Computer-assisted medical decision making 139-158 (Springer, 1985).
- [30]30. Umapathi, L. K., Pal, A. & Sankarasubbu, M. Med-halt: Medical domain hallucination test for large language models. arXiv preprint arXiv:2307.15343 (2023). · arXiv
Cited by
Sorted by citations
Evaluation and mitigation of the limitations of large language models in clinical decision-making
Hager, P., Jungmann, F., Holland, R., Bhagat, K., Hubrecht, I., Knauer, M., Vielhauer, J., Makowski, M., Braren, R., Kaissis, G., et al. (2024) · Nature Medicine · doi:10.1038/s41591-024-03097-1 · Cited by 798 · see citing works
“LLMs can summarize reports 3–5 , generate reports 2,4 , serve as diagnostic assistants 21,27 and could ultimately autonomously diagnose patients.”
Large Language Model Influence on Diagnostic Reasoning: A Randomized Clinical Trial
Goh, E., Gallo, R., Hom, J., Strong, E., Weng, Y., Kerman, H., Cool, J. A., Kanjee, Z., Parsons, A. S., Ahuja, N., et al. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.40969 · Cited by 724 · see citing works
Towards conversational diagnostic artificial intelligence
Tu, T., Schaekermann, M., Palepu, A., Saab, K., Freyberg, J., Tanno, R., Wang, A., Li, B., Amin, M., Cheng, Y., et al. (2025) · Nature · doi:10.1038/s41586-025-08866-7 · Cited by 366 · see citing works
“Previous research has shown that AI systems may match or exceed human diagnostic performance in specific, narrow tasks 21,22 in retrospective evaluation.”
Self-citationCurrent applications and challenges in large language models for patient care: a systematic review
Busch, F., Hoffmann, L., Rueger, C., van Dijk, E. H., Kader, R., Ortiz-Prado, E., Makowski, M. R., Saba, L., Hadamitzky, M., Kather, J. N., et al. (2025) · Communications Medicine · doi:10.1038/s43856-024-00717-2 · Cited by 358 · see citing works
The Opportunities and Risks of Large Language Models in Mental Health
Lawrence, H. R., Schneider, R. A., Rubin, S. B., Matarić, M. J., McDuff, D. J., & Jones Bell, M. (2024) · JMIR Mental Health · doi:10.2196/59479 · Cited by 235 · see citing works
Self-citationEducational Strategies for Clinical Supervision of Artificial Intelligence Use
Abdulnour, R.-E. E., Gin, B., & Boscardin, C. K. (2025) · New England Journal of Medicine · doi:10.1056/nejmra2503232 · Cited by 209 · see citing works
Goh, E., Gallo, R. J., Strong, E., Weng, Y., Kerman, H. M., Freed, J. A., Cool, J. A., Kanjee, Z., Lane, K. P., Parsons, A. S., et al. (2025) · Nature Medicine · doi:10.1038/s41591-024-03456-y · Cited by 179 · see citing works
Masanneck, L., Schmidt, L., Seifert, A., Kölsche, T., Huntemann, N., Jansen, R., Mehsin, M., Bernhard, M., Meuth, S. G., Böhm, L., et al. (2024) · Journal of Medical Internet Research · doi:10.2196/53297 · Cited by 130 · see citing works
Large language models for disease diagnosis: a scoping review
Zhou, S., Xu, Z., Zhang, M., Xu, C., Guo, Y., Zhan, Z., Fang, Y., Ding, S., Wang, J., Xu, K., et al. (2025) · npj Artificial Intelligence · doi:10.1038/s44387-025-00011-z · Cited by 143 · see citing works
A toolbox for surfacing health equity harms and biases in large language models
Pfohl, S. R., Cole-Lewis, H., Sayres, R., Neal, D., Asiedu, M., Dieng, A., Tomasev, N., Rashid, Q. M., Azizi, S., Rostamzadeh, N., et al. (2024) · Nature Medicine · doi:10.1038/s41591-024-03258-2 · Cited by 113 · see citing works
Self-citationCapabilities of Gemini Models in Medicine
Saab, K., Tu, T., Weng, W.-H., Tanno, R., Stutz, D., Wulczyn, E., Zhang, F., Strother, T., Park, C., Vedadi, E., et al. (2024) · arXiv · doi:10.48550/arxiv.2404.18416 · Cited by 117 · see citing works
Self-citationApplication of large language models in medicine
Liu, F., Zhou, H., Gu, B., Zou, X., Huang, J., Wu, J., Li, Y., Chen, S. S., Hua, Y., Zhou, P., et al. (2025) · Nature Reviews Bioengineering · doi:10.1038/s44222-025-00279-5 · Cited by 94 · see citing works
Savage, T., Wang, J., Gallo, R., Boukil, A., Patel, V., Safavi-Naini, S. A. A., Soroush, A., & Chen, J. H. (2025) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocae254 · Cited by 92 · see citing works
LLM-assisted systematic review of large language models in clinical medicine
Chen, S. F., Alyakin, A., Seas, A., Yang, E., Choi, J. J., Lee, J. V., Chen, A. L., Warman, P. I., Bitolas, R., Steele, R. J., et al. (2026) · Nature Medicine · doi:10.1038/s41591-026-04229-5 · Cited by 88 · see citing works
Jung, K.-H. (2025) · Healthcare Informatics Research · doi:10.4258/hir.2025.31.2.114 · Cited by 77 · see citing works
Medical foundation large language models for comprehensive text analysis and beyond
Xie, Q., Chen, Q., Chen, A., Peng, C., Hu, Y., Lin, F., Peng, X., Huang, J., Zhang, J., Keloth, V., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01533-1 · Cited by 74 · see citing works
Generative artificial intelligence, patient safety and healthcare quality: a review
Howell, M. D. (2024) · BMJ Quality & Safety · doi:10.1136/bmjqs-2023-016690 · Cited by 72 · see citing works
Performance of a large language model on the reasoning tasks of a physician
Brodeur, P. G., Buckley, T. A., Kanjee, Z., Goh, E., Ling, E., Jain, P., Cabral, S., Abdulnour, R.-E. E., Haimovich, A. D., Freed, J. A., et al. (2026) · Science · doi:10.1126/science.adz4433 · Cited by 135 · see citing works
An agentic system for rare disease diagnosis with traceable reasoning
Zhao, W., Wu, C., Fan, Y., Qiu, P., Zhang, X., Sun, Y., Zhou, X., Zhang, S., Peng, Y., Wang, Y., et al. (2026) · Nature · doi:10.1038/s41586-025-10097-9 · Cited by 62 · see citing works
Hadweh, P., Niset, A., Salvagno, M., Barajraji, M. A., Hadwe, S. E., Taccone, F. S., & Barrit, S. (2025) · Journal of Clinical Medicine · doi:10.3390/jcm14124026 · Cited by 66 · see citing works
A personal health large language model for sleep and fitness coaching
Khasentino, J., Belyaeva, A., Liu, X., Yang, Z., Furlotte, N. A., Lee, C., Schenck, E., Patel, Y., Cui, J. H., Schneider, L. D., et al. (2025) · Nature Medicine · doi:10.1038/s41591-025-03888-0 · Cited by 104 · see citing works
Self-citationAn eyecare foundation model for clinical assistance: a randomized controlled trial
Wu, Y.-L., Qian, B., Li, T., Qin, Y., Guan, Z., Chen, T., Jia, Y., Zhang, P., Zeng, D., Moroi, S. E., et al. (2025) · Nature Medicine · doi:10.1038/s41591-025-03900-7 · Cited by 60 · see citing works
Kim, J., Wang, K., Weng, C., & Liu, C. (2024) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2024.08.010 · Cited by 53 · see citing works
Large models in medical imaging: Advances and prospects
Fang, M., Wang, Z., Pan, S., Feng, X., Zhao, Y., Hou, D., Wu, L., Xie, X., Zhang, X.-Y., Tian, J., et al. (2025) · Chinese Medical Journal · doi:10.1097/cm9.0000000000003699 · Cited by 39 · see citing works
Influence of a Large Language Model on Diagnostic Reasoning: A Randomized Clinical Vignette Study
Goh, E., Gallo, R., Hom, J., Strong, E., Weng, Y., Kerman, H., Cool, J., Kanjee, Z., Parsons, A. S., Ahuja, N., et al. (2024) · doi:10.1101/2024.03.12.24303785 · Cited by 38 · see citing works
Human–large language model collaboration in clinical medicine: a systematic review and meta-analysis
Wang, G., Zhang, K., Jiang, J., Wang, C., Bi, H., Liang, H., Qi, Z., Huang, Y., Li, Y., & Yang, X. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02382-2 · Cited by 42 · see citing works
Large language models for clinical decision support in gastroenterology and hepatology
Wiest, I. C., Bhat, M., Clusmann, J., Schneider, C. V., Jiang, X., & Kather, J. N. (2025) · Nature Reviews Gastroenterology & Hepatology · doi:10.1038/s41575-025-01108-1 · Cited by 33 · see citing works
Scott, I. A., & Zuccon, G. (2024) · Internal Medicine Journal · doi:10.1111/imj.16393 · Cited by 30 · see citing works
Automating expert-level medical reasoning evaluation of large language models
Zhou, S., Xie, W., Li, J., Zhan, Z., Song, M., Yang, H., Espinoza, C., Welton, L., Mai, X., Jin, Y., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-02208-7 · Cited by 30 · see citing works
Chitoran, E., Rotaru, V., Gelal, A., Ionescu, S. O., Gullo, G., Stefan, D. C., & Simion, L. (2025) · Diagnostics · doi:10.3390/diagnostics15182391 · Cited by 30 · see citing works
Transforming wearable data into personal health insights using large language model agents
Merrill, M. A., Paruchuri, A., Rezaei, N., Kovacs, G., Perez, J., Liu, Y., Schenck, E., Hammerquist, N., Sunshine, J., Tailor, S. A., et al. (2026) · Nature Communications · doi:10.1038/s41467-025-67922-y · Cited by 53 · see citing works
Self-citationQazi, I. A., Ali, A., Khawaja, A. U., Akhtar, M. J., Sheikh, A. Z., & Alizai, M. H. (2026) · NEJM AI · doi:10.1056/aioa2501001 · Cited by 37 · see citing works
Generative artificial intelligence: implications for biomedical and health professions education
Hersh, W. (2025) · Annual Review of Biomedical Data Science · doi:10.1146/annurev-biodatasci-103123-094756 · Cited by 28 · see citing works
A large language model for complex cardiology care
O’Sullivan, J. W., Palepu, A. K., Saab, K. K., Weng, W., Amponsah, D., Cheng, E., Cheng, Y., Chu, E. L., Desai, Y. B., Elezaby, A., et al. (2026) · Nature Medicine · doi:10.1038/s41591-025-04190-9 · Cited by 33 · see citing works
Self-citationEverett, S., Bunning, B., Jain, P., López, I., Agarwal, A., Desai, M., Gallo, R. J., Goh, E., Kadiyala, V. B., Kanjee, Z., et al. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02545-1 · Cited by 56 · see citing works
Uncertainty-aware large language models for explainable disease diagnosis
Zhou, S., Wang, J., Xu, Z., Wang, S., Brauer, D., Welton, L., Cogan, J., Chung, Y.-H., Tian, L., Zhan, Z., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-02071-6 · Cited by 27 · see citing works
Wang, S., Tang, Z., Yang, H., Gong, Q., Gu, T., Ma, H., Wang, Y., Sun, W., Lian, Z., Mao, K., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-02277-8 · Cited by 33 · see citing works
Self-citationData-Centric Foundation Models in Computational Healthcare: A Survey
Zhang, Y., Gao, J. G., Tan, Z., Zhou, L., Ding, K., Zhou, M., Zhang, S., & Wang, D. (2026) · ACM Computing Surveys · doi:10.1145/3800677 · Cited by 42 · see citing works
Combining Multiple Large Language Models Improves Diagnostic Accuracy
Barabucci, G., Shia, V., Chu, E., Harack, B., Laskowski, K., & Fu, N. (2024) · NEJM AI · doi:10.1056/aics2400502 · Cited by 24 · see citing works
Artificial intelligence agents in cancer research and oncology
Truhn, D., Azizi, S., Zou, J., Cerdá-Alberich, L., Mahmood, F., & Kather, J. N. (2026) · Nature reviews. Cancer · doi:10.1038/s41568-025-00900-0 · Cited by 25 · see citing works
Self-citationBhasuran, B., Jin, Q., Xie, Y., Yang, C., Hanna, K., Costa, J., Shavor, C., Han, W., Lu, Z., & He, Z. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01556-8 · Cited by 25 · see citing works
Transforming mental health research and care through artificial intelligence
Opel, N., & Breakspear, M. J. (2026) · Science · doi:10.1126/science.adz9193 · Cited by 25 · see citing works
Patient agency and large language models in worldwide encoding of equity
Armoundas, A. A., & Loscalzo, J. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01598-y · Cited by 22 · see citing works
EndoChat: Grounded multimodal large language model for endoscopic surgery
Wang, G., Bai, L., Wang, J., Yuan, K., Li, Z., Jiang, T., He, X., Wu, J., Chen, Z., Lei, Z., et al. (2025) · Medical Image Analysis · doi:10.1016/j.media.2025.103789 · Cited by 32 · see citing works
Qazi, I. A., Ali, A., Khawaja, A. U., Akhtar, M. J., Sheikh, A. Z., & Alizai, M. H. (2026) · Nature Health · doi:10.1038/s44360-025-00007-8 · Cited by 23 · see citing works
A survey on biomedical automatic text summarization with large language models
Huang, Z., Chen, X., Wang, Y., Huang, J., & Zhao, X. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2025.104216 · Cited by 23 · see citing works
Patient-Clinician Communication: ASCO Guideline Update
Gilligan, T. D., Bohlke, K., Alpert, A. B., Coyle, N., Harichand-Herdt, S., Lathan, C. S., Razis, E., Rivera, K., Sanft, T. B., Seigel, C., et al. (2026) · Journal of Clinical Oncology · doi:10.1200/jco-26-00118 · Cited by 20 · see citing works
Dietrich, N., & Stubbert, B. (2025) · Canadian Association of Radiologists Journal · doi:10.1177/08465371251323124 · Cited by 20 · see citing works
Gómez, C., Yin, J., Huang, C., & Unberath, M. (2024) · Frontiers in Computer Science · doi:10.3389/fcomp.2024.1427463 · Cited by 23 · see citing works
Wen, P., Ai, Q., Fan, X., Gu, Z., 陈波, & Qian, H. (2026) · Cancer Letters · doi:10.1016/j.canlet.2026.218257 · Cited by 18 · see citing works
Everett, S. S., Bunning, B. J., Jain, P., Lopez, I., Agarwal, A., Desai, M., Gallo, R., Goh, E., Kadiyala, V. B., Kanjee, Z., et al. (2025) · doi:10.1101/2025.06.07.25329176 · Cited by 18 · see citing works
Beyond Accuracy: Investigating Error Types in GPT-4 Responses to USMLE Questions
Roy, S., Khatua, A., Ghoochani, F., Hadler, U., Nejdl, W., & Ganguly, N. (2024) · Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3626772.3657882 · Cited by 17 · see citing works
Hashjin, N. M., Amiri, M. H., & Najafabadi, M. K. (2026) · Scientific Reports · doi:10.1038/s41598-026-38715-0 · Cited by 17 · see citing works
An overview of diagnostics and therapeutics using large language models
Malgaroli, M., & McDuff, D. (2024) · Journal of Traumatic Stress · doi:10.1002/jts.23082 · Cited by 17 · see citing works
Self-citationScaling medical AI across clinical contexts
Li, M. M., Reis, B. Y., Rodman, A. M., Cai, T., Dagan, N., Balicer, R. D., Loscalzo, J., Kohane, I. S., & Žitnik, M. (2026) · Nature Medicine · doi:10.1038/s41591-025-04184-7 · Cited by 17 · see citing works
Towards conversational artificial intelligence for disease management
Liévin, V., Palepu, A. K., Weng, W., Saab, K. K., Stutz, D., Cheng, Y., Kulkarni, K., Mahdavi, S. S., Barral, J. K., Webster, D. R., et al. (2026) · Nature · doi:10.1038/s41586-026-10764-5 · Cited by 27 · see citing works
Self-citationHersh, W., & Hollis, K. F. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01251-0 · Cited by 14 · see citing works
AML diagnostics in the 21st century: Use of AI
Haferlach, T., Eckardt, J., Walter, W., Maschek, S., Kather, J. N., Pohlkamp, C., & Middeke, J. M. (2025) · Seminars in Hematology · doi:10.1053/j.seminhematol.2025.06.002 · Cited by 16 · see citing works
Automation Bias in Large Language Model Assisted Diagnostic Reasoning Among AI-Trained Physicians
Qazi, I. A., Ali, A., Khawaja, A. U., Akhtar, M. J., Sheikh, A. Z., & Alizai, M. H. (2025) · medRxiv · doi:10.1101/2025.08.23.25334280 · Cited by 16 · see citing works
Large Language Model Influence on Management Reasoning: A Randomized Controlled Trial
Goh, E., Gallo, R., Strong, E., Weng, Y., Kerman, H., Freed, J., Cool, J. A., Kanjee, Z., Lane, K. P., Parsons, A. S., et al. (2024) · medRxiv · doi:10.1101/2024.08.05.24311485 · Cited by 13 · see citing works
The Development Landscape of Large Language Models for Biomedical Applications
Cao, Z., Keloth, V. K., Xie, Q., Qian, L., Liu, Y., Wang, Y., Shi, R., Zhou, W., Yang, G. F., Zhang, J., et al. (2025) · Annual Review of Biomedical Data Science · doi:10.1146/annurev-biodatasci-102224-074736 · Cited by 14 · see citing works
Self-citationA survey on large language models driven meta-optimizers for automated intelligent optimization
Zheng, Y., Zhang, L., Li, K., Wang, R., Li, W., Zhang, T., Zhang, Q., & Jin, Y. (2026) · Artificial Intelligence Review · doi:10.1007/s10462-025-11470-w · Cited by 12 · see citing works
van Kessel, R., Anderson, M., McMillan, B., Matthews, M. R., Rust, P., Pearcy, P., Nasir, K., & Mossialos, E. A. (2026) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2025-101959 · Cited by 16 · see citing works
Capable language models can outgrow the benefits of collaboration
Kim, Y., Gu, K., Park, C., Park, C., Schmidgall, S., Heydari, A. A., Yan, Y., Zhang, Z., Zhuang, Y., Liu, Y., et al. (2026) · Nature Machine Intelligence · doi:10.1038/s42256-026-01268-y · Cited by 13 · see citing works
Self-citationLiu, J., Koopman, B., Brown, N. J., Chu, K., & Nguyen, A. N. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.103027 · Cited by 14 · see citing works
Hayat, H., Kudrautsau, M., Makarov, E., Melnichenko, V., Tsykunou, T., Varaksin, P., Pavelle, M., & Oskowitz, A. (2025) · medRxiv · doi:10.1101/2025.07.14.25331406 · Cited by 12 · see citing works
Large Language Model Uncertainty Measurement and Calibration for Medical Diagnosis and Treatment
Savage, T., Wang, J., Gallo, R., Boukil, A., Patel, V., Ahmad Safavi-Naini, S. A., Soroush, A., & Chen, J. H. (2024) · doi:10.1101/2024.06.06.24308399 · Cited by 11 · see citing works
Scaffolding for success: Blending learning with and about Generative AI in medical education
Boman, M., Jhun, P., & Schaekermann, M. (2025) · Medical Teacher · doi:10.1080/0142159x.2025.2571041 · Cited by 11 · see citing works
Self-citationBáez, J. C., Ahn, E., Tamietti, A., Victor, B. G., & Goldkind, L. (2025) · Journal of Evidence-Based Social Work · doi:10.1080/26408066.2025.2542450 · Cited by 10 · see citing works
A Licensure Framework for Autonomous Clinical AI
Bergman, A., Wachter, R. M., & Emanuel, E. (2026) · JAMA · doi:10.1001/jama.2026.5483 · Cited by 10 · see citing works
AI-assisted human clinical reasoning in the ICU: beyond “to err is human”
Gharib, K. E., Jundi, B., Furfaro, D. M., & Abdulnour, R.-E. E. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1506676 · Cited by 9 · see citing works
A scalable framework for evaluating health language models
Mallinar, N., Heydari, A. A., Liu, X., Faranesh, A. Z., Winslow, B. D., Hammerquist, N., Graef, B., Speed, C., Malhotra, M., Patel, S., et al. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02492-x · Cited by 14 · see citing works
Self-citationMe LLaMA: Foundation Large Language Models for Medical Applications
Xie, Q., Chen, Q., Chen, A., Peng, C., Hu, Y., Lin, F., Peng, X., Huang, J., Zhang, J., Keloth, V., et al. (2024) · arXiv · doi:10.48550/arxiv.2402.12749 · Cited by 8 · see citing works
Maurya, R., Rajput, N., Diviit, M. G., Mahapatra, S., & Ojha, M. K. (2025) · Scientific Reports · doi:10.1038/s41598-025-05012-1 · Cited by 8 · see citing works
Artificial intelligence in rehabilitation: a living systematic mapping review - first release
Morone, G., REHALISE Group, Carbonetti, R., Cinnera, A. M., Malfitano, C., Bisirri, A., & Negrini, F. (2025) · European Journal of Physical and Rehabilitation Medicine · doi:10.23736/s1973-9087.25.09331-1 · Cited by 9 · see citing works
Chen, M., Wu, Y., Ma, J., Jia, X., Gao, C., Zhao, F., & Qiao, Y. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02409-8 · Cited by 13 · see citing works
A clinical environment simulator for dynamic AI evaluation
Luo, L., Kim, S. E., Zhang, X., Kernbach, J. M., Kenia, R., Acosta, J. N., Nathanson, L. A., Haimovich, A. D., Rodman, A. M., Goh, E., et al. (2026) · Nature Medicine · doi:10.1038/s41591-026-04252-6 · Cited by 11 · see citing works
Self-citationGiuffrè, M., You, K., Pang, Z., Kresevic, S., Chung, S., Chen, R., Ko, Y., Chan, C., Saarinen, T., Ajčević, M., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01589-z · Cited by 8 · see citing works
Hu, R., Yang, Y., Liu, S., Li, Z., Liu, J., Ding, X., Sun, H., & Ren, L. (2025) · Scientific Reports · doi:10.1038/s41598-025-15627-z · Cited by 7 · see citing works
Artificial intelligence in emergency medicine: a narrative review
Rego, A., Arango-Ibañez, J. P., Taylor, R. A., Smith, M. E., Jones, D. D., Pelletier, J., Colletti, J. E., Gottlieb, M. A., & Long, B. (2026) · The American Journal of Emergency Medicine · doi:10.1016/j.ajem.2026.01.028 · Cited by 7 · see citing works
Maitín, A. M., Nogales, A., Fernández-Rincón, S., Aranguren, E., Barba, E. C., Arranz, S. D., Rodríguez, A. A. M., & García-Tejedor, Á. J. (2024) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocae302 · Cited by 7 · see citing works
Artificial intelligence–enabled precision medicine for inflammatory skin diseases
Tang, A. S., Wei, M. L., Haemel, A., La, C., Sirota, M., & Lee, E. Y. (2026) · Journal of Investigative Dermatology · doi:10.1016/j.jid.2025.10.596 · Cited by 6 · see citing works
Bridging BioSciences and technology: The impact of AI & GenAI in life sciences and agribusiness
da Cunha, N. B., Fernandes, F. C., Gil-Ley, A., Franco, O. L., Timakondu, N., & Costa, F. F. (2025) · Gene · doi:10.1016/j.gene.2025.149623 · Cited by 6 · see citing works
A survey on electronic health record driven multimodal representation learning
Dou, Y., Liu, Y., Zou, H., Zeng, W., Xu, K., & Peng, S. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103810 · Cited by 7 · see citing works
Self-citationApplication of Large Language Models in Automated Interpretation of Urodynamic Parameters
Wang, Z., Xu, Z., Shi, Y., Xi, J., & Zhang, Y. (2025) · Neurourology and Urodynamics · doi:10.1002/nau.70160 · Cited by 6 · see citing works
HUANG, A. S., Fam, A., ZHAO, H., PAULESCU, N., Fabczak-Kubicka, A., Wiggs, J. L., Zebardast, N., Friedman, D. S., Do, R., Aziz, K., et al. (2025) · American Journal of Ophthalmology · doi:10.1016/j.ajo.2025.11.046 · Cited by 6 · see citing works
Roemer, A., Schlicker, N., Kernder, A. L., Albe, B., Hack, J., Hirsch, M., Mayr, A. J., Kuhn, S., & Knitza, J. (2026) · BMC Medical Education · doi:10.1186/s12909-026-09079-w · Cited by 12 · see citing works
Using conversant artificial intelligence to improve diagnostic reasoning: ready for prime time?
Scott, I. A., Miller, T., & Crock, C. (2024) · The Medical Journal of Australia · doi:10.5694/mja2.52401 · Cited by 6 · see citing works
Harnessing Internet Search Data as a Potential Tool for Medical Diagnosis: Literature Review
Downing, G. J., Tramontozzi, L. M., Garcia, J., & Villanueva, E. (2024) · JMIR Mental Health · doi:10.2196/63149 · Cited by 6 · see citing works
Basics of Artificial Intelligence (AI) Modeling
Richie, R. C. (2024) · Journal of Insurance Medicine · doi:10.17849/insm-51-1-35-40.1 · Cited by 6 · see citing works
La inteligencia artificial en atención primaria: ¿solución o problema?
Sanz, J. B., & Toledo, R. B. (2025) · Atención Primaria · doi:10.1016/j.aprim.2025.103223 · Cited by 6 · see citing works
Farrokhi, M., Fallahian, A., Rahmani, E., Aghajan, A., Alipour, M., Khouzani, P. J., Hezarani, H. B., Sabzehie, H., Pirouzan, M., Pirouzan, Z., et al. (2025) · Archives of Academic Emergency Medicine · doi:10.22037/aaemj.v13i1.2712 · Cited by 5 · see citing works
Augmenting Medical Diagnostics with AI: A Dual Approach Using RAG-Based Chatbots and Nano GPT Models
Bande, S. P., Vinutha, N., & Krishnamurthy, P. K. (2025) · International Conference on Recent Advances in Information Technology · doi:10.1109/rait65068.2025.11088917 · Cited by 5 · see citing works
Chan, M. D. Z., Tjio, C. K. E., Chan, T. L. Y., Tan, Y. L., Chua, A. X. Y., Loh, S. K. Y., Leow, G. Z., Gan, M. Y., Lim, X., Choo, A. K., et al. (2025) · Cancers · doi:10.3390/cancers17193198 · Cited by 5 · see citing works
Self-citationMerchant, S. A., Merchant, N., Varghese, S. L., & Shaikh, M. J. S. (2025) · World Journal of Radiology · doi:10.4329/wjr.v17.i11.114754 · Cited by 6 · see citing works
Liu, D., Long, Y., Zuoqiu, S., Liu, D., Li, K., Lin, Y., Liu, H., Yin, R., & Tang, T. (2025) · Journal of Medical Internet Research · doi:10.2196/85206 · Cited by 5 · see citing works
Reis, F., Agha-Mir-Salim, L., Hickstein, R., Reis, M., Piper, S. K., Balzer, F., & Boie, S. D. (2026) · Journal of Medical Internet Research · doi:10.2196/84668 · Cited by 8 · see citing works
Jiang, Z., Chen, H., Wu, Y., Qin, Y., Pei, C., Zeng, D., Sheng, B., & Wong, T. Y. (2026) · Intelligent Medicine · doi:10.1016/j.imed.2026.01.001 · Cited by 5 · see citing works
McPeak, G., Sautmann, A., George, O. S., Hallal, A., Simal, E. A., Schwartz, A. L., Abaluck, J., Ravi, N., & Pless, R. B. (2024) · IEEE International Conference on Healthcare Informatics (ICHI) · doi:10.1109/ichi61247.2024.00094 · Cited by 5 · see citing works
Schönfelder, A., Eberlein-Gonska, M., Hülsken-Giesler, M., Jovy-Klein, F., Kather, J. N., Kohoutek, E., Lennefer, T., Liebert, E., Lipprandt, M., Mathias, R., et al. (2025) · Journal of Medical Internet Research · doi:10.2196/80754 · Cited by 5 · see citing works
- Authors
- McDuff, D., Schaekermann, M., Tu, T., Palepu, A., Wang, A., Garrison, J., Singhal, K., Sharma, Y., Azizi, S., Kulkarni, K., Hou, L., Cheng, Y., Liu, Y., Mahdavi, S. S., Prakash, S., Pathak, A., Semturs, C., Patel, S., Webster, D. R., Dominowska, E., Gottweis, J., Barral, J., Chou, K., Corrado, G. S., Matias, Y., Sunshine, J., Karthikesalingam, A., & Natarajan, V.
- Affiliations
- Google (United States) (US)
- Google (Switzerland) (CH)
- Google (United Kingdom) (GB)
- Corresponding author
- McDuff, Daniel
- Schaekermann, Mike
- Karthikesalingam, Alan
- Natarajan, Vivek
- ORCID
- McDuff, Daniel
- Schaekermann, Mike
- Tu, Tao
- Palepu, Anil
- Wang, Amy
- Singhal, Karan
- Azizi, Shekoofeh
- Cheng, Yong
- Liu, Yun
- Mahdavi, S Sara
- Prakash, Sushant
- Pathak, Anupam
- Semturs, Christopher
- Patel, Shwetak
- Webster, Dale R
- Dominowska, Ewa
- Gottweis, Juraj
- Barral, Joelle
- Chou, Katherine
- Corrado, Greg S
- Matias, Yossi
- Karthikesalingam, Alan
- Natarajan, Vivek
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- Volume
- 642
- Issue
- 8067
- Pages
- 451-457
- ISSN
- 0028-0836 (ISSN-L)
- arXiv
- 2312.00164
- PMC
- PMC12158753
- OpenAlex
- W4409283616
- Cited by
- 311
- References
- 34
- Citations by year
- 2026: 172 · 2025: 108 · 2024: 31
- FWCI
- 67.40
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Nature (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion, other-oa)
- arXiv (Cornell University)
- Funders
- Massachusetts Medical Society
- DeepMind
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- differential diagnosis, large language models, diagnostic reasoning, clinical decision support, clinician performance, AI-assisted diagnosis, medical knowledge retrieval
- MeSH terms
- Case Reports as Topic, Large Language Models, Artificial Intelligence, Diagnosis, Differential, Humans, Language
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
