CoChat

The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.

A generalist medical language model for disease diagnosis assistance

Abstract

The delivery of accurate diagnoses is crucial in healthcare and represents the gateway to appropriate and timely treatment. Although recent large language models (LLMs) have demonstrated impressive capabilities in few-shot or zero-shot learning, their effectiveness in clinical diagnosis remains unproven. Here we present MedFound, a generalist medical language model with 176 billion parameters, pre-trained on a large-scale corpus derived from diverse medical text and real-world clinical records. We further fine-tuned MedFound to learn physicians' inferential diagnosis with a self-bootstrapping strategy-based chain-of-thought approach and introduced a unified preference alignment framework to align it with standard clinical practice. Extensive experiments demonstrate that our medical LLM outperforms other baseline LLMs and specialized models in in-distribution (common diseases), out-of-distribution (external validation) and long-tailed distribution (rare diseases) scenarios across eight specialties. Further ablation studies indicate the effectiveness of key components in our medical LLM training approach. We conducted a comprehensive evaluation of the clinical applicability of LLMs for diagnosis involving artificial intelligence (AI) versus physician comparison, AI-assistance study and human evaluation framework. Our proposed framework incorporates eight clinical evaluation metrics, covering capabilities such as medical record summarization, diagnostic reasoning and risk manage…

Overview

Integrity signals

Registry

Crossref · 10.1038/s41591-024-03416-6

Cites

63 of 63 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 57 references

Research works printed but not linked: 6

  1. Stern, S.D. Symptom to Diagnosis: An Evidence-Based Guide (McGraw-Hill, 2014).
  2. Devlin, J. BERT: pre-training of deep bidirectional transformers for language understanding. In Proc. 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (eds Burstein, J. et al.) 4171–4186 (Association for Computational Linguistics, 2019).
  3. Zhang, H., Xu, W. & Yu, H. Generative planning for temporally coordinated exploration in reinforcement learning. In Proc. 10th International Conference on Learning Representations https://openreview.net/pdf/0e68ff1fa269567c6c6101685f2f721afcc5d0aa.pdf (ICLR, 2022).
  4. Achiam, J. et al. GPT-4 technical report. Preprint at https://arxiv.org/abs/2303.08774 (2023). · arXiv
  5. Hu, E. J. et al. LoRA: low-rank adaptation of large language models. In Proc. 10th International Conference on Learning Representations https://openreview.net/pdf?id=nZeVKeeFYf9 (ICLR, 2022).
  6. Chihara, L. M. & Hesterberg, T. C. Mathematical Statistics with Resampling and R (John Wiley & Sons, 2022).

Cited by

See all 188

Metadata

Authors
Liu, X., Liu, H., Yang, G., Jiang, Z., Cui, S., Zhang, Z., Wang, H., Tao, L., Sun, Y., Song, Z., Hong, T., Yang, J., Gao, T., Zhang, J., Li, X., Zhang, J., Sang, Y., Yang, Z., Xue, K., Wu, S., Zhang, P., Yang, J., Song, C., & Wang, G.
Affiliations
  • Beijing University of Posts and Telecommunications (CN)
  • Peking University Third Hospital (CN)
  • Chinese University of Hong Kong (HK)
  • China Three Gorges University (CN)
  • University of Oxford (GB)
  • Shenzhen University (CN)
Corresponding author
  • Yang, Jin
  • Yang, Jian
  • Song, Chunli
  • Wang, Guangyu
Venue
Nature Medicine
Published
2025-01-08
Volume
31
Issue
3
Pages
932-942
ISSN
  • 1078-8956 (ISSN-L)
  • 1546-170X
OpenAlex
W4406152280
Cited by
183
References
57
Citations by year
2026: 103 · 2025: 79
FWCI
43.81
Type
journal article
Language
en
Open access
closed
Licence
Locations
  • Nature Medicine (publishedVersion)
  • PubMed (publishedVersion)
Funders
  • Wellcome Trust (216593/Z/19/Z)
  • National Natural Science Foundation of China (82330078, 61931024, 92359202, 62272055, 12326610, 81874010)
  • Medical Research Council (MR/X013189/1)
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
  • Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
Keywords
clinical language models, chain-of-thought prompting, preference alignment, rare diseases, diagnostic reasoning, risk management, physician comparison, clinical workflow
MeSH terms
Artificial Intelligence, Diagnosis, Computer-Assisted, Humans, Language, Natural Language Processing

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: A generalist medical language model for disease diagnosis assistance. https://app.cochat.ai/papers/10.1038/s41591-024-03416-6
The paper
Liu, X., Liu, H., Yang, G., Jiang, Z., Cui, S., Zhang, Z., Wang, H., Tao, L., Sun, Y., Song, Z., Hong, T., Yang, J., Gao, T., Zhang, J., Li, X., Zhang, J., Sang, Y., Yang, Z., Xue, K., . . . Wang, G. (2025). A generalist medical language model for disease diagnosis assistance. Nature Medicine. https://doi.org/10.1038/s41591-024-03416-6

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.