CoChat
Sign Up
Cited by 361Artificial Intelligence in Healthcare and EducationBiomedical Text Mining and OntologiesTopic Modeling

The DOI matches its Crossref record; 136 of the 136 references it cites were found in a registry or an index.

Opportunities and challenges for ChatGPT and large language models in biomedicine and health

Open access
Tian, Shubo, Jin, Qiao, Yeganova, Lana, Lai, Po-Ting, Zhu, Qingqing, Chen, Xiuying, Yang, Yifan, Chen, Qingyu, Kim, Won, Comeau, Donald C, Islamaj, Rezarta, Kapoor, Aadit, Gao, Xin, Lu, Zhiyong·2023·Briefings in Bioinformatics
DOI 10.1093/bib/bbad493PMC PMC10762511
Open this paper in CoChat — free accountOpen PDF

Abstract

ChatGPT has drawn considerable attention from both the general public and domain experts with its remarkable text generation capabilities. This has subsequently led to the emergence of diverse applications in the field of biomedicine and health. In this work, we examine the diverse applications of large language models (LLMs), such as ChatGPT, in biomedicine and health. Specifically, we explore the areas of biomedical information retrieval, question answering, medical text summarization, information extraction and medical education and investigate whether LLMs possess the transformative power to revolutionize these tasks or whether the distinct complexities of biomedical domain presents unique challenges. Following an extensive literature survey, we find that significant advances have been made in the field of text generation tasks, surpassing the previous state-of-the-art methods. For other applications, the advances have been modest. Overall, LLMs have not yet revolutionized biomedicine, but recent rapid progress indicates that such methods hold great potential to provide valuable means for accelerating discovery and improving health. We also find that the use of LLMs, like ChatGPT, in the fields of biomedicine and health entails various risks and challenges, including fabricated information in its generated responses, as well as legal and privacy concerns associated with sensitive patient data. We believe this survey can provide a comprehensive and timely overview to biomedical researchers and healthcare practitioners on the opportunities and challenges associated with using ChatGPT and other LLMs for transforming biomedicine and health.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1093/bib/bbad493

Cites

136 of 136 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Flagged first, then by citations

Show all 132 references

Research works printed but not linked: 32

  1. OpenAI, 2022, Introducing ChatGPT
  2. OpenAI, 2023, GPT-4 Technical Report
  3. Bolton, 2022, BioMedLM: a Domain-Specific Large Language Model for Biomedical Text
  4. Wu, 2023, PMC-LLaMA: Further Finetuning LLaMA on Medical Papers
  5. Radford, 2018, Improving Language Understanding by Generative Pre-Training
  6. Radford, 2019, OpenAI Research Papers
  7. Chowdhery, 2022, et al
  8. Taylor, 2022, et al
  9. Touvron, 2023, et al
  10. Toma, 2023, Clinical Camel: An Open-Source Expert-Level Medical Language Model with Dialogue-Based Knowledge Encoding
  11. Li, 2023, ChatDoctor: A Medical Chat Model Fine-tuned on LLaMA Model using Medical Domain Knowledge
  12. Anil R, Dai AM, Firat O, 2023, PaLM 2 Technical Report
  13. Abacha, 2019, MEDINFO 2019: Health and Wellbeing e-Networks for All, 25
  14. Kanoulas, 2018, CEUR Workshop Proceedings
  15. Kanoulas, 2019, CEUR Workshop Proceedings
  16. Hou, 2023, GeneTuring tests GPT models in genomics, 10.1101/2023.03.11.532238 · DOI
  17. Fox, 2013, Pew Research Center Blog Post
  18. Cohan, 2018, Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
  19. Laundry, 2023, Turn GPT-4 Into your Personal Literature Review Bot. The Academic’s Field Guide to Writing Code Blog Post on Medium
  20. Smit, 2020, et al
  21. Wang, 2023, et al
  22. Tang, 2023, npj Digit Med
  23. Luo, Bioinformatics
  24. Krallinger, 2017, Proceedings of the sixth BioCreative Challenge Evaluation Workshop
  25. Chen, 2023, Large Language Models in Biomedical Natural Language Processing: Benchmarks, Baselines, and Recommendations
  26. OpenAI, 2023, Educator considerations for ChatGPT
  27. Gasperin, 2007, Proceedings of DAARC
  28. Su, Dagstuhl Seminar Proceedings
  29. Batista-Navarro, Proceedings of BioNLP 2011 Workshop
  30. OpenAI, 2023, GPT-4 System Card
  31. Papineni, Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics
  32. Lin, Text Summarization Branches Out

Cited by

Sorted by citations

Items 201–300 of 361

Related

See all

Metadata

Authors
Tian, S., Jin, Q., Yeganova, L., Lai, P.-T., Zhu, Q., Chen, X., Yang, Y., Chen, Q., Kim, W., Comeau, D. C., Islamaj, R., Kapoor, A., Gao, X., & Lu, Z.
Affiliations
  • United States National Library of Medicine (US)
  • King Abdullah University of Science and Technology (SA)
Corresponding author
Lu, Zhiyong
ORCID
Venue
Briefings in Bioinformatics
Publisher
Oxford University Press (OUP)
Published
2023-11-22
Volume
25
Issue
1
ISSN
  • 1467-5463 (ISSN-L)
  • 1477-4054
DOI
10.1093/bib/bbad493
PMC
PMC10762511
OpenAlex
W4381587418
Cited by
359
References
132
Citations by year
2026: 81 · 2025: 161 · 2024: 112 · 2023: 5
FWCI
14.34
Type
journal article
Language
en
Open access
Licence
public-domain
Locations
  • Briefings in Bioinformatics (publishedVersion, public-domain)
  • PubMed Central (publishedVersion, public-domain)
  • PubMed (publishedVersion)
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • PubMed Central (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Funders
  • NIH Intramural Research Program
  • National Library of Medicine
  • National Institutes of Health (1K99LM014024)
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Health Sciences › Medicine › Health Informatics › Biomedical Text Mining and Ontologies
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
Keywords
ChatGPT, large language models, biomedical information retrieval, question answering, medical text summarization, information extraction, medical education, patient data privacy, legal issues, text generation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review