CoChat

Medical Ethics of Large Language Models in Medicine

Open access
Ong, Jasmine Chiat Ling, Chang, Shelley Yin-Hsi, William, Wasswa, Butte, Atul J., Shah, Nigam H., Chew, Lita Sui Tjien, Liu, Nan, Doshi-Velez, Finale, Lu, Wei, Savulescu, Julian, Ting, Daniel Shu Wei · 2024 · NEJM AI
Cited by 58

The DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.

Abstract

Large language models (LLMs) have shown significant promise related to their application in medical research, medical education, and clinical tasks. While acknowledging their capabilities, we face the challenge of striking a balance between defining and holding ethical boundaries and driving innovation in LLM technology for medicine. We herein propose a framework, grounded in four bioethical principles, to promote the responsible use of LLMs. This model requires the responsible application of LLMs by three parties — the patient, the clinician, and the systems that govern the LLM itself — and suggests potential approaches to mitigating the risks of LLMs in medicine. This approach allows us to use LLMs ethically, equitably, and effectively in medicine.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1056/aira2400038

Cites

61 of 61 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 39

  1. Open AI Achiam J Adler S et al. GPT-4 technical report. March 15 2023 (https://arxiv.org/abs/2303.08774). Preprint. · arXiv
  2. Huang K Altosaar J Ranganath R. ClinicalBERT: modeling clinical notes and predicting hospital readmission. April 10 2019 (https://arxiv.org/abs/1904.05342). Preprint. · arXiv
  3. 10.1001/jamanetworkopen.2023.30320 · DOI · Paper page
  4. ICML. Clarification on large language model policy LLM. 2023 (https://icml.cc/Conferences/2023/llm-policy).
  5. 10.1038/d41586-022-03539-1 · DOI
  6. Zvyagin M Brace A Hippe K et al. GenSLMs: genome-scale language models reveal SARS-CoV-2 evolutionary dynamics. November 23 2022 (https://www.biorxiv.org/content/10.1101/2022.10.10.511571v2). Preprint. · doi:10.1101/2022.10.10.511571v2
  7. Jadon A Kumar S. Leveraging generative AI models for synthetic data generation in healthcare: balancing research and privacy. May 9 2023 (https://arxiv.org/abs/2305.05247). Preprint. · DOI · Paper page
  8. Van Veen D Van Uden C Blankemeier L et al. Clinical text summarization: adapting large language models can outperform human experts. October 30 2023 (https://pubmed.ncbi.nlm.nih.gov/37961377/). Preprint. · DOI · Paper page
  9. 10.1001/jamaophthalmol.2023.3314 · DOI
  10. 10.1016/j.xagr.2023.100165 · DOI · Paper page
  11. 10.1001/jama.268.11.1412 · doi:10.1001/jama.268.11.1412
  12. 10.1001/jamanetworkopen.2023.38050 · DOI
  13. Li C Zhang M Mei Q et al. Teach LLMs to personalize — an approach inspired by writing education. August 15 2023 (https://arxiv.org/abs/2308.07968). Preprint. · arXiv
  14. 10.1080/15265161.2022.2075968 · DOI
  15. Talboy AN Fuller E. Challenging the appearance of machine intelligence: cognitive bias in LLMs and best practices for adoption. April 3 2023 (https://arxiv.org/abs/2304.01358). Preprint. · arXiv
  16. Zack T Lehman E Suzgun M et al. Coding inequity: assessing GPT-4’s potential for perpetuating racial and gender biases in healthcare. July 16 2023 (https://www.medrxiv.org/content/10.1101/2023.07.13.23292577v1). Preprint. · DOI · Paper page
  17. 10.7759/cureus.39305 · DOI · Paper page
  18. 10.7759/cureus.38380 · DOI · Paper page
  19. 10.1001/jama.2023.9651 · DOI · Paper page
  20. 10.1186/s13010-023-00129-5 · DOI
  21. Ke Y Jin L Elangovan K et al. Development and testing of retrieval augmented generation in large language models — a case study report. January 29 2024 (https://arxiv.org/abs/2402.01733). Preprint. · DOI
  22. 10.1016/S2589-7500(23)00229-7 · doi:10.1016/s2589-7500(23)00229-7
  23. 10.1007/s11245-023-09911-8 · DOI · Paper page
  24. 10.1080/03605310590926812 · doi:10.1080/03605310590926812
  25. 10.1080/03605310590926821 · doi:10.1080/03605310590926821
  26. 10.1371/journal.pone.0271122 · DOI
  27. Kraljevic Z Bean D Shek A et al. Foresight — generative pretrained transformer (GPT) for modelling of patient timelines using EHRs. December 13 2022 (https://arxiv.org/abs/2212.08072). Preprint. · arXiv
  28. Chen C Feng X Zhou J Yin J Zheng X. Federated large language model: a position paper. July 18 2023 (https://arxiv.org/abs/2307.08925). Preprint. · arXiv
  29. 10.1016/j.oret.2022.03.019 · DOI
  30. Jiang J Liu X Fan C. Low-parameter federated learning with large language models. July 26 2023 (https://arxiv.org/abs/2307.13896). Preprint. · arXiv
  31. Yang W Li C Zhang J Zong C. BigTranslate: augmenting large language models with multilingual translation capability over 100 languages. May 29 2023 (https://arxiv.org/abs/2305.18098). Preprint. · arXiv
  32. Doddapaneni S Ramesh G Khapra MM Kunchukuttan A Kumar P. A primer on pretrained multilingual language models. July 1 2021 (https://arxiv.org/abs/2107.00676). Preprint. · arXiv
  33. 10.3350/cmh.2023.0089 · DOI · Paper page
  34. 10.1001/jamaoto.2023.0704 · DOI · Paper page
  35. Luchetti M. Global health and the 10/90 gap. BJMP 2014;7:a731. https://www.bjmp.org/content/global-health-and-1090-gap.
  36. 10.1001/jamapsychiatry.2023.1253 · DOI · Paper page
  37. 10.1001/jamaoncol.2023.2867 · DOI
  38. 10.1002/humu.23644 · DOI · Paper page
  39. 10.1038/s41467-022-28594-0 · DOI

Cited by

See all 58

Metadata

Authors
Ong, J. C. L., Chang, S. Y.-H., William, W., Butte, A. J., Shah, N. H., Chew, L. S. T., Liu, N., Doshi-Velez, F., Lu, W., Savulescu, J., & Ting, D. S. W.
Venue
NEJM AI
Published
2024-06-27
Volume
1
Issue
7
ISSN
2836-9386 (ISSN-L)
OpenAlex
W4399737726
Cited by
58
References
61
FWCI
4.57
Type
journal article
Language
en
Open access
hybrid

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.