CoChat

Medical Ethics of Large Language Models in Medicine

Open access
Ong, Jasmine Chiat Ling, Chang, Shelley Yin-Hsi, William, Wasswa, Butte, Atul J., Shah, Nigam H., Chew, Lita Sui Tjien, Liu, Nan, Doshi-Velez, Finale, Lu, Wei, Savulescu, Julian, Ting, Daniel Shu Wei · 2024 · NEJM AI
Cited by 58

The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.

Abstract

Large language models (LLMs) have shown significant promise related to their application in medical research, medical education, and clinical tasks. While acknowledging their capabilities, we face the challenge of striking a balance between defining and holding ethical boundaries and driving innovation in LLM technology for medicine. We herein propose a framework, grounded in four bioethical principles, to promote the responsible use of LLMs. This model requires the responsible application of LLMs by three parties — the patient, the clinician, and the systems that govern the LLM itself — and suggests potential approaches to mitigating the risks of LLMs in medicine. This approach allows us to use LLMs ethically, equitably, and effectively in medicine.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1056/aira2400038

Cites

56 of 56 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 56 references

Research works printed but not linked: 44

  1. Open AI Achiam J Adler S et al. GPT-4 technical report. March 15 2023 (https://arxiv.org/abs/2303.08774). Preprint. · arXiv
  2. Huang K Altosaar J Ranganath R. ClinicalBERT: modeling clinical notes and predicting hospital readmission. April 10 2019 (https://arxiv.org/abs/1904.05342). Preprint. · arXiv
  3. 10.1001/jamanetworkopen.2023.30320 · DOI · Paper page
  4. ICML. Clarification on large language model policy LLM. 2023 (https://icml.cc/Conferences/2023/llm-policy).
  5. 10.1038/d41586-022-03539-1 · DOI
  6. Zvyagin M Brace A Hippe K et al. GenSLMs: genome-scale language models reveal SARS-CoV-2 evolutionary dynamics. November 23 2022 (https://www.biorxiv.org/content/10.1101/2022.10.10.511571v2). Preprint. · doi:10.1101/2022.10.10.511571v2
  7. Jadon A Kumar S. Leveraging generative AI models for synthetic data generation in healthcare: balancing research and privacy. May 9 2023 (https://arxiv.org/abs/2305.05247). Preprint. · DOI · Paper page
  8. 10.1038/s41591-023-02448-8 · DOI · Paper page
  9. 10.1038/s41586-023-06160-y · DOI · Paper page
  10. Van Veen D Van Uden C Blankemeier L et al. Clinical text summarization: adapting large language models can outperform human experts. October 30 2023 (https://pubmed.ncbi.nlm.nih.gov/37961377/). Preprint. · DOI · Paper page
  11. 10.1001/jamaophthalmol.2023.3314 · DOI
  12. 10.1016/j.xagr.2023.100165 · DOI · Paper page
  13. 10.1001/jama.268.11.1412 · doi:10.1001/jama.268.11.1412
  14. 10.1001/jamanetworkopen.2023.38050 · DOI
  15. Li C Zhang M Mei Q et al. Teach LLMs to personalize — an approach inspired by writing education. August 15 2023 (https://arxiv.org/abs/2308.07968). Preprint. · arXiv
  16. 10.1080/15265161.2022.2075968 · DOI
  17. Talboy AN Fuller E. Challenging the appearance of machine intelligence: cognitive bias in LLMs and best practices for adoption. April 3 2023 (https://arxiv.org/abs/2304.01358). Preprint. · arXiv
  18. Zack T Lehman E Suzgun M et al. Coding inequity: assessing GPT-4’s potential for perpetuating racial and gender biases in healthcare. July 16 2023 (https://www.medrxiv.org/content/10.1101/2023.07.13.23292577v1). Preprint. · DOI · Paper page
  19. 10.7759/cureus.39305 · DOI · Paper page
  20. 10.7759/cureus.38380 · DOI · Paper page
  21. 10.1001/jama.2023.9651 · DOI · Paper page
  22. 10.1186/s13010-023-00129-5 · DOI
  23. Ke Y Jin L Elangovan K et al. Development and testing of retrieval augmented generation in large language models — a case study report. January 29 2024 (https://arxiv.org/abs/2402.01733). Preprint. · DOI
  24. 10.1016/S2589-7500(23)00229-7 · doi:10.1016/s2589-7500(23)00229-7
  25. Ning Y Teixayavong S Shang Y et al. Generative artificial intelligence in healthcare: ethical considerations and assessment checklist. November 2 2023 (https://arxiv.org/abs/2311.02107). Preprint. · arXiv
  26. 10.1007/s11245-023-09911-8 · DOI · Paper page
  27. 10.1186/s40635-019-0286-6 · DOI · Paper page
  28. 10.1080/03605310590926812 · doi:10.1080/03605310590926812
  29. 10.1080/03605310590926821 · doi:10.1080/03605310590926821
  30. 10.1371/journal.pone.0271122 · DOI
  31. Kraljevic Z Bean D Shek A et al. Foresight — generative pretrained transformer (GPT) for modelling of patient timelines using EHRs. December 13 2022 (https://arxiv.org/abs/2212.08072). Preprint. · arXiv
  32. Chen C Feng X Zhou J Yin J Zheng X. Federated large language model: a position paper. July 18 2023 (https://arxiv.org/abs/2307.08925). Preprint. · arXiv
  33. 10.1016/j.oret.2022.03.019 · DOI
  34. Jiang J Liu X Fan C. Low-parameter federated learning with large language models. July 26 2023 (https://arxiv.org/abs/2307.13896). Preprint. · arXiv
  35. Yang W Li C Zhang J Zong C. BigTranslate: augmenting large language models with multilingual translation capability over 100 languages. May 29 2023 (https://arxiv.org/abs/2305.18098). Preprint. · arXiv
  36. Doddapaneni S Ramesh G Khapra MM Kunchukuttan A Kumar P. A primer on pretrained multilingual language models. July 1 2021 (https://arxiv.org/abs/2107.00676). Preprint. · arXiv
  37. 10.3350/cmh.2023.0089 · DOI · Paper page
  38. 10.1001/jamaoto.2023.0704 · DOI · Paper page
  39. 10.1001/jama.2017.19198 · DOI · Paper page
  40. Luchetti M. Global health and the 10/90 gap. BJMP 2014;7:a731. https://www.bjmp.org/content/global-health-and-1090-gap.
  41. 10.1001/jamapsychiatry.2023.1253 · DOI · Paper page
  42. 10.1001/jamaoncol.2023.2867 · DOI
  43. 10.1002/humu.23644 · DOI · Paper page
  44. 10.1038/s41467-022-28594-0 · DOI

Cited by

See all 58

Metadata

Authors
Ong, J. C. L., Chang, S. Y.-H., William, W., Butte, A. J., Shah, N. H., Chew, L. S. T., Liu, N., Doshi-Velez, F., Lu, W., Savulescu, J., & Ting, D. S. W.
Venue
NEJM AI
Published
2024-06-27
Volume
1
Issue
7
ISSN
2836-9386 (ISSN-L)
OpenAlex
W4399737726
Cited by
58
References
56
FWCI
4.57
Type
journal article
Language
en
Open access
hybrid

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Medical Ethics of Large Language Models in Medicine. https://app.cochat.ai/papers/10.1056/aira2400038
The paper
Ong, J. C. L., Chang, S. Y.-H., William, W., Butte, A. J., Shah, N. H., Chew, L. S. T., Liu, N., Doshi-Velez, F., Lu, W., Savulescu, J., & Ting, D. S. W. (2024). Medical Ethics of Large Language Models in Medicine. NEJM AI. https://doi.org/10.1056/aira2400038

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.