Medical Ethics of Large Language Models in Medicine
Open accessThe DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Abstract
Large language models (LLMs) have shown significant promise related to their application in medical research, medical education, and clinical tasks. While acknowledging their capabilities, we face the challenge of striking a balance between defining and holding ethical boundaries and driving innovation in LLM technology for medicine. We herein propose a framework, grounded in four bioethical principles, to promote the responsible use of LLMs. This model requires the responsible application of LLMs by three parties — the patient, the clinician, and the systems that govern the LLM itself — and suggests potential approaches to mitigating the risks of LLMs in medicine. This approach allows us to use LLMs ethically, equitably, and effectively in medicine.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445922 · Cited by 6,988
LLaMA: Open and Efficient Foundation Language Models
Touvron, H., Lavril, T., Izacard, G., Martinet, X., Lachaux, M.-A., Lacroix, T., Rozière, B., Goyal, N., Hambro, E., Azhar, F., et al. (2023) · arXiv · doi:10.48550/arxiv.2302.13971 · Cited by 4,602
Large Language Models Encode Clinical Knowledge
Singhal, K., Azizi, S., Tu, T., Mahdavi, S. S., Wei, J., Chung, H. W., Scales, N., Tanwani, A., Cole-Lewis, H., Pfohl, S., et al. (2022) · arXiv · doi:10.48550/arxiv.2212.13138 · Cited by 4,083
Large language models encode clinical knowledge
Singhal, K., Azizi, S., Tu, T., Mahdavi, S. S., Wei, J., Chung, H. W., Scales, N., Tanwani, A., Cole-Lewis, H., Pfohl, S., et al. (2023) · Nature · doi:10.1038/s41586-023-06291-2 · Cited by 4,083
Ayers, J. W., Poliak, A., Dredze, M., Leas, E. C., Zhu, Z., Kelley, J. B., Faix, D. J., Goodman, A. M., Longhurst, C. A., Hogarth, M., et al. (2023) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2023.1838 · Cited by 2,613
Sheller, M. J., Edwards, B., Reina, G. A., Martin, J., Pati, S., Kotrotsou, A., Milchenko, M., Xu, W., Marcus, D., Colen, R. R., et al. (2020) · Scientific Reports · doi:10.1038/s41598-020-69250-1 · Cited by 1,646
Checklist for Artificial Intelligence in Medical Imaging (CLAIM): a guide for authors and reviewers
Mongan, J., Moy, L., & Kahn, C. E. (2020) · Radiology: Artificial Intelligence · doi:10.1148/ryai.2020200029 · Cited by 1,443
Scaling Instruction-Finetuned Language Models
Chung, H. W., Hou, L., Longpre, S., Zoph, B., Tay, Y., Fedus, W., Li, Y., Wang, X., Dehghani, M., Brahma, S., et al. (2022) · arXiv · doi:10.48550/arxiv.2210.11416 · Cited by 1,441
Potential Biases in Machine Learning Algorithms Using Electronic Health Record Data
Gianfrancesco, M. A., Tamang, S., Yazdany, J., & Schmajuk, G. (2018) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2018.3763 · Cited by 1,395
Research works printed but not linked: 44
- Open AI Achiam J Adler S et al. GPT-4 technical report. March 15 2023 (https://arxiv.org/abs/2303.08774). Preprint. · arXiv
- Huang K Altosaar J Ranganath R. ClinicalBERT: modeling clinical notes and predicting hospital readmission. April 10 2019 (https://arxiv.org/abs/1904.05342). Preprint. · arXiv
- 10.1001/jamanetworkopen.2023.30320 · DOI · Paper page
- ICML. Clarification on large language model policy LLM. 2023 (https://icml.cc/Conferences/2023/llm-policy).
- 10.1038/d41586-022-03539-1 · DOI
- Zvyagin M Brace A Hippe K et al. GenSLMs: genome-scale language models reveal SARS-CoV-2 evolutionary dynamics. November 23 2022 (https://www.biorxiv.org/content/10.1101/2022.10.10.511571v2). Preprint. · doi:10.1101/2022.10.10.511571v2
- Jadon A Kumar S. Leveraging generative AI models for synthetic data generation in healthcare: balancing research and privacy. May 9 2023 (https://arxiv.org/abs/2305.05247). Preprint. · DOI · Paper page
- 10.1038/s41591-023-02448-8 · DOI · Paper page
- 10.1038/s41586-023-06160-y · DOI · Paper page
- Van Veen D Van Uden C Blankemeier L et al. Clinical text summarization: adapting large language models can outperform human experts. October 30 2023 (https://pubmed.ncbi.nlm.nih.gov/37961377/). Preprint. · DOI · Paper page
- 10.1001/jamaophthalmol.2023.3314 · DOI
- 10.1016/j.xagr.2023.100165 · DOI · Paper page
- 10.1001/jama.268.11.1412 · doi:10.1001/jama.268.11.1412
- 10.1001/jamanetworkopen.2023.38050 · DOI
- Li C Zhang M Mei Q et al. Teach LLMs to personalize — an approach inspired by writing education. August 15 2023 (https://arxiv.org/abs/2308.07968). Preprint. · arXiv
- 10.1080/15265161.2022.2075968 · DOI
- Talboy AN Fuller E. Challenging the appearance of machine intelligence: cognitive bias in LLMs and best practices for adoption. April 3 2023 (https://arxiv.org/abs/2304.01358). Preprint. · arXiv
- Zack T Lehman E Suzgun M et al. Coding inequity: assessing GPT-4’s potential for perpetuating racial and gender biases in healthcare. July 16 2023 (https://www.medrxiv.org/content/10.1101/2023.07.13.23292577v1). Preprint. · DOI · Paper page
- 10.7759/cureus.39305 · DOI · Paper page
- 10.7759/cureus.38380 · DOI · Paper page
- 10.1001/jama.2023.9651 · DOI · Paper page
- 10.1186/s13010-023-00129-5 · DOI
- Ke Y Jin L Elangovan K et al. Development and testing of retrieval augmented generation in large language models — a case study report. January 29 2024 (https://arxiv.org/abs/2402.01733). Preprint. · DOI
- 10.1016/S2589-7500(23)00229-7 · doi:10.1016/s2589-7500(23)00229-7
- Ning Y Teixayavong S Shang Y et al. Generative artificial intelligence in healthcare: ethical considerations and assessment checklist. November 2 2023 (https://arxiv.org/abs/2311.02107). Preprint. · arXiv
- 10.1007/s11245-023-09911-8 · DOI · Paper page
- 10.1186/s40635-019-0286-6 · DOI · Paper page
- 10.1080/03605310590926812 · doi:10.1080/03605310590926812
- 10.1080/03605310590926821 · doi:10.1080/03605310590926821
- 10.1371/journal.pone.0271122 · DOI
- Kraljevic Z Bean D Shek A et al. Foresight — generative pretrained transformer (GPT) for modelling of patient timelines using EHRs. December 13 2022 (https://arxiv.org/abs/2212.08072). Preprint. · arXiv
- Chen C Feng X Zhou J Yin J Zheng X. Federated large language model: a position paper. July 18 2023 (https://arxiv.org/abs/2307.08925). Preprint. · arXiv
- 10.1016/j.oret.2022.03.019 · DOI
- Jiang J Liu X Fan C. Low-parameter federated learning with large language models. July 26 2023 (https://arxiv.org/abs/2307.13896). Preprint. · arXiv
- Yang W Li C Zhang J Zong C. BigTranslate: augmenting large language models with multilingual translation capability over 100 languages. May 29 2023 (https://arxiv.org/abs/2305.18098). Preprint. · arXiv
- Doddapaneni S Ramesh G Khapra MM Kunchukuttan A Kumar P. A primer on pretrained multilingual language models. July 1 2021 (https://arxiv.org/abs/2107.00676). Preprint. · arXiv
- 10.3350/cmh.2023.0089 · DOI · Paper page
- 10.1001/jamaoto.2023.0704 · DOI · Paper page
- 10.1001/jama.2017.19198 · DOI · Paper page
- Luchetti M. Global health and the 10/90 gap. BJMP 2014;7:a731. https://www.bjmp.org/content/global-health-and-1090-gap.
- 10.1001/jamapsychiatry.2023.1253 · DOI · Paper page
- 10.1001/jamaoncol.2023.2867 · DOI
- 10.1002/humu.23644 · DOI · Paper page
- 10.1038/s41467-022-28594-0 · DOI
Cited by
Large Language Models and Empathy: Systematic Review
Sorin, V., Brin, D., Barash, Y., Konen, E., Charney, A., Nadkarni, G., & Klang, E. (2024) · Journal of Medical Internet Research · doi:10.2196/52597 · Cited by 240
“While LLMs have the potential to improve and automate some medical tasks, there are significant limitations to these models and their integration [10,11].”
Benchmark evaluation of DeepSeek large language models in clinical decision-making
Sandmann, S., Hegselmann, S., Fujarski, M., Bickmann, L., Wild, B., Eils, R., & Varghese, J. (2025) · Nature Medicine · doi:10.1038/s41591-025-03727-2 · Cited by 233
“However, the integration of LLMs into clinical practice is not without challenges, necessitating careful validation and ethical considerations 6,7 .”
Berkhout, W. E. M., van Wijngaarden, J. J., Workum, J. D., van de Sande, D., Hilling, D. E., Jung, C., Meyfroidt, G., Gommers, D., Buijsman, S. N. R., & van Genderen, M. E. (2025) · JAMA Network Open · doi:10.1001/jamanetworkopen.2025.22866 · Cited by 75
Nong, P., & Ji, M. (2025) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaf031 · Cited by 40
Bejan, C. A., Wang, M., Venkateswaran, S., Bergmann, E. A., Hiles, L., Xu, Y., Chandler, G. S., Brondfield, S., Silverstein, J., Wright, F., et al. (2026) · eBioMedicine · doi:10.1016/j.ebiom.2026.106227 · Cited by 24
“48 In the context of irAEs, biased GPT models may disproportionately misclassify patients from certain groups, resulting in their underrepresentation in pharmacoe-pidemiologic research and delayed identification in pharmacovigilance efforts, which could potentially compromise timely care and…”
Metadata
- Authors
- Ong, J. C. L., Chang, S. Y.-H., William, W., Butte, A. J., Shah, N. H., Chew, L. S. T., Liu, N., Doshi-Velez, F., Lu, W., Savulescu, J., & Ting, D. S. W.
- Venue
- NEJM AI
- Publisher
- Massachusetts Medical Society
- Published
- 2024-06-27
- Volume
- 1
- Issue
- 7
- ISSN
- 2836-9386 (ISSN-L)
- OpenAlex
- W4399737726
- Cited by
- 58
- References
- 56
- FWCI
- 4.57
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Medical Ethics of Large Language Models in Medicine. https://app.cochat.ai/papers/10.1056/aira2400038
- The paper
- Ong, J. C. L., Chang, S. Y.-H., William, W., Butte, A. J., Shah, N. H., Chew, L. S. T., Liu, N., Doshi-Velez, F., Lu, W., Savulescu, J., & Ting, D. S. W. (2024). Medical Ethics of Large Language Models in Medicine. NEJM AI. https://doi.org/10.1056/aira2400038
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.