CoChat
Sign Up
PreprintCited by 240Artificial Intelligence in Healthcare and EducationMachine Learning in HealthcareTopic Modeling

A Survey of Large Language Models in Medicine: Progress, Application, and Challenge

Open access
Zhou, Hongjian, Liu, Fenglin, Gu, Boyang, Zou, Xinyu, Huang, Jinfa, Wu, Jinge, Li, Yiru, Chen, Sam S. +11 more·2023·arXiv
DOI 10.48550/arxiv.2311.05112arXiv 2311.05112
Open this paper in CoChat — free accountOpen PDF

Abstract

Large language models (LLMs), such as ChatGPT, have received substantial attention due to their capabilities for understanding and generating human language. While there has been a burgeoning trend in research focusing on the employment of LLMs in supporting different medical tasks (e.g., enhancing clinical diagnostics and providing medical education), a review of these efforts, particularly their development, practical applications, and outcomes in medicine, remains scarce. Therefore, this review aims to provide a detailed overview of the development and deployment of LLMs in medicine, including the challenges and opportunities they face. In terms of development, we provide a detailed introduction to the principles of existing medical LLMs, including their basic model structures, number of parameters, and sources and scales of data used for model development. It serves as a guide for practitioners in developing medical LLMs tailored to their specific needs. In terms of deployment, we offer a comparison of the performance of different LLMs across various medical tasks, and further compare them with state-of-the-art lightweight models, aiming to provide an understanding of the advantages and limitations of LLMs in medicine. Overall, in this review, we address the following questions: 1) What are the practices for developing medical LLMs 2) How to measure the medical task performance of LLMs in a medical setting? 3) How have medical LLMs been employed in real-world practice? 4) What challenges arise from the use of medical LLMs? and 5) How to more effectively develop and deploy medical LLMs? By answering these questions, this review aims to provide insights into the opportunities for LLMs in medicine and serve as a practical resource. We also maintain a regularly updated list of practical guides on medical LLMs at https://github.com/AI-in-Health/MedLLMsPracticalGuide

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2311.05112

Cites

4 of 4 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • LLMs have capabilities in generating scientific text, guiding clinical trial design, optimizing code, synthesizing medical literature, and facilitating communication of technical findings.

    “These studies highlight LLMs’ capabilities in generating scientific text, guiding clinical trial design, optimizing code, synthesizing medical literature, and facilitating communication of technical findings [4–7].”

    From Integrating large language models in biostatistical workflows for clinical and translational research (2025) · cites this paper as [4]

    Section 3.2 (page not provided) describes medical text generation and summarization, and section 4.6 describes adapting medical language for different audiences. Section 4.1 discusses processing medical literature and matching patients to clinical trials, but not guiding trial design. The passages do not establish scientific-text generation specifically or optimization of programming code; section 4.2’s “clinical coding” means assigning medical codes, not improving software. (LLM, conf=0.86)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 98

  1. Zhao, W. X. et al. A survey of large language models. arXiv preprint arXiv:2303.18223 (2023). · arXiv
  2. Yang, J. et al. Harnessing the power of llms in practice: A survey on chatgpt and beyond. arXiv preprint arXiv:2304.13712 (2023). · arXiv
  3. Chowdhery, A. et al. Palm: Scaling language modeling with pathways. arXiv preprint arXiv:2204.02311 (2022). · arXiv
  4. Touvron, H. et al. Llama: Open and efficient foundation language models. arXiv preprint arXiv:2302.13971 (2023). · arXiv
  5. Touvron, H. et al. Llama 2: Open foundation and fine-tuned chat models. arXiv preprint arXiv:2307.09288 (2023). · arXiv
  6. Brown, T. et al. Language models are few-shot learners. Adv. neural information processing systems 33, 1877-1901 (2020).
  7. OpenAI. Gpt-4 technical report. arXiv preprint arXiv:2303.08774 (2023). · arXiv
  8. Du, Z. et al. Glm: General language model pretraining with autoregressive blank infilling. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics, 320-335 (2022).
  9. Zeng, A. et al. Glm-130b: An open bilingual pre-trained model. In International Conference on Learning Representations (2022).
  10. Singhal, K. et al. Towards expert-level medical question answering with large language models. arXiv preprint arXiv:2305.09617 (2023). · arXiv
  11. Nori, H. et al. Can generalist foundation models outcompete special-purpose tuning? case study in medicine. arXiv preprint arXiv:2311.16452 (2023). · arXiv
  12. Wu, C., Zhang, X., Zhang, Y., Wang, Y. & Xie, W. Pmc-llama: Further finetuning llama on medical papers. arXiv preprint arXiv:2304.14454 (2023). · arXiv
  13. Jin, D. et al. What disease does this patient have? a large-scale open domain question answering dataset from medical exams. Appl. Sci. 11, 6421 (2021).
  14. Li, Y. et al. Chatdoctor: A medical chat model fine-tuned on a large language model meta-ai (llama) using medical domain knowledge. arXiv preprint arXiv:2303.14070 (2023). · arXiv
  15. Han, T. et al. Medalpaca-an open-source collection of medical conversational ai models and training data. arXiv preprint arXiv:2304.08247 (2023). · arXiv
  16. Wang, H. et al. Huatuo: Tuning llama model with chinese medical knowledge. arXiv preprint arXiv:2304.06975 (2023). · arXiv
  17. Toma, A. et al. Clinical camel: An open-source expert-level medical language model with dialogue-based knowledge encoding. arXiv preprint arXiv:2305.12031 (2023). · arXiv
  18. Omiye, J. A., Gui, H., Rezaei, S. J., Zou, J. & Daneshjou, R. Large language models in medicine: The potentials and pitfalls. Annals Intern. Medicine (2024).
  19. Clusmann, J. et al. The future landscape of large language models in medicine. Commun. Medicine 3, 141 (2023).
  20. Yang, X. et al. A large language model for electronic health records. NPJ Digit. Medicine 5, 194 (2022).
  21. Abd-Alrazaq, A. et al. Large language models in medical education: Opportunities, challenges, and future directions. JMIR Med. Educ. 9, e48291 (2023).
  22. Bengio, Y., Ducharme, R. & Vincent, P. A neural probabilistic language model. Adv. neural information processing systems 13 (2000).
  23. Mikolov, T., Karafiát, M., Burget, L., Cernockỳ, J. & Khudanpur, S. Recurrent neural network based language model. In Interspeech, vol. 2, 1045-1048 (2010).
  24. Sundermeyer, M., Ney, H. & Schlüter, R. From feedforward to recurrent lstm neural networks for language modeling. IEEE/ACM Transactions on Audio, Speech, Lang. Process. 23, 517-529 (2015).
  25. Vaswani, A. et al. Attention is all you need. Adv. neural information processing systems 30 (2017).
  26. Devlin, J., Chang, M.-W., Lee, K. & Toutanova, K. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018). · arXiv
  27. Hoffmann, J. et al. Training compute-optimal large language models. arXiv preprint arXiv:2203.15556 (2022). · arXiv
  28. He, P., Liu, X., Gao, J. & Chen, W. Deberta: Decoding-enhanced bert with disentangled attention. arXiv preprint arXiv:2006.03654 (2021). · arXiv
  29. Yang, A. et al. Baichuan 2: Open large-scale language models. arXiv preprint arXiv:2309.10305 (2023). · arXiv
  30. Chung, H. W. et al. Scaling instruction-finetuned language models. arXiv preprint arXiv:2210.11416 (2022). · arXiv
  31. Joseph, S. et al. Multilingual simplification of medical texts. arXiv preprint arXiv:2305.12532 (2023). · arXiv
  32. Liu, Y. et al. Roberta: A robustly optimized bert pretraining approach. arXiv preprint arXiv:1907.11692 (2019). · arXiv
  33. Radford, A. et al. Language models are unsupervised multitask learners. OpenAI blog 1, 9 (2019).
  34. Jiang, A. Q. et al. Mistral 7b. arXiv preprint arXiv:2310.06825 (2023). · arXiv
  35. Bai, J. et al. Qwen technical report. arXiv preprint arXiv:2309.16609 (2023). · arXiv
  36. Ouyang, L. et al. Training language models to follow instructions with human feedback. Adv. Neural Inf. Process. Syst. 35, 27730-27744 (2022).
  37. Lewis, M. et al. Bart: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension. arXiv preprint arXiv:1910.13461 (2019). · arXiv
  38. Tay, Y. et al. Ul2: Unifying language learning paradigms. In International Conference on Learning Representations (2022).
  39. Gu, Y. et al. Domain-specific language model pretraining for biomedical natural language processing. ACM Transactions on Comput. for Healthc. (HEALTH) 3, 1-23 (2021).
  40. Beltagy, I., Lo, K. & Cohan, A. Scibert: A pretrained language model for scientific text. arXiv preprint arXiv:1903.10676 (2019). · arXiv
  41. Ammar, W. et al. Construction of the literature graph in semantic scholar. arXiv preprint arXiv:1805.02262 (2018). · arXiv
  42. Alsentzer, E. et al. Publicly available clinical bert embeddings. arXiv preprint arXiv:1904.03323 (2019). · arXiv
  43. Gururangan, S. et al. Don't stop pretraining: Adapt language models to domains and tasks. In Proceedings of Association for Computational Linguistics (ACL) (2020).
  44. Lo, K., Wang, L. L., Neumann, M., Kinney, R. & Weld, D. S. S2orc: The semantic scholar open research corpus. arXiv preprint arXiv:1911.02782 (2019). · arXiv
  45. Yasunaga, M., Leskovec, J. & Liang, P. Linkbert: Pretraining language models with document links. In Proceedings of Association for Computational Linguistics (ACL) (2022).
  46. Peng, Y., Yan, S. & Lu, Z. Transfer learning in biomedical natural language processing: An evaluation of bert and elmo on ten benchmarking datasets. In Proceedings of the 18th BioNLP Workshop and Shared Task, 58-65 (2019).
  47. Mutinda, F. W. et al. Detecting redundancy in electronic medical records using clinical bert. In Proceedings of the Annual Conference of the Association for Natural Language Processing, 16-19 (2020).
  48. Mahajan, D. et al. Identification of semantically similar sentences in clinical notes: Iterative intermediate training using multi-task learning. JMIR medical informatics 8, e22508 (2020).
  49. Phan, L. N. et al. Scifive: a text-to-text transformer model for biomedical literature. arXiv preprint arXiv:2106.03598 (2021). · arXiv
  50. Lu, Q., Dou, D. & Nguyen, T. Clinicalt5: A generative language model for clinical text. In Findings of the Association for Computational Linguistics: EMNLP 2022, 5436-5443 (2022).
  51. Jin, Q. et al. Medcpt: Contrastive pre-trained transformers with large-scale pubmed search logs for zero-shot biomedical information retrieval. arXiv preprint arXiv:2307.00589 (2023). · arXiv
  52. Yasunaga, M. et al. Deep bidirectional language-knowledge graph pretraining. Adv. Neural Inf. Process. Syst. 35, 37309-37323 (2022).
  53. Zhu, Y. et al. Aligning books and movies: Towards story-like visual explanations by watching movies and reading books. In Proceedings of the IEEE international conference on computer vision, 19-27 (2015).
  54. Venigalla, A., Frankle, J. & Carbin, M. Biomedlm: a domain-specific large language model for biomedical text. MosaicML. Accessed: Dec 23, 2 (2022).
  55. Gao, L. et al. The Pile: An 800gb dataset of diverse text for language modeling. arXiv preprint arXiv:2101.00027 (2020). · arXiv
  56. Gao, W. et al. Ophglm: Training an ophthalmology large language-and-vision assistant based on instructions and dialogue. arXiv preprint arXiv:2306.12174 (2023). · arXiv
  57. Chen, S. et al. Meddialog: a large-scale medical dialogue dataset. arXiv preprint arXiv:2004.03329 3 (2020). · arXiv
  58. Peng, C. et al. A study of generative large language model for medical research and healthcare. arXiv preprint arXiv:2305.13523 (2023). · arXiv
  59. Xiong, H. et al. Doctorglm: Fine-tuning your chinese doctor is not a herculean task. arXiv preprint arXiv:2304.01097 (2023). · arXiv
  60. Chen, Y. et al. Bianque: Balancing the questioning and suggestion ability of health llms with multi-turn health conversations polished by chatgpt. arXiv preprint arXiv:2310.15896 (2023). · arXiv
  61. Wang, G., Yang, G., Du, Z., Fan, L. & Li, X. Clinicalgpt: Large language models finetuned with diverse medical data and comprehensive evaluation. arXiv preprint arXiv:2306.09968 (2023). · arXiv
  62. Ye, Q. et al. Qilin-med: Multi-stage knowledge injection advanced medical large language model. arXiv preprint arXiv:2310.09089 (2023). · arXiv
  63. Zhang, H. et al. Huatuogpt, towards taming language model to be a doctor. arXiv preprint arXiv:2305.15075 (2023). · arXiv
  64. Xu, C., Guo, D., Duan, N. & McAuley, J. Baize: An open-source chat model with parameter-efficient tuning on self-chat data. arXiv preprint arXiv:2304.01196 (2023). · arXiv
  65. Luo, Y. et al. Biomedgpt: Open multimodal generative pre-trained transformer for biomedicine. arXiv preprint arXiv:2308.09442 (2023). · arXiv
  66. Zhang, X. et al. Alpacare: Instruction-tuned large language models for medical application. arXiv preprint arXiv:2310.14558 (2023). · arXiv
  67. Yang, S. et al. Zhongjing: Enhancing the chinese medical capabilities of large language model through expert feedback and real-world multi-turn dialogue. arXiv preprint arXiv:2308.03549 (2023). · arXiv
  68. Shoham, O. B. & Rappoport, N. Cpllm: Clinical prediction with large language models. arXiv preprint arXiv:2309.11295 (2023). · arXiv
  69. Chen, Z. et al. Meditron-70b: Scaling medical pretraining for large language models. arXiv preprint arXiv:2311.16079 (2023). · arXiv
  70. Bosselut, A. et al. Meditron: Open medical foundation models adapted for clinical practice. Preprint (2024).
  71. He, X., Zhang, Y., Mou, L., Xing, E. & Xie, P. Pathvqa: 30000+ questions for medical visual question answering. arXiv preprint arXiv:2003.10286 (2020). 102. Li, C. et al. Llava-med: Training a large language-and-vision assistant for biomedicine in one day. Adv. Neural Inf. Process. Syst. 36 (2024). 103. Liu, B. et al. Slake: A semantically-labeled knowledge-enhanced dataset for medical visual question answering. In 2021 IEEE 18th International Symposium on Biomedical Imaging (ISBI), 1650-1654 (IEEE, 2021). 104. · arXiv
  72. Hyland, S. L. et al. Maira-1: A specialised large multimodal model for radiology report generation. arXiv preprint arXiv:2311.13668 (2023). 105. · arXiv
  73. Johnson, A. E. et al. Mimic-cxr, a de-identified publicly available database of chest radiographs with free-text reports. Sci. data 6, 317 (2019). 106. Wu, C., Zhang, X., Zhang, Y., Wang, Y. & Xie, W. Towards generalist foundation model for radiology. arXiv preprint arXiv:2308.02463 (2023). 107. Yang, L. et al. Advancing multimodal medical capabilities of gemini. arXiv preprint arXiv:2405.03162 (2024). 108. · arXiv
  74. Saab, K. et al. Capabilities of gemini models in medicine. arXiv preprint arXiv:2404.18416 (2024). 109. Tanno, R. et al. Consensus, dissensus and synergy between clinicians and specialist foundation models in radiology report generation. arXiv preprint arXiv:2311.18260 (2023). 110. Liévin, V., Hother, C. E. & Winther, O. Can large language models reason about medical questions? arXiv preprint arXiv:2207.08143 (2022). 111. Wei, J. et al. Chain-of-thought prompting elicits reasoning in large language models. Adv. Neural Inf. Process. Syst. 35, 24824-24837 (2022). 112 · arXiv
  75. Liu, Z. et al. Deid-gpt: Zero-shot medical text de-identification by gpt-4. arXiv preprint arXiv:2303.11032 (2023). 113. Wang, S., Zhao, Z., Ouyang, X., Wang, Q. & Shen, D. Chatcad: Interactive computer-aided diagnosis on medical image using large language models. arXiv preprint arXiv:2302.07257 (2023). 114. Gao, Y. et al. Leveraging a medical knowledge graph into large language models for diagnosis prediction. arXiv e-prints arXiv-2308 (2023). 115. Bodenreider, O. The unified medical language system (umls): integrating biomedical terminology. Nucleic acids research 32, D267-D270 (2004). 116 · arXiv
  76. Ondov, B., Attal, K. & Demner-Fushman, D. A survey of automated methods for biomedical text simplification. J. Am. Med. Informatics Assoc. 29, 1976-1988 (2022). 146. Liu, F. et al. Retrieve, reason, and refine: Generating accurate and faithful patient instructions. Adv. Neural Inf. Process. Syst. 35, 18864-18877 (2022). 147. Jin, Q., Dhingra, B., Liu, Z., Cohen, W. W. & Lu, X. Pubmedqa: A dataset for biomedical research question answering. arXiv preprint arXiv:1909.06146 (2019). 148. Pal, A., Umapathi, L. K. & Sankarasubbu, M. Medmcqa: A large-scale multi-subject multi-choice dataset for medical domain question answering. In Conference on Health, Inference, and Learning, 248-260 (2022). 149. · arXiv
  77. Dogan, R. I., Leaman, R. & Lu, Z. Ncbi disease corpus: a resource for disease name recognition and concept normalization. J. biomedical informatics 47, 1-10 (2014). 150. Dong, H. et al. Automated clinical coding: what, why, and where we are? NPJ digital medicine 5, 159 (2022). 151. D'Onofrio, G. et al. Emotion recognizing by a robotic solution initiative. Sensors 22, 2861 (2022). 152. Biri, S. K. et al. Assessing the utilization of large language models in medical education: Insights from undergraduate medical students. Cureus 15 (2023). 153. Vaidyam, A. N., Wisniewski, H., Halamka, J. D., Kashavan, M. S. & Torous, J. B. Chatbots and conversational agents in mental health: a review of the psychiatric landscape. The Can. J. Psychiatry 64, 456-464 (2019). 154. McDuff, D. et al. Towards accurate differential diagnosis with large language models. arXiv preprint arXiv:2312.00164 (2023). 155. Kraljevic, Z. et al. Foresight-a generative pretrained transformer for modelling of patient timelines using electronic health records: a retrospective modelling study. The Lancet Digit. Heal. 6, e281-e290 (2024). 156. Jin, Q. et al. Matching patients to clinical trials with large language models. ArXiv (2023). 157. Koopman, B. & Zuccon, G. A test collection for matching patients to clinical trials. In Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval, 669-672 (2016). 158. Roberts, K., Demner-Fushman, D., Voorhees, E. M., Bedrick, S. & Hersh, W. R. Overview of the trec 2022 clinical trials track. In TREC (2022). 159. · arXiv
  78. Huang, C.-W., Tsai, S.-C. & Chen, Y.-N. Plm-icd: Automatic icd coding with pretrained language models. arXiv e-prints arXiv-2207 (2022). 160.
  79. Saeed, M., Lieu, C., Raber, G. & Mark, R. G. Mimic ii: a massive temporal icu patient database to support research in intelligent patient monitoring. In Computers in cardiology, 641-644 (IEEE, 2002). 161. Wang, H., Gao, C., Dantona, C., Hull, B. & Sun, J. Drg-llama: tuning llama model to predict diagnosis-related group for hospitalized patients. npj Digit. Medicine 7, 16 (2024). 162. Liu, J., Yang, S., Peng, T., Hu, X. & Zhu, Q. Chaticd: Prompt learning for few-shot icd coding through chatgpt. In 2023 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), 4360-4367 (2023). 163. Yang, Z., Batra, S. S., Stremmel, J. & Halperin, E. Surpassing gpt-4 medical coding with a two-stage approach. arXiv preprint arXiv:2311.13735 (2023). 164. Ma, C. et al. An iterative optimizing framework for radiology report summarization with chatgpt. IEEE Transactions on Artif. Intell. (2024). 165. Open-i. https://openi.nlm.nih.gov/. Accessed: 2024-05-14. 166. Van Veen, D. et al. Radadapt: Radiology report summarization via lightweight domain adaptation of large language models. arXiv preprint arXiv:2305.01146 (2023). 167. Moghani, M. et al. Sufia: Language-guided augmented dexterity for robotic surgical assistants. arXiv preprint arXiv:2405.05226 (2024). 168. Yu, Q. et al. Orbit-surgical: An open-simulation framework for learning surgical augmented dexterity. arXiv preprint arXiv:2404.16027 (2024). 169. Xu, H. et al. Enhancing surgical robots with embodied intelligence for autonomous ultrasound scanning. arXiv preprint arXiv:2405.00461 (2024). 170. Killeen, B. D., Chaudhary, S., Osgood, G. & Unberath, M. Take a shot! natural language control of intelligent robotic x-ray systems in surgery. Int. J. Comput. Assist. Radiol. Surg. 1-9 (2024). 171. García-Ferrero, I. et al. Medical mt5: an open-source multilingual text-to-text llm for the medical domain. arXiv preprint arXiv:2404.07613 (2024). 172. Tiedemann, J. Parallel data, tools and interfaces in opus. In Lrec, vol. 2012, 2214-2218 (2012). 173. National Library of Medicine. Clinical trials. https://clinicaltrials.gov/ (2022). Accessed: 2024-05-14. 174. Wang, X. et al. Apollo: Lightweight multilingual medical llms towards democratizing medical ai to 6b people. arXiv preprint arXiv:2403.03640 (2024). 175. Pieri, S. et al. Bimedix: Bilingual medical mixture of experts llm. arXiv preprint arXiv:2402.13253 (2024). 176. Tang, C., Wang, S., Goldsack, T. & Lin, C. Improving biomedical abstractive summarisation with knowledge aggregation from citation papers. arXiv preprint arXiv:2310.15684 (2023). 177. Guo, Y., Qiu, W., Leroy, G., Wang, S. & Cohen, T. Retrieval augmentation of large language models for lay language generation. J. Biomed. Informatics 149, 104580 (2024). 178. Peacock, J., Austin, A., Shapiro, M., Battista, A. & Samuel, A. Accelerating medical education with chatgpt: an implementation guide. MedEdPublish 13 (2023). 179. · arXiv
  80. Qiu, H., Li, A., Ma, L. & Lan, Z. Psychat: A client-centric dialogue system for mental health support. arXiv preprint arXiv:2312.04262 (2023). 180. Liu, J. M. et al. Chatcounselor: A large language models for mental health support. arXiv preprint arXiv:2309.15461 (2023). 181. Xu, X. et al. Mental-llm: Leveraging large language models for mental health prediction via online text data. Proc. ACM on Interactive, Mobile, Wearable Ubiquitous Technol. 8, 1-32 (2024). 182. · arXiv
  81. Turcan, E. & McKeown, K. Dreaddit: A reddit dataset for stress analysis in social media. arXiv preprint arXiv:1911.00133 (2019). 183. Naseem, U., Dunn, A. G., Kim, J. & Khushi, M. Early identification of depression severity levels on reddit using ordinal classification. In Proceedings of the ACM Web Conference 2022, 2563-2572 (2022). 184. Haque, A., Reddi, V. & Giallanza, T. Deep learning for suicide and depression identification with unsupervised label correction. In International Conference on Artificial Neural Networks, 436-447 (2021). 185. Gaur, M. et al. Knowledge-aware assessment of severity of suicide risk for early intervention. In The world wide web conference, 514-525 (2019). 186. Sampath, K. & Durairaj, T. Data set creation and empirical analysis for detecting signs of depression from social media postings. In International Conference on Computational Intelligence in Data Science, 136-151 (2022). 187. · arXiv
  82. Jamil, Z. Monitoring tweets for depression to detect at-risk users. Ph.D. thesis, Université d'Ottawa/University of Ottawa (2017). 188. Mauriello, M. L. et al. Sad: A stress annotated dataset for recognizing everyday stressors in sms-like conversational systems. In Extended abstracts of the 2021 CHI conference on human factors in computing systems, 1-7 (2021). 189. Tu, T. et al. Towards conversational diagnostic ai. arXiv preprint arXiv:2401.05654 (2024). 190. Ren, Z., Zhan, Y., Yu, B., Ding, L. & Tao, D. Healthcare copilot: Eliciting the power of general llms for medical consultation. arXiv preprint arXiv:2402.13408 (2024). 191. · arXiv
  83. Sun, Z., Luo, C. & Huang, Z. Conversational disease diagnosis via external planner-controlled large language models. arXiv preprint arXiv:2404.04292 (2024). 192. · arXiv
  84. Rajpurkar, P., Chen, E., Banerjee, O. & Topol, E. J. Ai in health and medicine. Nat. medicine 28, 31-38 (2022). 193. Raffel, C. et al. Exploring the limits of transfer learning with a unified text-to-text transformer. The J. Mach. Learn. Res. 21, 5485-5551 (2020). 194. Liu, F., Wu, X., Ge, S., Fan, W. & Zou, Y. Exploring and distilling posterior and prior knowledge for radiology report generation. In IEEE Conference on Computer Vision and Pattern Recognition (2021). 195. Food, Administration, D. et al. National drug code directory (Consumer Protection and Environmental Health Service, Public Health Service . . . , 1976). 196. Liu, S., Ma, W., Moore, R., Ganesan, V. & Nelson, S. Rxnorm: prescription for electronic drug information exchange. IT professional 7, 17-23 (2005). 197.
  85. Elkin, P. L. & Brown, S. H. Current procedural terminology. In Terminology, Ontology and their Implementations, 367-370 (Springer, 2023). 198. Liu, X. et al. Reporting guidelines for clinical trials evaluating artificial intelligence interventions are needed. Nat. Medicine 25, 1467-1469 (2019). 199.
  86. Papineni, K., Roukos, S., Ward, T. & Zhu, W. BLEU: a Method for automatic evaluation of machine translation. In Proceedings of Association for Computational Linguistics (ACL) (2002). 200.
  87. Lin, C.-Y. ROUGE: A package for automatic evaluation of summaries. In Proceedings of Association for Computational Linguistics (ACL) (2004). 201.
  88. Banerjee, S. & Lavie, A. Meteor: An automatic metric for mt evaluation with improved correlation with human judgments. In ACL workshop on intrinsic and extrinsic evaluation measures for machine translation and summarization, 65-72 (2005). 202. Zhang, T., Kishore, V., Wu, F., Weinberger, K. Q. & Artzi, Y. Bertscore: Evaluating text generation with bert. arXiv preprint arXiv:1904.09675 (2019). 203. Smit, A. et al. Chexbert: combining automatic labelers and expert annotations for accurate radiology report labeling using bert. arXiv preprint arXiv:2004.09167 (2020). 204. Jain, S. et al. Radgraph: Extracting clinical entities and relations from radiology reports. arXiv preprint arXiv:2106.14463 (2021). 205. Yu, F. et al. Evaluating progress in automatic chest x-ray radiology report generation. Patterns 4 (2023). 206. Xie, Q. et al. Faithful ai in medicine: A systematic review with large language models and beyond. medRxiv (2023). 207. · arXiv
  89. Dupont, P. E. et al. A decade retrospective of medical robotics research from 2010 to 2020. Sci. robotics 6, eabi8017 (2021). 208. Chen, K. et al. Llm-assisted multi-teacher continual learning for visual question answering in robotic surgery. arXiv preprint arXiv:2402.16664 (2024). 209. Wang, J. et al. Large language models for robotics: Opportunities, challenges, and perspectives. arXiv preprint arXiv:2401.04334 (2024). 210. Weerarathna, I. N., Raymond, D. & Luharia, A. Human-robot collaboration for healthcare: A narrative review. Cureus 15 (2023). 211. Moglia, A., Georgiou, K., Georgiou, E., Satava, R. M. & Cuschieri, A. A systematic review on artificial intelligence in robot-assisted surgery. Int. J. Surg. 95, 106151 (2021). 212. Xia, Y., Wang, S. & Kan, Z. A nested u-structure for instrument segmentation in robotic surgery. In International Conference on Advanced Robotics and Mechatronics (ICARM), 994-999 (2023). 213. Chen, Y., Arunasalam, A. & Celik, Z. B. Can large language models provide security & privacy advice? measuring the ability of llms to refute misconceptions. In Proceedings of the 39th Annual Computer Security Applications Conference, 366-378 (2023). 214. Karabacak, M. et al. The advent of generative language models in medical education. JMIR Med. Educ. 9, e48163 (2023). 215. Qiu, J. et al. Large ai models in health informatics: Applications, challenges, and the future. IEEE J. Biomed. Heal. Informatics (2023). 216. Ahn, S. The impending impacts of large language models on medical education. Korean J. Med. Educ. 35, 103 (2023). 217. OpenAI. Chatgpt [large language model]. https://chat.openai.com (2023). 218. · arXiv
  90. Rawte, V., Sheth, A. & Das, A. A survey of hallucination in large foundation models. arXiv preprint arXiv:2309.05922 (2023). 219. Stock, A., Schlögl, S. & Groth, A. Tell me, what are you most afraid of? exploring the effects of agent representation on information disclosure in human-chatbot interaction. arXiv e-prints arXiv-2307 (2023). 220. · arXiv
  91. De Choudhury, M., Pendse, S. R. & Kumar, N. Benefits and harms of large language models in digital mental health. arXiv preprint arXiv:2311.14693 (2023). 221. Hua, Y. et al. Large language models in mental health care: a scoping review (2024). 2401.02984. 222. Robinson, N., Connolly, J., Suddrey, G. & Kavanagh, D. J. A brief wellbeing training session delivered by a humanoid social robot: A pilot randomized controlled trial. arXiv e-prints arXiv-2308 (2023). 223. Lai, T. et al. Psy-llm: Scaling up global mental health psychological services with ai-based large language models. arXiv preprint arXiv:2307.11991 (2023). 224. Ma, Z., Mei, Y. & Su, Z. Understanding the benefits and challenges of using large language model-based conversational agents for mental well-being support. In AMIA Annual Symposium Proceedings, vol. 2023, 1105 (2023). 225. · arXiv
  92. Chung, N. C., Dyer, G. & Brocki, L. Challenges of large language models for mental health counseling. arXiv preprint arXiv:2311.13857 (2023). 226. Wang, J., Yang, Z., Yao, Z. & Yu, H. Jmlr: Joint medical llm and retrieval training for enhancing reasoning and professional question answering capability. arXiv preprint arXiv:2402.17887 (2024). 227. Hager, P. et al. Evaluation and mitigation of the limitations of large language models in clinical decision-making. Nat. Medicine 1-10 (2024). 228. Stokel-Walker, C. Chatgpt listed as author on research papers: many scientists disapprove. Nature 613, 620-621 (2023). 229. Shen, X., Chen, Z., Backes, M., Shen, Y. & Zhang, Y. " do anything now": Characterizing and evaluating in-the-wild jailbreak prompts on large language models. arXiv preprint arXiv:2308.03825 (2023). 230. Umapathi, L. K., Pal, A. & Sankarasubbu, M. Med-halt: Medical domain hallucination test for large language models. arXiv preprint arXiv:2307.15343 (2023). 231. Roit, P. et al. Factually consistent summarization via reinforcement learning with textual entailment feedback. arXiv preprint arXiv:2306.00186 (2023). 232. Chern, I.-C. et al. Improving factuality of abstractive summarization via contrastive reward learning. arXiv preprint arXiv:2307.04507 (2023). 233. Manakul, P., Liusie, A. & Gales, M. J. Selfcheckgpt: Zero-resource black-box hallucination detection for generative large language models. arXiv preprint arXiv:2303.08896 (2023). 234. · arXiv
  93. Shuster, K., Poff, S., Chen, M., Kiela, D. & Weston, J. Retrieval augmentation reduces hallucination in conversation. arXiv preprint arXiv:2104.07567 (2021). 235. Dhuliawala, S. et al. Chain-of-verification reduces hallucination in large language models. arXiv preprint arXiv:2309.11495 (2023). 236. Lin, S., Hilton, J. & Evans, O. Truthfulqa: Measuring how models mimic human falsehoods. arXiv preprint arXiv:2109.07958 (2021). 237. Li, J., Cheng, X., Zhao, W. X., Nie, J.-Y. & Wen, J.-R. Halueval: A large-scale hallucination evaluation benchmark for large language models. arXiv e-prints arXiv-2305 (2023). 238. Liu, F. et al. Auto-encoding knowledge graph for unsupervised medical report generation. In Advances in Neural Information Processing Systems (2021). 239. Shumailov, I. et al. Model dementia: Generated data makes models forget. arXiv preprint arXiv:2305.17493 (2023). 240. Hoelscher-Obermaier, J., Persson, J., Kran, E., Konstas, I. & Barez, F. Detecting edit failures in large language models: An improved specificity benchmark. arXiv preprint arXiv:2305.17553 (2023). 241. Liu, F. et al. A medical multimodal large language model for future pandemics. npj Digit. Medicine 6, 226 (2023). 242. Yao, Y. et al. Editing large language models: Problems, methods, and opportunities. arXiv preprint arXiv:2305.13172 (2023). 243. · arXiv
  94. Lewis, P. et al. Retrieval-augmented generation for knowledge-intensive nlp tasks. Adv. Neural Inf. Process. Syst. 33, 9459-9474 (2020). 244. Hendrycks, D. et al. Aligning ai with shared human values. arXiv preprint arXiv:2008.02275 (2020). 245. Glaese, A. et al. Improving alignment of dialogue agents via targeted human judgements. arXiv preprint arXiv:2209.14375 (2022). 246. Nakano, R. et al. Webgpt: Browser-assisted question-answering with human feedback. arXiv preprint arXiv:2112.09332 (2021). 247. Liu, H., Sferrazza, C. & Abbeel, P. Chain of hindsight aligns language models with feedback. arXiv preprint arXiv:2302.02676 3 (2023). 248. Sallam, M. Chatgpt utility in healthcare education, research, and practice: systematic review on the promising perspectives and valid concerns. In Healthcare, 887 (MDPI, 2023). 249. Tian, S. et al. Opportunities and challenges for chatgpt and large language models in biomedicine and health. Briefings Bioinforma. 25, bbad493 (2024). 250. Li, H., Guo, D., Fan, W., Xu, M. & Song, Y. Multi-step jailbreaking privacy attacks on chatgpt. arXiv preprint arXiv:2304.05197 (2023). 251. Wei, A., Haghtalab, N. & Steinhardt, J. Jailbroken: How does llm safety training fail? arXiv preprint arXiv:2307.02483 (2023). 252. Meskó, B. & Topol, E. J. The imperative for regulatory oversight of large language models (or generative ai) in healthcare. NPJ digital medicine 6, 120 (2023). 253. · arXiv
  95. Mökander, J., Schuett, J., Kirk, H. R. & Floridi, L. Auditing large language models: a three-layered approach. AI Ethics 1-31 (2023). 256. Chen, Q. et al. An extensive benchmark study on biomedical text generation and mining with chatgpt. Bioinformatics 39, btad557 (2023). 257. Chen, Q. et al. Large language models in biomedical natural language processing: benchmarks, baselines, and recommen- dations. arXiv preprint arXiv:2305.16326 (2023). 258. Yin, S. et al. A survey on multimodal large language models. arXiv preprint arXiv:2306.13549 (2023). 259. Tu, T. et al. Towards generalist biomedical ai. arXiv preprint arXiv:2307.14334 (2023). 260. Li, C. et al. Llava-med: Training a large language-and-vision assistant for biomedicine in one day. arXiv preprint arXiv:2306.00890 (2023). 261. Shu, C., Liu, F. & Shareghi, C. Visual med-alpaca: A parameter-efficient biomedical llm with visual capabilities. https://github.com/cambridgeltl/visual-med-alpaca (2023). 262. · arXiv
  96. Moor, M. et al. Med-flamingo: a multimodal medical few-shot learner. arXiv preprint arXiv:2307.15189 (2023). 263. Liu, J. et al. Qilin-med-vl: Towards chinese large vision-language model for general healthcare. arXiv preprint arXiv:2310.17956 (2023). 264. Huang, H. et al. Chatgpt for shaping the future of dentistry: the potential of multi-modal large language model. Int. J. Oral Sci. 15, 29 (2023). 265. Li, J., Liu, C., Cheng, S., Arcucci, R. & Hong, S. Frozen language model helps ecg zero-shot learning. arXiv preprint arXiv:2303.12311 (2023). 266. Englhardt, Z. et al. Exploring and characterizing large language models for embedded system development and debugging. arXiv preprint arXiv:2307.03817 (2023). 267. · arXiv
  97. Xi, Z. et al. The rise and potential of large language model based agents: A survey. arXiv preprint arXiv:2309.07864 (2023). 268. Wang, L. et al. A survey on large language model based autonomous agents. arXiv preprint arXiv:2308.11432 (2023). 269. Li, G., Hammoud, H. A. A. K., Itani, H., Khizbullin, D. & Ghanem, B. Camel: Communicative agents for "mind" exploration of large scale language model society. arXiv preprint arXiv:2303.17760 (2023). 270. Tang, X. et al. Medagents: Large language models as collaborators for zero-shot medical reasoning. arXiv preprint arXiv:2311.10537 (2023). 271. Organization, W. H. Physical activity (2022). Accessed: Aug. 18, 2023. 272. · arXiv
  98. Connor, M. & O'Neill, M. Large language models in sport science & medicine: Opportunities, risks and considerations. arXiv preprint arXiv:2305.03851 (2023). 273. Mello, M. M. & Guha, N. Chatgpt and physicians' malpractice risk. In JAMA Health Forum, e231938-e231938 (2023). · arXiv

Cited by

Sorted by citations

Authors
Zhou, H., Liu, F., Gu, B., Zou, X., Huang, J., Wu, J., Li, Y., Chen, S. S., Zhou, P., Liu, J., Hua, Y., Mao, C., You, C., Wu, X., Zheng, Y., Clifton, L., Li, Z., Luo, J., & Clifton, D. A.
Affiliations
  • University of Oxford (GB)
  • Imperial College London (GB)
  • University of Waterloo (CA)
  • University of Rochester (US)
  • University College London (GB)
  • Western University (CA)
  • University of Georgia (US)
  • The Hong Kong University of Science and Technology (Guangzhou) (CN)
  • Peking University (CN)
  • Harvard University (US)
  • Massachusetts Institute of Technology (US)
  • Stony Brook University (US)
  • Tencent (China) (CN)
  • Amazon (United States) (US)
Corresponding author
Liu, Fenglin
ORCID
Venue
arXiv
Publisher
arXiv
Published
2023
Volume
3
Issue
6
Pages
445-464
ISSN
2731-6092 (ISSN-L)
DOI
10.48550/arxiv.2311.05112
arXiv
2311.05112
OpenAlex
W4409235391
Cited by
240
References
4
Citations by year
2026: 114 · 2025: 102 · 2024: 22 · 2023: 2
FWCI
10.98
Type
journal article
Language
en
Open access
Licence
Locations
  • Nature Reviews Bioengineering (publishedVersion)
  • Oxford University Research Archive (ORA) (University of Oxford) (acceptedVersion)
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Funders
  • UK Research and Innovation
  • National Institute for Health and Care Research
  • Royal Academy of Engineering
  • University of Oxford
  • Engineering and Physical Sciences Research Council
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
Keywords
large language models, ChatGPT, medical LLMs, clinical diagnostics, medical education, LLM deployment, model architecture, training data, lightweight models, clinical decision support

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review