The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Benefits, Limits, and Risks of GPT-4 as an AI Chatbot for Medicine
Abstract
Chatbots are computer programs with which one can have a conversation. In this article, the authors describe how the GPT-4 chatbot, which has been given a general education, could affect the practice of medicine.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Large language models (LLMs), with their superior contextual semantic understanding, offer a promising avenue to overcome these limitations [8, 9].”
From Enhancing hepatopathy clinical trial efficiency: a secure, large language model-powered pre-screening pipeline (2025) · cites this paper as [8]
In the citing paper
“Previous research has documented LLM hallucination in various contexts, including medical information [8], legal reasoning [9], and general factual queries [10].”
From Compound Deception in Elite Peer Review: A Failure Mode Taxonomy of 100 Fabricated Citations at NeurIPS 2025 (2026) · cites this paper as [8]
In the citing paper
“This is in contrast to prior work that claims LMs approach human performance, even for complex tasks (Ding et al., 2022; Nori et al., 2023; Lee et al., 2023) even though the task of writing biographies is fairly easy.”
From FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation (2023) · cites this paper as Lee et al., 2023
In the citing paper
“This is in contrast to prior work that claims LMs approach human performance, even for complex tasks (Ding et al., 2022; Nori et al., 2023; Lee et al., 2023) even though the task of writing biographies is fairly easy.”
From FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation (2023) · cites this paper as Lee et al., 2023
In the citing paper
“Studies evaluating GPT-4 and Claude on medical board examinations report accuracy rates of 80-90% [3,6]”
From Benchmarking Large Language Models for Intensive Care Unit Clinical Decision Support: A Dual Safety Evaluation of 26 Models on Consumer Hardware (2026) · cites this paper as [3]
In the citing paper
“Large Language Models (LLMs) demonstrating remarkable capabilities in medical knowledge synthesis, diagnostic reasoning, and clinical documentation [1-3].”
From Benchmarking Large Language Models for Intensive Care Unit Clinical Decision Support: A Dual Safety Evaluation of 26 Models on Consumer Hardware (2026) · cites this paper as [3]
In the citing paper
“Most published medical AI benchmarks employ enterprise GPUs (NVIDIA A100, H100) or cloud API access, reporting neither hardware specifications nor inference costs [2,3,7].”
From Benchmarking Large Language Models for Intensive Care Unit Clinical Decision Support: A Dual Safety Evaluation of 26 Models on Consumer Hardware (2026) · cites this paper as [3]
In the citing paper
“While these models offer powerful foundational capabilities, adapting them to specific tasks and datasets without losing robustness is a significant hurdle, often resulting in significant variability in accuracy across different settings.7,9,10”
In the citing paper
“Despite their ability to create novel and customized content, these models are prone to hallucinations7 and can produce factually incorrect yet plausible outputs that may mislead users.”
In the citing paper
“If generative AI in health care is used for diagnostics, personalized medicine, or clinical assistance, AI hallucination can be extremely dangerous and may even harm patients’ lives [83].”
From Generative AI in medical practice: in-depth exploration of privacy and security challenges (2024) · cites this paper as [83]
In the citing paper
“However, their clinical deployment carries substantial limitations, including the generation of inaccurate or fabricated outputs (commonly termed “hallucinations”), variable output quality, and the absence of transparent reasoning pathways [4].”
In the citing paper
“Without full knowledge of the intervention being applied, it is difficult to interpret LLM performance.9,17,156”
From Large Language Models for Chatbot Health Advice Studies: A Systematic Review (2025) · cites this paper as [9]
Citations
Cites
Kung, T. H., Cheatham, M., Medenilla, A., Sillos, C., De Leon, L., Elepaño, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., Maningo, J., et al. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000198 · Cited by 4,115
Large Language Models Encode Clinical Knowledge
Singhal, K., Azizi, S., Tu, T., Mahdavi, S. S., Wei, J., Chung, H. W., Scales, N., Tanwani, A., Cole-Lewis, H., Pfohl, S., et al. (2022) · arXiv · doi:10.48550/arxiv.2212.13138 · Cited by 4,083
Deep Learning Applications in Medical Image Analysis
Ker, J., Wang, L., Rao, J. P., & Lim, C. C. T. (2017) · IEEE Access · doi:10.1109/access.2017.2788044 · Cited by 1,574
A Review of Approaches for Predicting Drug–Drug Interactions Based on Machine Learning
Han, K., Cao, P., Wang, Y., Xie, F., Ma, J., Yu, M., Wang, J., Xu, Y., Zhang, Y., & Wan, J. (2022) · Frontiers in Pharmacology · doi:10.3389/fphar.2021.814858 · Cited by 180
Beaulieu‐Jones, B. K., Yuan, W., Brat, G. A., Beam, A. L., Weber, G. M., Ruffin, M., & Kohane, I. S. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00426-3 · Cited by 168
Comparison of biomedical relationship extraction methods and models for knowledge graph creation
Milošević, N., & Thielemann, W. (2022) · Journal of Web Semantics · doi:10.1016/j.websem.2022.100756 · Cited by 49
The US Medical Licensing Examination
Cancarevic, I. (2021) · Springer eBooks · doi:10.1007/978-3-030-62249-7_23 · Cited by 2
Research works printed but not linked: 1
- Corbelle JG Bugarín-Diz A Alonso-Moral J Taboada J. Dealing with hallucination and omission in neural Natural Language Generation: a use case on meteorology. In: Proceedings and Abstracts of the 15th International Conference on Natural Language Generation July 18–22 2022. Waterville ME: Arria 2022.
Cited by
Sorted by citations
Items 101–200 of 1,012
Reliability of LLMs as medical assistants for the general public: a randomized preregistered study
Bean, A. M., Payne, R. E., Parsons, G., Kirk, H. R., Ciro, J., Mosquera-Gómez, R., Sara Hincapié, M., Ekanayaka, A. S., Tarassenko, L., Rocher, L., et al. (2026) · Nature Medicine · doi:10.1038/s41591-025-04074-y · Cited by 130
ChatGPT, GPT-4, and Other Large Language Models: The Next Revolution for Clinical Microbiology?
Egli, A. (2023) · Clinical Infectious Diseases · doi:10.1093/cid/ciad407 · Cited by 115
Bays, H. E., Fitch, A., Cuda, S. E., Gonsahn-Bollie, S., Rickey, E., Hablutzel, J., Coy, R., & Censani, M. (2023) · Obesity Pillars · doi:10.1016/j.obpill.2023.100065 · Cited by 111
Taloni, A., Borselli, M., Scarsi, V., Rossi, C., Coco, G., Scorcia, V., & Giannaccare, G. (2023) · Scientific Reports · doi:10.1038/s41598-023-45837-2 · Cited by 111
Evolution and Prospects of Foundation Models: From Large Language Models to Large Multimodal Models
Chen, Z., Xu, L., Zheng, H., Chen, L., Tolba, A. K. R., Zhao, L., Yu, K., & Feng, H. (2024) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2024.052618 · Cited by 126
Harnessing Large Language Models to Collect and Analyze Metal–Organic Framework Property Data Set
Kang, Y., Lee, W., Bae, T., Han, S., Jang, H., & Kim, J. (2025) · Journal of the American Chemical Society · doi:10.1021/jacs.4c11085 · Cited by 122
Artificial Intelligence (AI) Chatbots in Medicine: A Supplement, Not a Substitute
Altamimi, I., Altamimi, A., Alhumimidi, A. S., Altamimi, A., & Temsah, M.-H. (2023) · Cureus · doi:10.7759/cureus.40922 · Cited by 102
Gordon, E. B., Towbin, A. J., Wingrove, P. M., Shafique, U., Haas, B. M., Kitts, A. B., Feldman, J., & Furlan, A. (2023) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2023.09.011 · Cited by 102
Hershenhouse, J. S., Mokhtar, D., Eppler, M., Rodler, S., Ramacciotti, L. S., Ganjavi, C., Hom, B. M., Davis, R. J., Tran, J., Russo, G. I., et al. (2024) · Prostate Cancer and Prostatic Diseases · doi:10.1038/s41391-024-00826-y · Cited by 102
Harnessing the potential of large language models in medical education: promise and pitfalls
Benítez, T. M., Xu, Y., Boudreau, J. D., Kow, A. W. C., Bello, F., Van Phuoc, L., Wang, X., Sun, X., Leung, G. K.-K., Lan, Y., et al. (2024) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocad252 · Cited by 100
A Mathematical Investigation of Hallucination and Creativity in GPT Models
Lee, M. (2023) · Mathematics · doi:10.3390/math11102320 · Cited by 105
Haemmerli, J., Sveikata, L., Nouri, A., May, A. T., Égervári, K., Freyschlag, C. F., Lobrinus, J. A., Migliorini, D., Momjian, S., Sanda, N., et al. (2023) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2023-100775 · Cited by 102
Chatelan, A., Clerc, A., & Fonta, P.-A. (2023) · Journal of the Academy of Nutrition and Dietetics · doi:10.1016/j.jand.2023.08.001 · Cited by 105
RetractedMenz, B. D., Modi, N. D., Sorich, M. J., & Hopkins, A. M. (2024) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2023.5947 · Cited by 99
Artificial intelligence for diabetes care: current and future prospects
Sheng, B., Pushpanathan, K., Guan, Z., Lim, Q. H., Lim, Z. W., Yew, S. M. E., Goh, J. H. L., Bee, Y. M., Sabanayagam, C., Sevdalis, N., et al. (2024) · The Lancet Diabetes & Endocrinology · doi:10.1016/s2213-8587(24)00154-2 · Cited by 106
Herrmann‐Werner, A., Wietek, T. F., Holderried, F., Herschbach, L., Griewatz, J., Masters, K., Zipfel, S., & Mahling, M. (2024) · Journal of Medical Internet Research · doi:10.2196/52113 · Cited by 109
Wan, P., Huang, Z., Tang, W., Nie, Y., Pei, D., Deng, S., Chen, J., Zhou, Y., Duan, H., Chen, Q., et al. (2024) · Nature Medicine · doi:10.1038/s41591-024-03148-7 · Cited by 97
ChatGPT and Generating a Differential Diagnosis Early in an Emergency Department Presentation
Berg, H. T., van Bakel, B., van de Wouw, L., Jie, K. E., Schipper, A., Jansen, H., O’Connor, R. D., van Ginneken, B., & Kurstjens, S. (2024) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2023.08.003 · Cited by 97
BI-RADS Category Assignments by GPT-3.5, GPT-4, and Google Bard: A Multilanguage Study
Cozzi, A., Pinker, K., Hidber, A., Zhang, T., Bonomo, L., Gullo, R. L., Christianson, B., Curti, M., Rizzo, S., Grande, F. D., et al. (2024) · Radiology · doi:10.1148/radiol.232133 · Cited by 99
The role of large language models in medical image processing: a narrative review
Tian, D., Jiang, S., Zhang, L., Lü, X., & Xu, Y. (2023) · Quantitative Imaging in Medicine and Surgery · doi:10.21037/qims-23-892 · Cited by 103
Derraz, B., Breda, G., Kaempf, C., Baenke, F., Cotte, F., Reiche, K., Köhl, U., Kather, J. N., Eskenazy, D., & Gilbert, S. (2024) · npj Precision Oncology · doi:10.1038/s41698-024-00517-w · Cited by 94
Comparative Performance of ChatGPT and Bard in a Text-Based Radiology Knowledge Assessment
Patil, N. S., Huang, R. S., van der Pol, C. B., & Larocque, N. (2023) · Canadian Association of Radiologists Journal · doi:10.1177/08465371231193716 · Cited by 103
People Overtrust AI-Generated Medical Advice despite Low Accuracy
Shekar, S., Pataranutaporn, P., Sarabu, C. R., Cecchi, G., & Maes, P. (2025) · NEJM AI · doi:10.1056/aioa2300015 · Cited by 112
ChatGPT vs Google for Queries Related to Dementia and Other Cognitive Decline: Comparison of Results
Hristidis, V., Ruggiano, N., Brown, E. L., Ganta, S. R. R., & Stewart, S. (2023) · Journal of Medical Internet Research · doi:10.2196/48966 · Cited by 100
Ntinopoulos, V., Biefer, H. R. C., Tudorache, I., Papadopoulos, N., Odavic, D., Risteski, P. S., Haeussler, A., & Dzemali, O. (2025) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2024-101139 · Cited by 110
GPT-4 for Information Retrieval and Comparison of Medical Oncology Guidelines
Ferber, D., Wiest, I. C., Wölflein, G., Ebert, M. P., Beutel, G., Eckardt, J.-N., Truhn, D., Springfeld, C., Jäger, D., & Kather, J. N. (2024) · NEJM AI · doi:10.1056/aics2300235 · Cited by 92
Yanagita, Y., Yokokawa, D., Uchida, S., Tawara, J., & Ikusaka, M. (2023) · JMIR Formative Research · doi:10.2196/48023 · Cited by 90
Evaluating the ChatGPT family of models for biomedical reasoning and classification
Chen, S., Li, Y., Lu, S., Van, H., Aerts, H. J. W. L., Savova, G. K., & Bitterman, D. S. (2024) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocad256 · Cited by 91
Ethical Implications of Chatbot Utilization in Nephrology
Valencia, O. A. G., Suppadungsuk, S., Thongprayoon, C., Miao, J., Tangpanithandee, S., Craici, I. M., & Cheungpasitporn, W. (2023) · Journal of Personalized Medicine · doi:10.3390/jpm13091363 · Cited by 92
Schukow, C. P., Smith, S. C., Landgrebe, E., Parasuraman, S., Folaranmi, O. O., Paner, G. P., & Amin, M. B. (2023) · Advances in Anatomic Pathology · doi:10.1097/pap.0000000000000406 · Cited by 87
Pugliese, N., Wong, V. W., Schattenberg, J. M., Romero‐Gómez, M., Sebastiani, G., Castéra, L., Hassan, C., Manousou, P., Miele, L., Peck, R., et al. (2023) · Clinical Gastroenterology and Hepatology · doi:10.1016/j.cgh.2023.08.033 · Cited by 86
Jin, H. K., Lee, H. E., & Kim, E. (2024) · BMC Medical Education · doi:10.1186/s12909-024-05944-8 · Cited by 85
Gebrael, G., Sahu, K. K., Chigarira, B., Tripathi, N., Mathew Thomas, V., Sayegh, N., Maughan, B. L., Agarwal, N., Swami, U., & Li, H. (2023) · Cancers · doi:10.3390/cancers15143717 · Cited by 85
Performance of a Large Language Model in Screening Citations
Oami, T., Okada, Y., & Nakada, T. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.20496 · Cited by 101
Leveraging Large Language Models to Power Chatbots for Collecting User Self-Reported Data
Wei, J., Kim, S., Jung, H., & Kim, Y.-H. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637364 · Cited by 84
Mess, S. A., Mackey, A., & Yarowsky, D. (2025) · Plastic & Reconstructive Surgery Global Open · doi:10.1097/gox.0000000000006450 · Cited by 84
Hasani, A. M., Singh, S. M., Zahergivar, A., Ryan, B., Nethala, D., Bravomontenegro, G., Mendhiratta, N., Ball, M. W., Farhadi, F., & Malayeri, A. A. (2023) · European Radiology · doi:10.1007/s00330-023-10384-x · Cited by 87
Generating Automatic Feedback on UI Mockups with Large Language Models
Duan, P., Warner, J., Li, Y., & Hartmann, B. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642782 · Cited by 83
Opportunities and risks of large language models in psychiatry
Obradovich, N., Khalsa, S. S., Khan, W. U., Suh, J., Perlis, R. H., Ajilore, O., & Paulus, M. P. (2024) · NPP—Digital Psychiatry and Neuroscience · doi:10.1038/s44277-024-00010-z · Cited by 103
Advancing microbial production through artificial intelligence-aided biology
Gong, X., Zhang, J., Gan, Q., Teng, Y., Hou, J., Lyu, Y., Liu, Z., Wu, Z., Dai, R., Zou, Y., et al. (2024) · Biotechnology Advances · doi:10.1016/j.biotechadv.2024.108399 · Cited by 85
Suárez, A., Jiménez, J., de Pedro, M. L., Vázquez, C. A., García, V. D., Sánchez, M. G., & Freire, Y. (2023) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2023.11.058 · Cited by 92
Yildirim, N., Richardson, H., Wetscherek, M. T., Bajwa, J., Jacob, J., Pinnock, M. A., Harris, S., Coelho De Castro, D., Bannur, S., Hyland, S., et al. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642013 · Cited by 82
Bridging the literacy gap for surgical consents: an AI-human expert collaborative approach
Ali, R., Connolly, I. D., Tang, O. Y., Mirza, F. N., Johnston, B. R., Abdulrazeq, H., Lim, R. K., Galamaga, P. F., Libby, T. J., Sodha, N. R., et al. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01039-2 · Cited by 82
LLMs and generative agent-based models for complex systems research
Lu, Y., Aleta, A., Du, C., Shi, L., & Moreno, Y. (2024) · Physics of Life Reviews · doi:10.1016/j.plrev.2024.10.013 · Cited by 107
Large language model assisted fine-grained knowledge graph construction for robotic fault diagnosis
Liao, X., Chen, C., Wang, Z., Liu, Y., Wang, T., & Cheng, L. (2025) · Advanced Engineering Informatics · doi:10.1016/j.aei.2025.103134 · Cited by 88
Performance of Large Language Models on Medical Oncology Examination Questions
Longwell, J. B., Hirsch, I., Binder, F., Gonzalez Conchas, G. A., Mau, D., Jang, R., Krishnan, R. G., & Grant, R. C. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.17641 · Cited by 81
Shea, Y. F., Lee, C. M. Y., Ip, W. C., Luk, D. W. A., & Wong, S. S. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.25000 · Cited by 81
ChatGPT and Physicians’ Malpractice Risk
Mello, M. M., & Guha, N. (2023) · JAMA Health Forum · doi:10.1001/jamahealthforum.2023.1938 · Cited by 80
Kolding, S., Lundin, R. M., Hansen, L., & Østergaard, S. D. (2024) · Acta Neuropsychiatrica · doi:10.1017/neu.2024.50 · Cited by 97
Claman, D. B., & Sezgın, E. (2024) · JMIR Medical Education · doi:10.2196/52346 · Cited by 102
Uribe, S. E., Maldupa, I., Kavadella, A., El Tantawi, M., Chaurasia, A., Fontana, M., Marino, R., Innes, N., & Schwendicke, F. (2024) · European Journal of Dental Education · doi:10.1111/eje.13009 · Cited by 77
Li, H., Wang, Y., & Qu, H. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642726 · Cited by 77
Medical education and physician training in the era of artificial intelligence
Xu, Y., Jiang, Z., Ting, D. S. W., Kow, A. W. C., Bello, F., Car, J., Tham, Y.-C., & Wong, T. Y. (2024) · Singapore Medical Journal · doi:10.4103/singaporemedj.smj-2023-203 · Cited by 76
Abdullahi, T., Singh, R., & Eickhoff, C. (2024) · JMIR Medical Education · doi:10.2196/51391 · Cited by 76
Benefits, Limits, and Risks of GPT-4 as an AI Chatbot for Medicine
Lee, P., Bubeck, S., & Petro, J. (2023) · New England Journal of Medicine · doi:10.1056/nejmc2305286 · Cited by 81
Self-citationGenerative artificial intelligence: Can ChatGPT write a quality abstract?
Babl, F. E., & Babl, M. P. (2023) · Emergency Medicine Australasia · doi:10.1111/1742-6723.14233 · Cited by 73
Large Language Models in Neurology Research and Future Practice
Romano, M. F., Shih, L. C., Paschalidis, I. C., Au, R., & Kolachalama, V. B. (2023) · Neurology · doi:10.1212/wnl.0000000000207967 · Cited by 74
Yan, C., Grabowska, M. E., Dickson, A. L., Li, B., Wen, Z., Roden, D. M., Michael Stein, C., Embí, P. J., Peterson, J. F., Feng, Q., et al. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01038-3 · Cited by 73
Ganjavi, C., Eppler, M., O’Brien, D., Ramacciotti, L. S., Ghauri, M. S., Anderson, I., Choi, J., Dwyer, D., Stephens, C., Shi, V., et al. (2024) · PLOS Digital Health · doi:10.1371/journal.pdig.0000596 · Cited by 73
Wang, C., Ong, J., Wang, C., Ong, D., Cheng, R., & Ong, D. (2023) · Annals of Biomedical Engineering · doi:10.1007/s10439-023-03327-6 · Cited by 86
Explainable artificial intelligence in emergency medicine: an overview
Okada, Y., Ning, Y., & Ong, M. E. H. (2023) · Clinical and Experimental Emergency Medicine · doi:10.15441/ceem.23.145 · Cited by 77
Talyshinskii, A., Naik, N., Hameed, B. M. Z., Juliebø‐Jones, P., & Somani, B. K. (2023) · Current Urology Reports · doi:10.1007/s11934-023-01184-3 · Cited by 86
Principles, applications, and future of artificial intelligence in dermatology
Omiye, J. A., Gui, H., Daneshjou, R., Cai, Z. R., & Muralidharan, V. (2023) · Frontiers in Medicine · doi:10.3389/fmed.2023.1278232 · Cited by 87
Practical AI application in psychiatry: historical review and future directions
Sun, J., Lu, T., Shao, X., Han, Y., Xia, Y., Zheng, Y., Wang, Y., Li, X., Ravindran, A. V., Fan, L., et al. (2025) · Molecular Psychiatry · doi:10.1038/s41380-025-03072-3 · Cited by 88
Truhn, D., Weber, C. D., Braun, B. J., Bressem, K., Kather, J. N., Kuhl, C., & Nebelung, S. (2023) · Scientific Reports · doi:10.1038/s41598-023-47500-2 · Cited by 71
Herding AI Cats: Lessons from Designing a Chatbot by Prompting GPT-3
Zamfirescu-Pereira, J. D., Wei, H., Xiao, A., Gu, K., Jung, G., Lee, M. G., Hartmann, B., & Yang, Q. (2023) · Designing Interactive Systems Conference · doi:10.1145/3563657.3596138 · Cited by 88
CORAL: Expert-Curated Oncology Reports to Advance Language Model Inference
Sushil, M., Kennedy, V. E., Mandair, D., Miao, B. Y., Zack, T. I., & Butte, A. J. (2024) · NEJM AI · doi:10.1056/aidbp2300110 · Cited by 68
Yuan, M., Bao, P., Yuan, J., Shen, Y., Chen, Z., Xie, Y., Zhao, J., Li, Q., Chen, Y., Zhang, L., et al. (2024) · Medicine Plus · doi:10.1016/j.medp.2024.100030 · Cited by 93
Mastrodicasa, D., van Assen, M., Huisman, M., Leiner, T., Williamson, E. E., Nicol, E. D., Allen, B. D., Saba, L., Vliegenthart, R., & Hanneman, K. (2025) · Radiology · doi:10.1148/radiol.240516 · Cited by 69
Zaleski, A. L., Berkowsky, R. S., Craig, K. J. T., & Pescatello, L. S. (2024) · JMIR Medical Education · doi:10.2196/51308 · Cited by 74
Beyond ChatGPT: What does GPT-4 add to healthcare? The dawn of a new era
Wójcik, S., Rulkiewicz, A., Pruszczyk, P., Lisik, W., Poboży, M., & Domienik‐Karłowicz, J. (2023) · Cardiology Journal · doi:10.5603/cj.97515 · Cited by 74
Large language model integrations in cancer decision-making: a systematic review and meta-analysis
Hao, Y., Qiu, Z., Holmes, J., Löckenhoff, C. E., Liu, W., Ghassemi, M., & Kalantari, S. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01824-7 · Cited by 67
Enhancing head and neck tumor management with artificial intelligence: Integration and perspectives
Zhong, N., Wang, H., Huang, X., Li, Z., Cao, L., Huo, F., Liu, B., & Bu, L. (2023) · Seminars in Cancer Biology · doi:10.1016/j.semcancer.2023.07.002 · Cited by 74
Evaluating the performance of ChatGPT in answering questions related to pediatric urology
Çağlar, U., Yıldız, O., Meriç, A., Ayrancı, A., Gelmiş, M., Sarılar, Ö., & Özgör, F. (2023) · Journal of Pediatric Urology · doi:10.1016/j.jpurol.2023.08.003 · Cited by 67
Shiferaw, M. W., Zheng, T., Winter, A., Mike, L. A., & Chan, L. (2024) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-024-02824-5 · Cited by 77
Radiology Gets Chatty: The ChatGPT Saga Unfolds
Grewal, H., Dhillon, G. S., Monga, V., Sharma, P., Buddhavarapu, V. S., Sidhu, G. K., & Kashyap, R. (2023) · Cureus · doi:10.7759/cureus.40135 · Cited by 64
ChatGPT and the future of journal reviews: A feasibility study
Biswas, S., Dobaria, D., & Cohen, H. L. (2023) · The Yale Journal of Biology and Medicine · doi:10.59249/skdh9286 · Cited by 65
ChatGPT and assistive AI in structured radiology reporting: A systematic review
Sacoransky, E., Kwan, B. Y. M., & Soboleski, D. (2024) · Current Problems in Diagnostic Radiology · doi:10.1067/j.cpradiol.2024.07.007 · Cited by 68
Göktaş, P., Karakaya, G., Kalyoncu, A. F., & Damadoğlu, E. (2023) · The Journal of Allergy and Clinical Immunology In Practice · doi:10.1016/j.jaip.2023.05.042 · Cited by 62
Maillard, A., Micheli, G., Lefèvre, L., Guyonnet, C., Poyart, C., Canouï, É., Belan, M., & Charlier, C. (2023) · Clinical Infectious Diseases · doi:10.1093/cid/ciad632 · Cited by 62
Tanaka, Y., Nakata, T., Aiga, K., Etani, T., Muramatsu, R., Katagiri, S., Kawai, H., Higashino, F., Enomoto, M., Noda, M., et al. (2024) · PLOS Digital Health · doi:10.1371/journal.pdig.0000433 · Cited by 65
Remy, F., Demuynck, K., & Demeester, T. (2024) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocae029 · Cited by 64
Szczesniewski, J. J., Fouz, C. T., Alba, A. R., Díaz-Goizueta, F. J., García-Tello, A., & González, L. L. (2023) · World Journal of Urology · doi:10.1007/s00345-023-04563-0 · Cited by 67
Performance of a large language model on the reasoning tasks of a physician
Brodeur, P. G., Buckley, T. A., Kanjee, Z., Goh, E., Ling, E., Jain, P., Cabral, S., Abdulnour, R.-E. E., Haimovich, A. D., Freed, J. A., et al. (2026) · Science · doi:10.1126/science.adz4433 · Cited by 187
The Role and Potential Contributions of the Artificial Intelligence Language Model ChatGPT
Berşe, S., Akça, K., Dirgar, E., & Kaplan Serin, E. (2024) · Annals of Biomedical Engineering · doi:10.1007/s10439-023-03296-w · Cited by 63
Will ChatGPT/GPT-4 be a Lighthouse to Guide Spinal Surgeons?
He, Y., Tang, H., Wang, D., Gu, S., Ni, G., & Wu, H. (2023) · Annals of Biomedical Engineering · doi:10.1007/s10439-023-03206-0 · Cited by 62
Saenz, A. D., Mass General Brigham AI Governance Committee, McCoy, T., Mantha, A. B., Martin, R., Damiano, R., Adair, D., Heaney, D., Sisodia, R., Park, L., et al. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01300-8 · Cited by 62
Health Care Privacy Risks of AI Chatbots
Kanter, G. P., & Packel, E. A. (2023) · JAMA · doi:10.1001/jama.2023.9618 · Cited by 62
Ensuring useful adoption of generative artificial intelligence in healthcare
Jindal, J., Lungren, M. P., & Shah, N. H. (2024) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocae043 · Cited by 70
Conductive hydrogels: intelligent dressings for monitoring and healing chronic wounds
Fang, Y. Z., Han, Y., Lu, Y., Kankala, R. K., Wang, S., Chen, A., & Fu, C. (2024) · Regenerative Biomaterials · doi:10.1093/rb/rbae127 · Cited by 66
Enhancing Kidney Transplant Care through the Integration of Chatbot
Valencia, O. A. G., Thongprayoon, C., Jadlowiec, C. C., Mao, S. A., Miao, J., & Cheungpasitporn, W. (2023) · Healthcare · doi:10.3390/healthcare11182518 · Cited by 66
A guide to prompt design: foundations and applications for healthcare simulationists
Maaz, S., Palaganas, J. C., Palaganas, G., & Bajwa, M. (2025) · Frontiers in Medicine · doi:10.3389/fmed.2024.1504532 · Cited by 69
Exploring the Potential of GPT-4 in Biomedical Engineering: The Dawn of a New Era
Cheng, K., Guo, Q., He, Y., Lu, Y., Gu, S., & Wu, H. (2023) · Annals of Biomedical Engineering · doi:10.1007/s10439-023-03221-1 · Cited by 60
Artificial intelligence-driven biomedical genomics
Guo, K., Wu, M., Soo, Z., Yang, Y. Y., Zhang, Y., Zhang, Q., Lin, H., Grosser, M., Venter, D. J., Zhang, G., et al. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110937 · Cited by 64
Examining ChatGPT Performance on USMLE Sample Items and Implications for Assessment
Yaneva, V., Baldwin, P., Jurich, D. P., Swygert, K. A., & Clauser, B. E. (2023) · Academic Medicine · doi:10.1097/acm.0000000000005549 · Cited by 62
Mavrych, V., Ganguly, P. K., & Bolgova, O. (2024) · Clinical Anatomy · doi:10.1002/ca.24244 · Cited by 67
Rethinking clinical trials for medical AI with dynamic deployments of adaptive systems
Rosenthal, J. T., Beecy, A., & Sabuncu, M. R. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01674-3 · Cited by 59
Artificial Intelligence in Sports Medicine: Could GPT-4 Make Human Doctors Obsolete?
Cheng, K., Guo, Q., He, Y., Lu, Y., Xie, R., Li, C., & Wu, H. (2023) · Annals of Biomedical Engineering · doi:10.1007/s10439-023-03213-1 · Cited by 59
ChatGPT: Can You Prepare My Patients for [18F]FDG PET/CT and Explain My Reports?
Rogasch, J. M. M., Metzger, G., Preisler, M., Galler, M., Thiele, F., Brenner, W., FELDHAUS, F. W., Wetz, C., Amthauer, H., Furth, C., et al. (2023) · Journal of Nuclear Medicine · doi:10.2967/jnumed.123.266114 · Cited by 59
Metadata
- Authors
- Lee, P., Bubeck, S., & Petro, J.
- Affiliations
- Microsoft (United States) (US)
- From Microsoft Research, Redmond, WA (P.L., S.B.); and Nuance Communications, Burlington, MA (J.P.).
- Venue
- New England Journal of Medicine
- Publisher
- Massachusetts Medical Society
- Published
- 2023-03-30
- Volume
- 388
- Issue
- 13
- Pages
- 1233-1239
- ISSN
- 0028-4793 (ISSN-L)
- 1533-4406
- OpenAlex
- W4361289889
- Semantic Scholar
- 72b74bcff8fd76eff6789111a7ce5d0d6c5ac4db
- Cited by
- 1,738
- References
- 6
- Citations by year
- 2026: 405 · 2025: 419 · 2024: 542 · 2023: 370
- FWCI
- 69.16
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- New England Journal of Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Technology and Human Factors in Education and Health
- Keywords
- GPT-4, large language models, AI chatbots, medical practice, clinical decision support, artificial intelligence in healthcare
- MeSH terms
- Artificial Intelligence, Humans, Medicine, Risk Assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
