The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Benefits, Limits, and Risks of GPT-4 as an AI Chatbot for Medicine
Abstract
Chatbots are computer programs with which one can have a conversation. In this article, the authors describe how the GPT-4 chatbot, which has been given a general education, could affect the practice of medicine.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Large language models (LLMs), with their superior contextual semantic understanding, offer a promising avenue to overcome these limitations [8, 9].”
From Enhancing hepatopathy clinical trial efficiency: a secure, large language model-powered pre-screening pipeline (2025) · cites this paper as [8]
In the citing paper
“Previous research has documented LLM hallucination in various contexts, including medical information [8], legal reasoning [9], and general factual queries [10].”
From Compound Deception in Elite Peer Review: A Failure Mode Taxonomy of 100 Fabricated Citations at NeurIPS 2025 (2026) · cites this paper as [8]
In the citing paper
“This is in contrast to prior work that claims LMs approach human performance, even for complex tasks (Ding et al., 2022; Nori et al., 2023; Lee et al., 2023) even though the task of writing biographies is fairly easy.”
From FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation (2023) · cites this paper as Lee et al., 2023
In the citing paper
“This is in contrast to prior work that claims LMs approach human performance, even for complex tasks (Ding et al., 2022; Nori et al., 2023; Lee et al., 2023) even though the task of writing biographies is fairly easy.”
From FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation (2023) · cites this paper as Lee et al., 2023
In the citing paper
“Studies evaluating GPT-4 and Claude on medical board examinations report accuracy rates of 80-90% [3,6]”
From Benchmarking Large Language Models for Intensive Care Unit Clinical Decision Support: A Dual Safety Evaluation of 26 Models on Consumer Hardware (2026) · cites this paper as [3]
In the citing paper
“Large Language Models (LLMs) demonstrating remarkable capabilities in medical knowledge synthesis, diagnostic reasoning, and clinical documentation [1-3].”
From Benchmarking Large Language Models for Intensive Care Unit Clinical Decision Support: A Dual Safety Evaluation of 26 Models on Consumer Hardware (2026) · cites this paper as [3]
In the citing paper
“Most published medical AI benchmarks employ enterprise GPUs (NVIDIA A100, H100) or cloud API access, reporting neither hardware specifications nor inference costs [2,3,7].”
From Benchmarking Large Language Models for Intensive Care Unit Clinical Decision Support: A Dual Safety Evaluation of 26 Models on Consumer Hardware (2026) · cites this paper as [3]
In the citing paper
“While these models offer powerful foundational capabilities, adapting them to specific tasks and datasets without losing robustness is a significant hurdle, often resulting in significant variability in accuracy across different settings.7,9,10”
In the citing paper
“Despite their ability to create novel and customized content, these models are prone to hallucinations7 and can produce factually incorrect yet plausible outputs that may mislead users.”
In the citing paper
“If generative AI in health care is used for diagnostics, personalized medicine, or clinical assistance, AI hallucination can be extremely dangerous and may even harm patients’ lives [83].”
From Generative AI in medical practice: in-depth exploration of privacy and security challenges (2024) · cites this paper as [83]
In the citing paper
“However, their clinical deployment carries substantial limitations, including the generation of inaccurate or fabricated outputs (commonly termed “hallucinations”), variable output quality, and the absence of transparent reasoning pathways [4].”
In the citing paper
“Without full knowledge of the intervention being applied, it is difficult to interpret LLM performance.9,17,156”
From Large Language Models for Chatbot Health Advice Studies: A Systematic Review (2025) · cites this paper as [9]
Citations
Cites
Kung, T. H., Cheatham, M., Medenilla, A., Sillos, C., De Leon, L., Elepaño, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., Maningo, J., et al. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000198 · Cited by 4,115
Large Language Models Encode Clinical Knowledge
Singhal, K., Azizi, S., Tu, T., Mahdavi, S. S., Wei, J., Chung, H. W., Scales, N., Tanwani, A., Cole-Lewis, H., Pfohl, S., et al. (2022) · arXiv · doi:10.48550/arxiv.2212.13138 · Cited by 4,083
Deep Learning Applications in Medical Image Analysis
Ker, J., Wang, L., Rao, J. P., & Lim, C. C. T. (2017) · IEEE Access · doi:10.1109/access.2017.2788044 · Cited by 1,574
A Review of Approaches for Predicting Drug–Drug Interactions Based on Machine Learning
Han, K., Cao, P., Wang, Y., Xie, F., Ma, J., Yu, M., Wang, J., Xu, Y., Zhang, Y., & Wan, J. (2022) · Frontiers in Pharmacology · doi:10.3389/fphar.2021.814858 · Cited by 180
Beaulieu‐Jones, B. K., Yuan, W., Brat, G. A., Beam, A. L., Weber, G. M., Ruffin, M., & Kohane, I. S. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00426-3 · Cited by 168
Comparison of biomedical relationship extraction methods and models for knowledge graph creation
Milošević, N., & Thielemann, W. (2022) · Journal of Web Semantics · doi:10.1016/j.websem.2022.100756 · Cited by 49
The US Medical Licensing Examination
Cancarevic, I. (2021) · Springer eBooks · doi:10.1007/978-3-030-62249-7_23 · Cited by 2
Research works printed but not linked: 1
- Corbelle JG Bugarín-Diz A Alonso-Moral J Taboada J. Dealing with hallucination and omission in neural Natural Language Generation: a use case on meteorology. In: Proceedings and Abstracts of the 15th International Conference on Natural Language Generation July 18–22 2022. Waterville ME: Arria 2022.
Cited by
Sorted by citations
Items 401–500 of 1,012
Noda, M., Ueno, T., Koshu, R., Takaso, Y., Shimada, M. D., Saito, C., Sugimoto, H., Fushiki, H., Itō, M., Nomura, A., et al. (2024) · JMIR Medical Education · doi:10.2196/57054 · Cited by 28
Innovations in Medicine: Exploring ChatGPT’s Impact on Rare Disorder Management
Zampatti, S., Peconi, C., Megalizzi, D., Calvino, G., Trastulli, G., Cascella, R., Strafella, C., Caltagirone, C., & Giardina, E. (2024) · Genes · doi:10.3390/genes15040421 · Cited by 31
Online patient education in body contouring: A comparison between Google and ChatGPT
Bonetti, M. A., Liu, H. Y., Palmesano, M., Nguyen, V. T., & Egro, F. M. (2023) · Journal of Plastic Reconstructive & Aesthetic Surgery · doi:10.1016/j.bjps.2023.10.091 · Cited by 26
Xu, J., Lu, L., Peng, X., Pang, J., Ding, J., Yang, L., Song, H., Li, K., Sun, X., & Zhang, S. (2024) · JMIR Medical Informatics · doi:10.2196/57674 · Cited by 26
Evaluation of GPT Large Language Model Performance on RSNA 2023 Case of the Day Questions
Mukherjee, P., Hou, B., Suri, A., Zhuang, Y., Parnell, C., Lee, N., Stroie, O. M., Jain, R. K., Wang, K. C., Sharma, K. K., et al. (2024) · Radiology · doi:10.1148/radiol.240609 · Cited by 27
Large Language Models to Identify Advance Care Planning in Patients With Advanced Cancer
Agaronnik, N. D., Davis, J., Manz, C. R., Tulsky, J. A., & Lindvall, C. J. (2024) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2024.11.016 · Cited by 26
Naliyatthaliyazchayil, P., Muthyala, R., Gichoya, J. W., & Purkayastha, S. (2025) · Journal of Medical Internet Research · doi:10.2196/74142 · Cited by 31
Centering health equity in large language model deployment
Singh, N. P., Lawrence, K. S., Richardson, S. I., & Mann, D. M. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000367 · Cited by 29
ChatGPT in Occupational Medicine: A Comparative Study with Human Experts
Padovan, M., Cosci, B., Petillo, A., Nerli, G., Porciatti, F., Scarinci, S., Carlucci, F., Dell’Amico, L., Meliani, N., Necciari, G., et al. (2024) · Bioengineering · doi:10.3390/bioengineering11010057 · Cited by 28
Chen, C.-W., Walter, P., & Wei, J. C. (2024) · JMIR Medical Education · doi:10.2196/48989 · Cited by 27
Large Language Models in Oncology: Revolution or Cause for Concern?
Caglayan, A., Slusarczyk, W., Rabbani, R. D., Ghose, A., Papadopoulos, V. P., & Boussios, S. (2024) · Current Oncology · doi:10.3390/curroncol31040137 · Cited by 27
Tate, S., Fouladvand, S., Chen, J. H., & Chen, C. A. (2023) · Addiction · doi:10.1111/add.16341 · Cited by 30
GPT-4: The Future of Cosmetic Procedure Consultation?
Sun, Y.-X., Li, Z.-M., Huang, J.-Z., Yu, N.-Z., & Long, X. (2023) · Aesthetic Surgery Journal · doi:10.1093/asj/sjad134 · Cited by 23
Wang, J., Ye, Q., Liu, L., Guo, N. L., & Hu, G. (2024) · npj Precision Oncology · doi:10.1038/s41698-024-00576-z · Cited by 30
Huang, T.-Y., Hsieh, P. H., & Chang, Y. (2024) · JMIR Medical Education · doi:10.2196/59902 · Cited by 23
Genovese, A., Prabha, S., Borna, S., Gomez-Cabello, C. A., Haider, S. A., Trabilsy, M., Tao, C., Aziz, K. T., Murray, P. M., & Forte, A. J. (2025) · Aesthetic Surgery Journal · doi:10.1093/asj/sjaf038 · Cited by 25
Large Language Models and Their Implications on Medical Education
Bair, H., & Norden, J. G. (2023) · Academic Medicine · doi:10.1097/acm.0000000000005265 · Cited by 25
Hacking, C., Verbeek, H., Hamers, J. P. H., & Aarts, S. (2023) · PLoS ONE · doi:10.1371/journal.pone.0292578 · Cited by 32
Bednorz, A., Mak, J. K. L., Jylhävä, J., & Religa, D. (2023) · Clinical Interventions in Aging · doi:10.2147/cia.s400887 · Cited by 27
Fisch, U., Kliem, P. S. C., Grzonka, P., & Sutter, R. (2024) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2023-100978 · Cited by 25
The Promises and Perils of Foundation Models in Dermatology
Gui, H., Omiye, J. A., Chang, C. T., & Daneshjou, R. (2024) · Journal of Investigative Dermatology · doi:10.1016/j.jid.2023.12.019 · Cited by 28
Performance Assessment of ChatGPT versus Bard in Detecting Alzheimer’s Dementia
Balamurali, B. T., & Chen, J. (2024) · Diagnostics · doi:10.3390/diagnostics14080817 · Cited by 24
Cheligeer, K., Wu, G., Laws, A., Quan, M. L., Li, A., Brisson, A.-M., Xie, J., & Xu, Y. (2024) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-024-02677-y · Cited by 26
Combining Multiple Large Language Models Improves Diagnostic Accuracy
Barabucci, G., Shia, V., Chu, E., Harack, B., Laskowski, K., & Fu, N. (2024) · NEJM AI · doi:10.1056/aics2400502 · Cited by 24
Opportunities and Challenges of Chatbots in Ophthalmology: A Narrative Review
Sabaner, M. C., Anguita, R., Antaki, F., Balas, M., Boberg‐Ans, L. C., Desideri, L. F., Grauslund, J., Hansen, M. S., Klefter, O. N., Potapenko, I. O., et al. (2024) · Journal of Personalized Medicine · doi:10.3390/jpm14121165 · Cited by 30
Gadekallu, T. R., Yenduri, G., Kaluri, R., Rajput, D. S., Lakshmanna, K., Fang, K., Chen, J., & Wang, W. W. (2025) · PeerJ Computer Science · doi:10.7717/peerj-cs.2400 · Cited by 31
Large Language Models as Tools for Molecular Toxicity Prediction: AI Insights into Cardiotoxicity
Yang, H., Xiu, J., yan, W., Liu, K., Cui, H., Wang, Z., He, Q., Gao, Y., & Han, W. (2025) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.4c01371 · Cited by 27
Ethical Considerations for Generative Artificial Intelligence in Plastic Surgery
Dhawan, R., Brooks, K. D., Shauly, O., Shay, D., & Losken, A. (2025) · Plastic & Reconstructive Surgery Global Open · doi:10.1097/gox.0000000000006825 · Cited by 26
ChatGPT in Medical Education: Bibliometric and Visual Analysis
Zhang, Y., Xie, X., & Xu, Q. (2025) · JMIR Medical Education · doi:10.2196/72356 · Cited by 35
We need to chat about artificial intelligence
Coiera, E. W., Verspoor, K. M., & Hansen, D. P. (2023) · The Medical Journal of Australia · doi:10.5694/mja2.51992 · Cited by 24
Peng, S., Wang, D., Liang, Y., Xiao, W., Zhang, Y., & Liu, L. (2023) · Annals of Biomedical Engineering · doi:10.1007/s10439-023-03314-x · Cited by 24
Salihu, A., Gadiri, M. A., Skalidis, I., Meier, D. J., Auberson, D., Fournier, A., Fournier, R., Thanou, D., Abbe, E. A., Müller, O., et al. (2023) · EuroIntervention · doi:10.4244/eij-d-23-00461 · Cited by 24
Enhancing Uncertainty-Based Hallucination Detection with Stronger Focus
Zhang, T., Qiu, L., Guo, Q., Deng, C., Zhang, Y., Zhang, Z., Zhou, C., Wang, X., & Fu, L. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.58 · Cited by 71
Generative Artificial Intelligence in Health Care
Cacciamani, G. E., Siemens, D. R., & Gill, I. S. (2023) · The Journal of Urology · doi:10.1097/ju.0000000000003703 · Cited by 26
Maximising Large Language Model Utility in Cardiovascular Care: A Practical Guide
Nolin-Lapalme, A., Thériault-Lauzier, P., Corbin, D., Tastet, O., Sharma, A., Hussin, J., Kadoury, S., Jiang, R., Krahn, A. D., Gallo, R., et al. (2024) · Canadian Journal of Cardiology · doi:10.1016/j.cjca.2024.05.024 · Cited by 29
Sarangi, P. K., Datta, S., Panda, B. B., Panda, S., & Mondal, H. (2024) · Indian journal of radiology and imaging - new series/Indian journal of radiology and imaging/Indian Journal of Radiology & Imaging · doi:10.1055/s-0044-1792040 · Cited by 24
Aydın, F. O., Aksoy, B. K., Ceylan, A., Akbaş, Y. B., Ermiş, S., Yıldız, B. K., & Yıldırım, Y. (2025) · Turkish Journal of Ophthalmology · doi:10.4274/tjo.galenos.2024.28234 · Cited by 23
Zhang, C., Zhang, J., Zhao, Y., & Lu, J. (2025) · Energy · doi:10.1016/j.energy.2025.134824 · Cited by 23
Evaluating interactions of patients with large language models for medical information
Carl, N., Haggenmüller, S., Wies, C., Nguyen, L., Winterstein, J. T., Hetz, M. J., Mangold, M. H., Hartung, F. O., Grüne, B., Holland‐Letz, T., et al. (2025) · British Journal of Urology · doi:10.1111/bju.16676 · Cited by 25
Revolutionizing MASLD: How Artificial Intelligence Is Shaping the Future of Liver Care
Pugliese, N., Bertazzoni, A., Hassan, C., Schattenberg, J. M., & Aghemo, A. (2025) · Cancers · doi:10.3390/cancers17050722 · Cited by 23
False Responses From Artificial Intelligence Models Are Not Hallucinations
Østergaard, S. D., & Nielbo, K. L. (2023) · Schizophrenia Bulletin · doi:10.1093/schbul/sbad068 · Cited by 27
Updates in Diagnostic Imaging for Infectious Keratitis: A Review
Cabrera‐Aguas, M., & Watson, S. L. (2023) · Diagnostics · doi:10.3390/diagnostics13213358 · Cited by 23
The lucent yet opaque challenge of regulating artificial intelligence in radiology
Hillis, J. M., Visser, J. J., Cliff, E. R. S., van der Geest, K., Bizzo, B. C., Dreyer, K. J., Adams‐Prassl, J., & Andriole, K. P. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01071-2 · Cited by 23
Moglia, A., Georgiou, K. E., Cerveri, P., Mainardi, L. T., Satava, R. M., & Cuschieri, A. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10849-5 · Cited by 27
AI meets informed consent: a new era for clinical trial communication
Waters, M. R. (2025) · JNCI Cancer Spectrum · doi:10.1093/jncics/pkaf028 · Cited by 26
ChatGPT in forensic sciences: a new Pandora’s box with advantages and challenges to pay attention
Dinis‐Oliveira, R. J., & Azevedo, R. M. S. (2023) · Forensic Sciences Research · doi:10.1093/fsr/owad039 · Cited by 26
Artificial Intelligence for Risk Assessment on Primary Prevention of Coronary Artery Disease
Chen, S., Loguercio, S., Chen, K., Lee, S. E., Park, J., Liu, S., Sadaei, H. J., & Torkamani, A. (2023) · Current Cardiovascular Risk Reports · doi:10.1007/s12170-023-00731-4 · Cited by 26
Guthrie, E., Levy, D., & del Carmen, G. (2024) · The American Journal of Surgery · doi:10.1016/j.amjsurg.2024.02.016 · Cited by 22
Hu, X., Niemann, M., Kienzle, A., Braun, K. F., Back, D. A., Gwinner, C., Renz, N., Stoeckle, U., Trampuž, A., & Meller, S. (2024) · Digital Health · doi:10.1177/20552076241272620 · Cited by 24
Talyshinskii, A., Juliebø‐Jones, P., Hameed, B. M. Z., Naik, N., Adhikari, K., Zhanbyrbekuly, U., Tzelves, L. I., & Somani, B. K. (2024) · European Urology Open Science · doi:10.1016/j.euros.2024.08.015 · Cited by 23
Cecchini, M. J., Borowitz, M. J., Glassy, E. F., Gullapalli, R. R., Hart, S. N., Hassell, L. A., Homer, R., Jackups, R., McNeal, J. L., & Anderson, S. R. (2024) · Archives of Pathology & Laboratory Medicine · doi:10.5858/arpa.2024-0187-ra · Cited by 23
Reuben, J. S., Meiri, H., & Arien‐Zakay, H. (2024) · Frontiers in Digital Health · doi:10.3389/fdgth.2024.1458811 · Cited by 28
Song, Y., Zhang, Y., Zhou, A., Shi, Y., Shen, S., Tang, X., Li, J., Zhang, M., & Wang, D. (2025) · IEEE Communications Magazine · doi:10.1109/mcom.001.2400342 · Cited by 24
Albalawi, F., Khanagar, S. B., Iyer, K., Alhazmi, N., Alayyash, A., Alhazmi, A. S., Awawdeh, M. A., & Singh, O. G. (2025) · Applied Sciences · doi:10.3390/app15020893 · Cited by 22
Exploring the Boundaries of GPT-4 in Radiology
Liu, Q., Hyland, S. L., Bannur, S., Bouzid, K., Castro, D. C., Wetscherek, M. T., Tinn, R., Sharma, H., Pérez‐García, F., Schwaighofer, A., et al. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.891 · Cited by 42
Robotic Anesthesia: A Vision for 2050
Hemmerling, T. M., & Jeffries, S. D. (2024) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000006835 · Cited by 22
Xue, Z., Zhang, Y., Gan, W., Wang, H., She, G., & Zheng, X. (2024) · Journal of Medical Internet Research · doi:10.2196/50882 · Cited by 22
OptiComm-GPT: a GPT-based versatile research assistant for optical fiber communication systems
Jiang, X., Zhang, M., Song, Y., Zhang, Y., Wang, Y., Ju, C., & Wang, D. (2024) · Optics Express · doi:10.1364/oe.522026 · Cited by 27
ChatGPT for assessing risk of bias of randomized trials using the RoB 2.0 tool: A methods studyPreprint
Pitre, T., Jassal, T., Talukdar, J. R., Shahab, M., Ling, M., & Zeraatkar, D. (2023) · medRxiv · doi:10.1101/2023.11.19.23298727 · Cited by 24
VeriPlan: Integrating Formal Verification and LLMs into End-User Planning
Lee, C. P., Porfirio, D., Wang, X. J., Zhao, K. C., & Mutlu, B. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714113 · Cited by 21
Comparing ChatGPT's and Surgeon's Responses to Thyroid-related Questions From Patients
Guo, S., Li, R., Li, G., Chen, W., Huang, J., He, L., Ma, Y., Wang, L., Zheng, H., Tian, C., et al. (2024) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/clinem/dgae235 · Cited by 21
Uranbey, Ö., Özbey, F., Kaygisiz, Ö. F., & Ayrancı, F. (2024) · Cureus · doi:10.7759/cureus.58607 · Cited by 22
Shikino, K., Shimizu, T., Otsuka, Y., Tago, M., Takahashi, H., Watari, T., Sasaki, Y., Iizuka, G., Tamura, H., Nakashima, K., et al. (2024) · JMIR Medical Education · doi:10.2196/58758 · Cited by 22
The emerging role of generative artificial intelligence in transplant medicine
Deeb, M., Gangadhar, A., Rabindranath, M., Rao, K. R., Brudno, M., Sidhu, A., Wang, B., & Bhat, M. (2024) · American Journal of Transplantation · doi:10.1016/j.ajt.2024.06.009 · Cited by 21
ChatGPT Use Among Pediatric Health Care Providers: Cross-Sectional Survey Study
Kisvarday, S., Yan, A. P., Yarahuan, J. W., Kats, D. J., Ray, M., Kim, E. Y., Hong, P. J., Spector, J. D., Bickel, J. P., Parsons, C. R., et al. (2024) · JMIR Formative Research · doi:10.2196/56797 · Cited by 22
Ferrari‐Light, D., Merritt, R. E., D’Souza, D. M., Ferguson, M. K., Harrison, S. W., Madariaga, M. L. L., Lee, B. E., Moffatt, S. D., & Kneuertz, P. J. (2024) · Journal of Thoracic and Cardiovascular Surgery · doi:10.1016/j.jtcvs.2024.09.030 · Cited by 21
How can large language models assist with a FRAM analysis?
Sujan, M. A., Slater, D., & Crumpton, E. (2024) · Safety Science · doi:10.1016/j.ssci.2024.106695 · Cited by 22
Eisele‐Metzger, A., Lieberum, J.-L., Toews, M., Siemens, W., Heilmeyer, F., Haverkamp, C., Böhringer, D., & Meerpohl, J. J. (2025) · Research Synthesis Methods · doi:10.1017/rsm.2025.12 · Cited by 29
Zhang, X., Li, H., Yin, M., Zhang, M., Li, Z., & Chen, Z. (2026) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2025.2545464 · Cited by 21
Mittal, K., & Dhar, M. (2023) · Journal of The Indian Academy of Geriatrics · doi:10.4103/jiag.jiag_27_23 · Cited by 22
Yuan, J., Bao, P., Chen, Z., Yuan, M., Zhao, J., Pan, J., Xie, Y., Cao, Y., Wang, Y., Wang, Z., et al. (2023) · The Innovation Medicine · doi:10.59717/j.xinn-med.2023.100019 · Cited by 23
Zhang, Y., Chen, R., Nguyen, D., Choi, S. H., Gabel, C. K., Leonard, N., Yim, K. M., O'Donnell, P. J., Elaba, Z., DENG, A. C., et al. (2023) · Journal of the American Academy of Dermatology · doi:10.1016/j.jaad.2023.09.072 · Cited by 22
Mann, V., Viswanath, S. K., Vaidyaraman, S., Balakrishnan, J., & Venkatasubramanian, V. (2023) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2023.108446 · Cited by 21
Xu, L., Lu, L., & Liu, M. (2023) · Heritage Science · doi:10.1186/s40494-023-01068-2 · Cited by 21
Artificial intelligence (AI) for neurologists: do digital neurones dream of electric sheep?
Yeung, J. A., Wang, Y. Y., Kraljević, Ž., & Teo, J. (2023) · Practical Neurology · doi:10.1136/pn-2023-003757 · Cited by 23
Potential applications of ChatGPT in obstetrics and gynecology in Korea: a review article
Lee, Y., & Kim, S. Y. (2024) · Obstetrics & Gynecology Science · doi:10.5468/ogs.23231 · Cited by 24
Mishra, V., Sarraju, A., Kalwani, N. M., & Dexter, J. P. (2024) · Journal of Medical Internet Research · doi:10.2196/55388 · Cited by 22
Apornvirat, S., Thinpanja, W., Damrongkiet, K., Benjakul, N., & Laohawetwanit, T. (2024) · Annals of Diagnostic Pathology · doi:10.1016/j.anndiagpath.2024.152359 · Cited by 21
Enslin, S., & Kaul, V. (2024) · Gastrointestinal Endoscopy Clinics of North America · doi:10.1016/j.giec.2024.09.003 · Cited by 23
Strasser, L. M., Anschuetz, W., Dennstädt, F., & Hastings, J. (2026) · JMIR Medical Education · doi:10.2196/81399 · Cited by 20
Accuracy of a chatbot in answering questions that patients should ask before taking a new medication
Cornelison, B. R., Erstad, B. L., & Edwards, C. J. (2024) · Journal of the American Pharmacists Association · doi:10.1016/j.japh.2024.102110 · Cited by 20
Practical Applications of Large Language Models for Health Care Professionals and Scientists
Reis, F., Lenz, C., Gossen, M., Volk, H., & Drzeniek, N. M. (2024) · JMIR Medical Informatics · doi:10.2196/58478 · Cited by 20
Beck, S. M., Kuhner, M., Haar, M., Daubmann, A., Semmann, M., & Kluge, S. (2024) · Scandinavian Journal of Trauma Resuscitation and Emergency Medicine · doi:10.1186/s13049-024-01266-2 · Cited by 24
Su, Z., Jin, K., Wu, H., Luo, Z., Grzybowski, A. E., & Ye, J. (2024) · Ophthalmology and Therapy · doi:10.1007/s40123-024-01066-y · Cited by 22
Antonie, N. I., Gheorghe, G., Ionescu, V. A., Tiucă, L.-C., & Diaconu, C. C. (2025) · Antibiotics · doi:10.3390/antibiotics14010060 · Cited by 25
Park, C., An, M. H., Hwang, G., Park, R. W., & An, J. (2025) · JMIR Medical Informatics · doi:10.2196/68409 · Cited by 22
Personalizing prostate cancer education for patients using an EHR-Integrated LLM agent
Hao, Y., Holmes, J., Waddle, M. R., Davis, B. J., Yu, N. Y., Vickers, K. S., Preston, H. R., Margolin, D., Löckenhoff, C. E., Vashistha, A., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-02166-0 · Cited by 35
Public use of a generalist LLM chatbot for health queries
Costa-Gomes, B., Tolmachev, P., Taysom, E., Sounderajah, V., Richardson, H. B., Schoenegger, P., Liu, X., Nour, M. M., Spielman, S., Way, S. F., et al. (2026) · Nature Health · doi:10.1038/s44360-026-00117-x · Cited by 37
Will the future of pharmacovigilance be more automated?
Salvo, F., Micallef, J., Lahouegue, A., Chouchana, L., Létinier, L., Faillie, J., & Pariente, A. (2023) · Expert Opinion on Drug Safety · doi:10.1080/14740338.2023.2227091 · Cited by 21
Using a chat-based informed consent tool in large-scale genomic research
Savage, S. K., LoTempio, J. E., Smith, E. D., Andrew, E. H., Mas, G., Kahn-Kirby, A. H., Délot, E. C., Cohen, A. J., Pitsava, G., Nussbaum, R. L., et al. (2023) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocad181 · Cited by 19
Langford, B. J., Branch‐Elliman, W., Nori, P., Marra, A. R., & Bearman, G. M. (2024) · Open Forum Infectious Diseases · doi:10.1093/ofid/ofae053 · Cited by 24
Unexpectedly low accuracy of GPT-4 in identifying common liver diseases from CT scan images
Zhang, Y., Wu, L., Wang, Y., Sheng, B., Tham, Y. C., Ji, H., Chen, Y., Ren, L., Liu, H., & Xu, L. (2024) · Digestive and Liver Disease · doi:10.1016/j.dld.2024.01.191 · Cited by 21
Kim, S. E., Lee, J. H., Choi, B. S., Han, H., Lee, M. C., & Ro, D. H. (2024) · Clinics in Orthopedic Surgery · doi:10.4055/cios23179 · Cited by 21
Kim, H., Yang, J. H., Chang, D.-G., Lenke, L. G., Pizones, J., Castelein, R., Watanabe, K., Trobisch, P., Mundis, G., Suh, S.-W., et al. (2024) · Journal of Medical Internet Research · doi:10.2196/52001 · Cited by 17
Bilgin, G. B., Bilgin, C., Childs, D. S., Orme, J. J., Burkett, B. J., Packard, A. T., Johnson, D. R., Thorpe, M. P., Riaz, I. B., Halfdanarson, T. R., et al. (2024) · Frontiers in Oncology · doi:10.3389/fonc.2024.1386718 · Cited by 22
Gender Representation of Health Care Professionals in Large Language Model–Generated Stories
Menz, B. D., Kuderer, N. M., Chin-Yee, B. H., Logan, J. M., Rowland, A., Sorich, M. J., & Hopkins, A. M. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.34997 · Cited by 24
Robinson, E. J., Qiu, C. X., Sands, S., Khan, M. I., Vora, S., Oshima, K., Nguyen, K., DiFronzo, L. A., Rhew, D. C., & Feng, M. I. (2024) · World Journal of Urology · doi:10.1007/s00345-024-05399-y · Cited by 23
Pre-trained Multimodal Large Language Model Enhances Dermatological Diagnosis using SkinGPT-4Preprint
Zhou, J., He, X., Sun, L., Xu, J., Chen, X., Chu, Y., Zhou, L., Liao, X., Zhang, B., & Gao, X. (2023) · medRxiv · doi:10.1101/2023.06.10.23291127 · Cited by 20
Feasibility and Prospect of Privacy-preserving Large Language Models in Radiology
Cai, W. (2023) · Radiology · doi:10.1148/radiol.232335 · Cited by 20
Yildirim, N., Zlotnikov, S., Venkat, A., Chawla, G., Kim, J., Bukowski, L. A., Kahn, J. M., McCann, J., & Zimmerman, J. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3641982 · Cited by 22
Metadata
- Authors
- Lee, P., Bubeck, S., & Petro, J.
- Affiliations
- Microsoft (United States) (US)
- From Microsoft Research, Redmond, WA (P.L., S.B.); and Nuance Communications, Burlington, MA (J.P.).
- Venue
- New England Journal of Medicine
- Publisher
- Massachusetts Medical Society
- Published
- 2023-03-30
- Volume
- 388
- Issue
- 13
- Pages
- 1233-1239
- ISSN
- 0028-4793 (ISSN-L)
- 1533-4406
- OpenAlex
- W4361289889
- Semantic Scholar
- 72b74bcff8fd76eff6789111a7ce5d0d6c5ac4db
- Cited by
- 1,738
- References
- 6
- Citations by year
- 2026: 405 · 2025: 419 · 2024: 542 · 2023: 370
- FWCI
- 69.16
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- New England Journal of Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Technology and Human Factors in Education and Health
- Keywords
- GPT-4, large language models, AI chatbots, medical practice, clinical decision support, artificial intelligence in healthcare
- MeSH terms
- Artificial Intelligence, Humans, Medicine, Risk Assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review