Current applications and challenges in large language models for patient care: a systematic review
Open accessPublished version of a preprint
The DOI matches its Crossref record; 157 of the 163 references it cites were found in a registry or an index, and 1 are not checked yet; 12 of the 40 sources its claims cite were checked for support.
Abstract
Background: The introduction of large language models (LLMs) into clinical practice promises to improve patient education and empowerment, thereby personalizing medical care and broadening access to medical knowledge. Despite the popularity of LLMs, there is a significant gap in systematized information on their use in patient care. Therefore, this systematic review aims to synthesize current applications and limitations of LLMs in patient care. Methods: We systematically searched 5 databases for qualitative, quantitative, and mixed methods articles on LLMs in patient care published between 2022 and 2023. From 4349 initial records, 89 studies across 29 medical specialties were included. Quality assessment was performed using the Mixed Methods Appraisal Tool 2018. A data-driven convergent synthesis approach was applied for thematic syntheses of LLM applications and limitations using free line-by-line coding in Dedoose. Results: We show that most studies investigate Generative Pre-trained Transformers (GPT)-3.5 (53.2%, n = 66 of 124 different LLMs examined) and GPT-4 (26.6%, n = 33/124) in answering medical questions, followed by patient information generation, including medical text summarization or translation, and clinical documentation. Our analysis delineates two primary domains of LLM limitations: design and output. Design limitations include 6 second-order and 12 third-order codes, such as lack of medical domain optimization, data transparency, and accessibility issues, while output limitations include 9 second-order and 32 third-order codes, for example, non-reproducibility, non-comprehensiveness, incorrectness, unsafety, and bias. Conclusions: This review systematically maps LLM applications and limitations in patient care, providing a foundational framework and taxonomy for their implementation and evaluation in healthcare settings.
Verified 2026-10-05 · 1 reference not checked yet
Overview
CoChat Summary
TL;DR
This systematic review synthesized 89 studies across 29 medical specialties on large language models (LLMs) in patient care published 2022–2023, finding most examined GPT-3.5/GPT-4 for medical question answering and patient information tasks. It maps limitations into design and output domains, with non-comprehensiveness and incorrectness each reported in 87.6% of studies.
Key findings
- Most studies investigated GPT-3.5 (53.2%, n = 66/124 LLMs examined) and GPT-4 (26.6%, n = 33/124); 94.4% (n = 84/89) examined LLMs as medical chatbots, and 20.2% (n = 18/89) focused on patient information generation.
- Thematic synthesis identified design limitations (6 second-order and 12 third-order codes) and output limitations (9 second-order and 32 third-order codes).
- Common output limitations included non-comprehensiveness (87.6%, n = 78/89), incorrectness (87.6%, n = 78/89), unsafeness (43.8%, n = 39/89), non-reproducibility (42.7%, n = 38/89), and bias (6.7%, n = 6/89).
- Incorrectness was classified as hallucination (42.7%, n = 38/89), delirium (38.2%, n = 34/89), confabulation (20.2%, n = 18/89), delusion (15.7%, n = 14/89), illusion (13.5%, n = 12/89), and extrapolation (12.4%, n = 11/89).
Methods
- Systematic review pre-registered in PROSPERO (CRD42024504542) and conducted per PRISMA; searched Web of Science, PubMed, Embase/Embase Classic, ACM Digital Library, and IEEE Xplore as of January 25, 2024, for qualitative, quantitative, and mixed methods articles published January 1, 2022–December 31, 2023. From 4349 records, 89 studies across 29 medical specialties were included.
- Quality assessment used the Mixed Methods Appraisal Tool 2018; a data-driven convergent synthesis approach was applied with free line-by-line coding in Dedoose. No meta-analysis was conducted due to diversity of outcomes and study designs.
- Most included studies were quantitative non-randomized (94.4%, n = 84/89), 4 were qualitative (4.5%), 1 was quantitative randomized (1.1%), and zero mixed methods studies were included.
Limitations
- Stated: the review focused on patient care and excluded research directed at clinicians only; no meta-analysis of LLM performance was possible; eligible studies may have been missed if not in the 5 databases or not available in English; the January 2022 cut-off risks missing predecessor LLMs such as GPT-3; rapid LLM development may make the review and taxonomy outdated.
- Stated: patient acceptance was not assessed in any of the included studies, and whether ongoing human oversight and validation is feasible remains subject to further research.
- Evident from the text: most studies were quantitative non-randomized (94.4%) and zero mixed methods studies were included due to classification; conflicts of interest/funding were not explicitly stated in 25.8% (n = 23/89) of studies; IRB approval was not reported in 61.8% (n = 55/89) and deemed unnecessary in 31.5% (n = 28/89).
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
11 Valid · 1 Not valid · 20 Not checked · 106 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“One major issue is the inherent stochasticity in the models’ architecture, particularly in transformer-based models, which utilize probabilistic techniques during inference (e.g., beam search or temperature sampling)125.”
§ Current applications and challenges in large language models for patient care: a systematic review > Discussion
What the sources say
- Partly supportedcites [125] Ouyang, S., Zhang, J. M., Harman, M. & Wang, M. LLM is Like a Box of Chocolates: the Non-determinism of ChatGPT in Code Generation. arXiv preprint arXiv:2308.02828 (2023). sourceExperimental — accuracy not yet measured
The Introduction (p. 1) supports the core: LLMs are 'nondeterministic by nature' because they predict token probabilities, with randomness 'typically coming from the sampling methods used during text generation, such as top-k sampling or nucleus sampling', and non-determinism 'affects the reliability and reproducibility of empirical software engineering' (p. 1); temperature/greedy sampling is also treated in RQ2 (p. 13). However, our copy never locates the stochasticity in the model architecture and never mentions transformer-based models — the architectural hypothesis it records is GPT-4's 'sparse MoE architecture', alongside floating-point and GPU causes for residual non-determinism at temperature 0 (p. 13). The parenthetical examples are also only partly matched: beam search is not named anywhere as a probabilistic inference technique in this paper. (LLM, conf=0.72)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“suggesting that this limitation is also prevalent and overlooked in other domains of LLM use125.”
§ Current applications and challenges in large language models for patient care: a systematic review > Discussion
What the sources say
- Partly supportedcites [125] Ouyang, S., Zhang, J. M., Harman, M. & Wang, M. LLM is Like a Box of Chocolates: the Non-determinism of ChatGPT in Code Generation. arXiv preprint arXiv:2308.02828 (2023). sourceExperimental — accuracy not yet measured
The Introduction (p. 1) says LLMs are nondeterministic by nature. It also reports that only 21.1% of surveyed LLM-based code-generation papers considered non-determinism (p. 2). That supports the concern for code generation, but the paper does not establish that non-determinism is overlooked in other domains of LLM use. (LLM, conf=0.86)
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“As a result, open-source models such as BioMistral may offer a viable solution6.”
§ Current applications and challenges in large language models for patient care: a systematic review > Discussion
What the sources say
- Supportedcites [6] Labrak, Y. et al. BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical Domains. arXiv preprint arXiv:2402.10373 (2024). source
The Introduction (Sec. 1) frames the gap as the lack of lightweight open-source medical models allowing commercial use with performance comparable to larger or proprietary models, and presents BioMistral 7B as the specialized open-source model built to fill it; the Abstract reports BioMistral's superiority over existing open-source medical models and its 'competitive edge against proprietary counterparts,' and Sec. 2 Related Work casts proprietary models (GPT-4 MedPrompt, Med-PaLM 2) as targets for domain-specific open-source development. This supports the hedged claim that open-source models such as BioMistral may offer a viable solution. The only qualification our copy adds is the Ethics Statement, which restricts BioMistral 7B to research use and advises against production/clinical deployment — a scope caveat rather than a denial of viability. (LLM, conf=0.85)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“It should also be noted that passing these exams does not equate to the practical competence required of a healthcare provider, which was also a limitation identified in our review (third-order codes: implicit knowledge/lack of clinical context; limited clinical reasoning; misunderstanding of medical information/terms; limited in processing/producing medical images)123.”
§ Current applications and challenges in large language models for patient care: a systematic review > Discussion
What the sources say
- Could not verifycites [123] Kung, T. H. et al. Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language models. PLOS Digital Health 2, e0000198 (2023). 36812645 PMC9931230 sourceExperimental — accuracy not yet measured
The Results and Discussion report ChatGPT’s USMLE performance, but do not assess whether passing the exams demonstrates practical competence as a healthcare provider. The Discussion calls for real-world studies of its utility in medical education; it does not make the claimed comparison between exam results and clinical practice. (LLM, conf=0.72)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Despite the use of various mitigation techniques, such as debiasing algorithms, curating balanced datasets, or incorporating fairness-focused training objectives, eliminating bias entirely is a persistent challenge141–143.”
§ Current applications and challenges in large language models for patient care: a systematic review > Discussion
What the sources say
- Not checked yetcites [141] Yang, Y., Liu, Y. & Naghizadeh, P. Adaptive data debiasing through bounded exploration. Advances in Neural Information Processing Systems 35, 1516–1528 (2022).
- Supportedcites [142] Gallegos, I. O. et al. Bias and Fairness in Large Language Models: A Survey. Computational Linguistics, 1-83. 10.1162/coli_a_00524 (2024) source
The survey's contribution list (p. 3) states it draws attention to 'ways that bias may persist at each mitigation stage,' and its mitigation taxonomy covers exactly the three technique types the claim names: projection-based/modular debiasing methods and decoding modifications (§5.1.5, §5.3, pp. 40, 53), data filtering/reweighting/augmentation for curating datasets (§5.1.1–5.1.3, p. 37), and in-training equalizing objectives/fairness regularizers (§5.2.2, p. 42). The discussion of limitations documents their insufficiency — modified prompting 'unsuccessful for bias removal' and projection-based methods 'ill-suited to target downstream biases' (§5.1.6, p. 41), toxicity-reducing decoding amplifying bias (§5.3.4, p. 53), and bias mitigated in the embedding space re-emerging downstream with efficacy 'an open problem' (§6.4, p. 59). Together these support the paraphrase that, despite such mitigation techniques, fully eliminating bias remains a persistent challenge; the source phrases it as persistence/'open problem' rather than an explicit impossibility claim. (LLM, conf=0.85)
- Not checked yetcites [143] Grari, V., Laugel, T., Hashimoto, T., Lamprier, S. & Detyniecki, M. On the Fairness ROAD: Robust Optimization for Adversarial Debiasing. arXiv preprint arXiv:2310.18413 (2023).
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
67 more claims · 4 with their cited sources checked
Create a free account to see all 138 claims and to verify the 28 references still open.
- Probably not a substantial claim. 40
- It may state two separate claims as one. 38
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Secondly, the veracity of professional information dispensed by AI chatbots in nursing education is yet to be ascertained (51).”
From Digital affordances of AI chatbots in nursing education: a systematic review of learning gains and gaps in the evidence (2026) · cites this paper as [51]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, previous reviews of LLM use within patient care have often overlooked pharmacyspecific applications.”
From Large Language Models in Pharmacist-Led Direct Patient Care: A Rapid Review of Published Evaluations (2026) · cites this paper as [16]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Despite LLMs' potential to support pharmacist-led direct patient care tasks, notable challenges include hallucination risk, response sensitivity to prompting method, cost, and data privacy.16,53,92”
From Large Language Models in Pharmacist-Led Direct Patient Care: A Rapid Review of Published Evaluations (2026) · cites this paper as [16]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Current applications and challenges in large language models for patient care: a systematic review > Results > Characteristics of included studies
“84 (n = 84/89, 94.4%) in 202313,25–107”
§ Current applications and challenges in large language models for patient care: a systematic review > References
“33. Patnaik, S. S. & Hoffmann, U. Quantitative evaluation of ChatGPT versus Bard responses to anaesthesia-related queries. Br J Anaesth 132, 169–171 (2024).”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“or both patients and caregivers (n = 25/89, 27%)”
§ Current applications and challenges in large language models for patient care: a systematic review > Results > Characteristics of included studies
Reported 27 · recomputed 28.089888
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“Arabic (n = 2/84, 2.3%)”
§ Current applications and challenges in large language models for patient care: a systematic review > Results > Applications of large language models
Reported 2.3 · recomputed 2.380952
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Current applications and challenges in large language models for patient care: a systematic review > Abstract > Results
“output limitations include 9 second-order and 32 third-order codes”
§ Current applications and challenges in large language models for patient care: a systematic review > Results > Limitations of large language models
“The evaluation of limitations in output data yielded 7 second-order codes”
Citations
Cites
1 retracted
Singer, M. B., Fu, J. J., Chow, J., & Teng, C. C. (2024) · Journal of Surgical Education · doi:10.1016/j.jsurg.2023.11.019 · Cited by 34
RetractedThe PRISMA 2020 statement: An updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n71 · Cited by 108,283
Rayyan-a web and mobile app for systematic reviews.
Ouzzani, M., Hammady, H., Fedorowicz, Z., & Elmagarmid, A. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0384-4 · Cited by 26,092
Advances in neural information processing systems 7
Cios, K., & Shields, M. (1997) · Neurocomputing · doi:10.1016/s0925-2312(97)90018-7 · Cited by 22,059
Advances in Neural Information Processing Systems 19
(2007) · The MIT Press eBooks · doi:10.52202/085713 · Cited by 15,539
High-performance medicine: the convergence of human and artificial intelligence
Topol, E. J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0300-7 · Cited by 10,450
Methods for the thematic synthesis of qualitative research in systematic reviews
Thomas, J., & Harden, A. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-45 · Cited by 9,312
The PRISMA 2020 statement: an updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J., Bossuyt, P., Boutron, I., Hoffmann, T., mulrow, C., Shamseer, L., Tetzlaff, J., Akl, E., Brennan, S. E., et al. (2020) · doi:10.31222/osf.io/v7gm2_v1 · Cited by 8,090
The PRISMA 2020 statement: an updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J., Bossuyt, P., Boutron, I., Hoffmann, T., mulrow, C., Shamseer, L., Tetzlaff, J., Akl, E., Brennan, S. E., et al. (2020) · doi:10.31222/osf.io/v7gm2 · Cited by 5,177
The Mixed Methods Appraisal Tool (MMAT) version 2018 for information professionals and researchers
Hong, Q. N., Fàbregues, S., Bartlett, G., Boardman, F., Cargo, M., Dagenais, P., Gagnon, M.-P., Griffiths, F., Nicolau, B., O’Cathain, A., et al. (2018) · Education for Information · doi:10.3233/efi-180221 · Cited by 4,737 · cited 1×
“Quality assessment was also performed independently for each article within this data extraction form, usingtheMixedMethodsAppraisalTool(MMAT)2018 18 .”
Kung, T. H., Cheatham, M., Medenilla, A., Sillos, C., De Leon, L., Elepaño, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., Maningo, J., et al. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000198 · Cited by 4,115 · cited 1×
“…competence required of a healthcare provider, which was also a limitation identi fi ed in our review (third-order codes: implicit knowledge/ lack of clinical context; limited clinical reasoning; misunderstanding of medical information/terms; limited in processing/producing medical images) 123 .”
Kung, T. H., Cheatham, M., ChatGPT, Medenilla, A., Sillos, C., De Leon, L., Elepaño, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., et al. (2022) · doi:10.1101/2022.12.19.22283643 · Cited by 4,115
Explainability for artificial intelligence in healthcare: a multidisciplinary perspective
the Precise4Q consortium, Amann, J., Blasimme, A., Vayena, E., Frey, D., & Madai, V. I. (2020) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-020-01332-6 · Cited by 2,203
A Survey of Large Language Models
Zhao, W. X., Zhou, K., Li, J., Tang, T., Dong, Z., Hou, Y., Zhang, B., Min, Y., Zhang, J., Liu, P., et al. (2026) · Frontiers of Computer Science · doi:10.1007/s11704-026-60308-3 · Cited by 2,093 · cited 1×
“Public and academic interest in large language models (LLMs) and their potential applications has increased substantially, especially since the release of OpenAI ’ s ChatGPT (Chat Generative Pre-trained Transfor-mers) in November 2022 1 – 3 .”
A Survey of Large Language Models
Zhao, W. X., Zhou, K., Li, J., Tang, T., Wang, X., Hou, Y., Min, Y., Zhang, B., Zhang, J., Dong, Z., et al. (2023) · arXiv · doi:10.48550/arxiv.2303.18223 · Cited by 2,090
Toward expert-level medical question answering with large language models
Singhal, K., Tu, T., Gottweis, J., Sayres, R., Wulczyn, E., Amin, M., Hou, L., Clark, K., Pfohl, S. R., Cole-Lewis, H., et al. (2025) · Nature Medicine · doi:10.1038/s41591-024-03423-7 · Cited by 1,734
Bias and Fairness in Large Language Models: A Survey
Gallegos, I. O., Rossi, R. A., Barrow, J., Tanjim, M. M., Kim, S., Dernoncourt, F., Yu, T., Zhang, R., & Ahmed, N. K. (2024) · Computational Linguistics · doi:10.1162/coli_a_00524 · Cited by 1,245
Ethical and legal challenges of artificial intelligence-driven healthcare
Gerke, S., Minssen, T., & Cohen, G. (2020) · Artificial Intelligence in Healthcare · doi:10.1016/b978-0-12-818438-7.00012-5 · Cited by 1,170
A survey on large language model (LLM) security and privacy: The Good, The Bad, and The Ugly
Yao, Y., Duan, J., Xu, K., Cai, Y., Sun, Z., & Zhang, Y. (2024) · High-Confidence Computing · doi:10.1016/j.hcc.2024.100211 · Cited by 1,083 · cited 1×
“For example, strategies to ensure LLM security and privacy can include continuous monitoring for new vulnerabilities, implementing input validation, conducting regular audits of training data, and using secure data pipelines 146 .”
The future landscape of large language models in medicine
Clusmann, J., Kolbinger, F. R., Muti, H. S., Carrero, Z. I., Eckardt, J.-N., Laleh, N. G., Löffler, C. M. L., Schwarzkopf, S.-C., Unger, M., Veldhuizen, G. P., et al. (2023) · Communications Medicine · doi:10.1038/s43856-023-00370-1 · Cited by 1,045
Self-citationA large language model for electronic health records
Yang, X., Chen, A., PourNejatian, N., Shin, H. C., Smith, K. E., Parisien, C., Compas, C., Martin, C., Costa, A. B., Flores, M. G., et al. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00742-2 · Cited by 847
Hong, Q. N., Pluye, P., Bujold, M., & Wassef, M. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0454-2 · Cited by 754 · cited 1×
“Instead,adata-drivenconvergent synthesisapproachwasselectedforthematicsynthesesofLLMapplications andlimitationsinpatientcare 19 .”
BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical Domains
Labrak, Y., Bazoge, A., Morin, E., et al. (2024) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2402.10373 · Cited by 584
ChatGPT makes medicine easy to swallow: an exploratory case study on simplified radiology reports
Jeblick, K., Schachtner, B., Dexl, J., Mittermeier, A., Stüber, A. T., Topalis, J., Weber, T., Wesp, P., Sabel, B. O., Ricke, J., et al. (2023) · European Radiology · doi:10.1007/s00330-023-10213-1 · Cited by 549
Li, Y., Li, Z., Zhang, K., Dan, R., Jiang, S., & Zhang, Y. (2023) · arXiv · doi:10.48550/arxiv.2303.14070 · Cited by 512
Capabilities of GPT-4 on Medical Challenge Problems
Nori, H., King, N., McKinney, S. M., Carignan, D., & Horvitz, E. (2023) · arXiv · doi:10.48550/arxiv.2303.13375 · Cited by 509
Li, Y., Li, Z., Zhang, K., Dan, R., Jiang, S., & Zhang, Y. (2023) · Cureus · doi:10.7759/cureus.40895 · Cited by 505
Bhayana, R., Krishna, S., & Bleakney, R. R. (2023) · Radiology · doi:10.1148/radiol.230582 · Cited by 460
Health system-scale language models are all-purpose prediction engines
Jiang, L. Y., Liu, X. C., Nejatian, N. P., Nasir-Moin, M., Wang, D., Abidin, A., Eaton, K., Riina, H. A., Laufer, I., Punjabi, P., et al. (2023) · Nature · doi:10.1038/s41586-023-06160-y · Cited by 460
ChatGPT in healthcare: A taxonomy and systematic review
Li, J., Dada, A., Puladi, B., Kleesiek, J., & Egger, J. (2024) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2024.108013 · Cited by 452
MasterKey: Automated Jailbreak Across Multiple Large Language Model Chatbots
Deng, G., Liu, Y., Li, Y., Wang, K., Zhang, Y., Li, Z., Wang, H., Zhang, T., & Liu, Y. (2023) · arXiv · doi:10.48550/arxiv.2307.08715 · Cited by 418 · cited 1×
“Moreover, previous work has shown that automated jailbreak generation is possible across various commercial LLM chatbots 139 .”
Ambient artificial intelligence scribes to alleviate the burden of clinical documentation.
Tierney, A. A., Gayre, G., Hoberman, B., Mattern, B., Ballesca, M., Kipnis, P., Liu, V., & Lee, K. (2024) · NEJM Catalyst · doi:10.1056/cat.23.0404 · Cited by 400
Non-Determinism of "Deterministic" LLM SettingsPreprint
Atil, B., Aykent, S., Chittams, A., Fu, L., Passonneau, R. J., Radcliffe, E., Rajagopal, G. R., Sloan, A., Tudrej, T., Ture, F., et al. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2408.04667 · Cited by 371
Biases in Large Language Models: Origins, Inventory, and Discussion
Navigli, R., Conia, S., & Ross, B. (2023) · Journal of Data and Information Quality · doi:10.1145/3597307 · Cited by 364 · cited 1×
“Ultimately, only six studies have identi fi ed biases in their results, for example,re fl ectingtheunequalrepresentationofcertaincontentorthebiases inherent in human-generated text in the training data 138 .”
Opportunities and Challenges for ChatGPT and Large Language Models in Biomedicine and Health
Tian, S., Jin, Q., Yeganova, L., Lai, P.-T., Zhu, Q., Chen, X., Yang, Y., Chen, Q., Kim, W., Comeau, D. C., et al. (2023) · Briefings in Bioinformatics · doi:10.1093/bib/bbad493 · Cited by 359
Adams, L. C., Truhn, D., Busch, F., Kader, A., Niehues, S. M., Makowski, M. R., & Bressem, K. K. (2023) · Radiology · doi:10.1148/radiol.230725 · Cited by 339
Self-citationTowards Expert-Level Medical Question Answering with Large Language Models
Singhal, K., Tu, T., Gottweis, J., Sayres, R., Wulczyn, E., Hou, L., Clark, K., Pfohl, S., Cole-Lewis, H., Neal, D., et al. (2023) · arXiv · doi:10.48550/arxiv.2305.09617 · Cited by 338
Large Language Models Are Human-Level Prompt Engineers
Zhou, Y., Muresanu, A. I., Han, Z., Paster, K., Pitis, S., Chan, H., & Ba, J. (2022) · arXiv · doi:10.48550/arxiv.2211.01910 · Cited by 330
Comparing ChatGPT and GPT-4 performance in USMLE soft skill assessments
Brin, D., Sorin, V., Vaid, A., Soroush, A., Glicksberg, B. S., Charney, A. W., Nadkarni, G., & Klang, E. (2023) · Scientific Reports · doi:10.1038/s41598-023-43436-9 · Cited by 319
Benchmarking Retrieval-Augmented Generation for Medicine
Xiong, G., Jin, Q., Lu, Z., & Zhang, A. (2024) · arXiv · doi:10.48550/arxiv.2402.13178 · Cited by 312
Towards Accurate Differential Diagnosis with Large Language Models
McDuff, D., Schaekermann, M., Tu, T., Palepu, A., Wang, A., Garrison, J., Singhal, K., Sharma, Y., Azizi, S., Kulkarni, K., et al. (2023) · arXiv · doi:10.48550/arxiv.2312.00164 · Cited by 311
Towards accurate differential diagnosis with large language models
McDuff, D., Schaekermann, M., Tu, T., Palepu, A., Wang, A., Garrison, J., Singhal, K., Sharma, Y., Azizi, S., Kulkarni, K., et al. (2025) · Nature · doi:10.1038/s41586-025-08869-4 · Cited by 311
Benchmarking Retrieval-Augmented Generation for Medicine
Xiong, G., Jin, Q., Lu, Z., & Zhang, A. (2024) · Findings of the Association for Computational Linguistics ACL 2024 · doi:10.18653/v1/2024.findings-acl.372 · Cited by 310
Academic integrity and artificial intelligence: is ChatGPT hype, hero or heresy?
Currie, G. M. (2023) · Seminars in Nuclear Medicine · doi:10.1053/j.semnuclmed.2023.04.008 · Cited by 283 · cited 1×
“…into illusions, delusions, delirium, confabulation, and extrapolation, thus proposing a framework for a more precise and structured error classi fi cation to improve the characterization of incorrect outputs and enabling more detailed performance comparisons with other research 43,112,113 .”
Samaan, J. S., Yeo, Y. H., Rajeev, N., Hawley, L., Abel, S., Ng, W. H., Srinivasan, N., Park, J., Burch, M., Watson, R., et al. (2023) · Obesity Surgery · doi:10.1007/s11695-023-06603-5 · Cited by 282 · cited 4×
“13,50,60,88 , and local/national medical resources ( n = 5/89, 5.6”
InfluentialUllah, E., Parwani, A., Baig, M. M., & Singh, R. (2024) · Diagnostic Pathology · doi:10.1186/s13000-024-01464-7 · Cited by 281
BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical Domains
Labrak, Y., Bazoge, A., Morin, E., Gourraud, P.-A., Rouvier, M., & Dufour, R. (2024) · Findings of the Association for Computational Linguistics ACL 2024 · doi:10.18653/v1/2024.findings-acl.348 · Cited by 269
The reality of informed consent: empirical studies on patient comprehension—systematic review
Pietrzykowski, T., & Smilowska, K. (2021) · Trials · doi:10.1186/s13063-020-04969-w · Cited by 259
An Empirical Study of the Non-Determinism of ChatGPT in Code Generation
Ouyang, S., Zhang, J. M., Harman, M., & Wang, M. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3697010 · Cited by 258
Use of Artificial Intelligence Chatbots for Cancer Treatment Information
Chen, S., Kann, B. H., Foote, M. B., Aerts, H. J. W. L., Savova, G. K., Mak, R. H., & Bitterman, D. S. (2023) · JAMA Oncology · doi:10.1001/jamaoncol.2023.2954 · Cited by 251 · cited 1×
“25,28,32,33,35 – 38,40 – 44 ,49 – 51,57 – 60,65,73,74,76,77 , 81 ,83 ,85,91,94,96 Aminorityofreportsidenti fi edbiasesintheoutput,whichwererelated to language ( n = 2/89, 2.3”
InfluentialBernstein, I. A., Zhang, Y. (., Govil, D., Majid, I., Chang, R. T., Sun, Y., Shue, A., Chou, J. C., Schehlein, E., Christopher, K. L., et al. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.30320 · Cited by 247
AI generates covertly racist decisions about people based on their dialect
Hofmann, V., Kalluri, P. R., Jurafsky, D., & King, S. (2024) · Nature · doi:10.1038/s41586-024-07856-5 · Cited by 233
An evaluation framework for clinical use of large language models in patient interaction tasks
Johri, S., Jeong, J., Tran, B. A., Schlessinger, D. I., Wongvibulsin, S., Barnes, L. A., Zhou, H.-Y., Cai, Z. R., Van Allen, E. M., Kim, D., et al. (2025) · Nature Medicine · doi:10.1038/s41591-024-03328-5 · Cited by 201
Xie, Y., Seth, I., Hunter-Smith, D. J., Rozen, W. M., Ross, R., & Lee, M. (2023) · Aesthetic Plastic Surgery · doi:10.1007/s00266-023-03338-7 · Cited by 198 · cited 3×
“24,31,43,48,49,57,59,62,67,79,88 – 91,97,102,106,107 , including clinical documentation”
InfluentialFully informed consent can be needlessly cruel.
Tobias, J. S., & Souhami, R. L. (1993) · BMJ · doi:10.1136/bmj.307.6913.1199 · Cited by 180
Decker, H., Trang, K., Ramirez, J., Colley, A., Pierce, L., Coleman, M., Bongiovanni, T., Melton, G. B., & Wick, E. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.36997 · Cited by 178 · cited 1×
“24,31,43,48,49,57,59,62,67,79,88 – 91,97,102,106,107 , including clinical documentation”
Mohammad‐Rahimi, H., Ourang, S. A., Pourhoseingholi, M. A., Dianat, O., Dummer, P. M. H., & Nosrat, A. (2023) · International Endodontic Journal · doi:10.1111/iej.14014 · Cited by 165
Zhu, L., Mou, W., & Chen, R. (2023) · Journal of Translational Medicine · doi:10.1186/s12967-023-04123-5 · Cited by 143
Patient Perspectives on the Use of Artificial Intelligence in Health Care: A Scoping Review
Moy, S., Irannejad, M., Manning, S. J., Farahani, M., Ahmed, Y., Gao, E., Prabhune, R., Lorenz, S., Mirza, R. M., & Klinger, C. A. (2024) · Journal of patient-centered research and reviews · doi:10.17294/2330-0698.2029 · Cited by 141
Large language models show human-like content biases in transmission chain experiments
Acerbi, A., & Stubbersfield, J. M. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2313790120 · Cited by 137
MASTERKEY: Automated Jailbreaking of Large Language Model Chatbots
Deng, G., Liu, Y., Li, Y., Wang, K., Zhang, Y., Li, Z., Wang, H., Zhang, T., & Liu, Y. (2024) · Proceedings 2024 Network and Distributed System Security Symposium · doi:10.14722/ndss.2024.24188 · Cited by 137
Navigating the European Union Artificial Intelligence Act for Healthcare
Busch, F., Kather, J. N., Johner, C., Moser, M., Truhn, D., Adams, L. C., & Bressem, K. K. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01213-6 · Cited by 133
Self-citationFormosa, P., Rogers, W., Griep, Y., Bankins, S., & Richards, D. (2022) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107296 · Cited by 129
Chiesa-Estomba, C. M., Lechien, J. R., Vaira, L. A., Brunet, A., Cammaroto, G., Mayo‐Yáñez, M., Barrueco, Á. S., & Saga-Gutiérrez, C. (2023) · European Archives of Oto-Rhino-Laryngology · doi:10.1007/s00405-023-08104-8 · Cited by 124
MEDITRON-70B: Scaling Medical Pretraining for Large Language Models
Chen, Z., Cano, A. H., Romanou, A., Bonnet, A., Matoba, K., Salvi, F., Pagliardini, M., Fan, S., Köpf, A., Mohtashami, A., et al. (2023) · arXiv · doi:10.48550/arxiv.2311.16079 · Cited by 122 · cited 1×
“Since most LLMs are designed as general-purpose chatbots, recent research has focused on developing specialized models for the medical domain, such as Meditron or BioMistral, by enriching the training data of LLMs with medical knowledge 5,6 .”
Vaira, L. A., Lechien, J. R., Abbate, V., Allevi, F., Audino, G., Beltramini, G. A., Bergonzani, M., Bolzoni, A., Committeri, U., Crimi, S., et al. (2024) · Otolaryngology–Head and Neck Surgery · doi:10.1002/ohn.489 · Cited by 122
Li, H., Moon, J. T., Iyer, D., Balthazar, P., Krupinski, E. A., Bercu, Z. L., Newsome, J. M., Banerjee, I., Gichoya, J. W., & Trivedi, H. M. (2023) · Clinical Imaging · doi:10.1016/j.clinimag.2023.06.008 · Cited by 118 · cited 2×
“24,31,43,48,49,57,59,62,67,79,88 – 91,97,102,106,107 , including clinical documentation”
InfluentialExploring the Potential of ChatGPT as a Supplementary Tool for Providing Orthopaedic Information
Kaarre, J., Feldt, R., Keeling, L. E., Dadoo, S., Zsidai, B., Hughes, J. D., Samuelsson, K., & Musahl, V. (2023) · Knee Surgery Sports Traumatology Arthroscopy · doi:10.1007/s00167-023-07529-2 · Cited by 117 · cited 2×
“13,24 – 62,64 – 66,68,69,71 – 96,98 – 111 ,whilefewerreportsadditionallyorexclusively focused on the generation of patient information ( n = 18/89, 20.2”
InfluentialIs ChatGPT accurate and reliable in answering questions regarding head and neck cancer?
Kuşcu, O., Pamuk, A. E., Sütay Süslü, N., & Hosal, S. (2023) · Frontiers in Oncology · doi:10.3389/fonc.2023.1256459 · Cited by 117
Head‐to‐Head Comparison of ChatGPT Versus Google Search for Medical Knowledge Acquisition
Ayoub, N. F., Lee, Y., Grimm, D., & Divi, V. (2024) · Otolaryngology–Head and Neck Surgery · doi:10.1002/ohn.465 · Cited by 111
Hurley, E. T., Crook, B. S., Lorentz, S. G., Danilkowicz, R. M., Lau, B. C., Taylor, D. C., Dickens, J. F., Anakwenze, O., & Klifto, C. S. (2024) · Arthroscopy: The Journal of Arthroscopic & Related Surgery · doi:10.1016/j.arthro.2023.07.048 · Cited by 103
Artificial intelligence chatbot performance in triage of ophthalmic conditions
Lyons, R. J., Arepalli, S. R., Fromal, O., Choi, J. D., & Jain, N. (2024) · Canadian Journal of Ophthalmology · doi:10.1016/j.jcjo.2023.07.016 · Cited by 101 · cited 3×
“46,49,51,54,72,90,93,97,109 , provider/organization ( n = 4/89, 4.5”
InfluentialGordon, E. B., Towbin, A. J., Wingrove, P., Shafique, U., Haas, B., Kitts, A. B., Feldman, J., & Furlan, A. (2024) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2023.09.011 · Cited by 100
Health-LLM: Personalized Retrieval-Augmented Disease Prediction SystemPreprint
Yu, Q., Jin, M., Shu, D., Zhang, C., Fan, L., Hua, W., Zhu, S., Meng, Y., Wang, Z., Du, M., et al. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.00746 · Cited by 97
ChatGPT Makes Medicine Easy to Swallow: An Exploratory Case Study on Simplified Radiology Reports
Jeblick, K., Schachtner, B., Dexl, J., Mittermeier, A., Stüber, A. T., Topalis, J., Weber, T., Wesp, P., Sabel, B., Ricke, J., et al. (2022) · arXiv · doi:10.48550/arxiv.2212.14882 · Cited by 97
Coskun, B., Ocakoglu, G., Yetemen, M., & Kaygisiz, O. (2023) · Urology · doi:10.1016/j.urology.2023.05.040 · Cited by 96
Nastasi, A. J., Courtright, K. R., Halpern, S. D., & Weissman, G. E. (2023) · Scientific Reports · doi:10.1038/s41598-023-45223-y · Cited by 93
Lahat, A., Shachar, E., Avidan, B., Glicksberg, B., & Klang, E. (2023) · Diagnostics · doi:10.3390/diagnostics13111950 · Cited by 92
Chervenak, J., Lieman, H., Blanco-Breindel, M., & Jindal, S. (2023) · Fertility and Sterility · doi:10.1016/j.fertnstert.2023.05.151 · Cited by 87
Leveraging large language models for generating responses to patient messages—a subjective analysis
Liu, S., McCoy, A. B., Wright, A. P., Carew, B., Genkins, J. Z., Huang, S. S., Peterson, J. F., Steitz, B., & Wright, A. (2024) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocae052 · Cited by 86
Biswas, S., Logan, N. S., Davies, L. N., Sheppard, A. L., & Wolffsohn, J. S. (2023) · Ophthalmic and Physiological Optics · doi:10.1111/opo.13207 · Cited by 84
The Use of Large Language Models to Generate Education Materials about Uveitis
Kianian, R., Sun, D., Crowell, E. L., & Tsui, E. (2024) · Ophthalmology Retina · doi:10.1016/j.oret.2023.09.008 · Cited by 83
AI-Powered Renal Diet Support: Performance of ChatGPT, Bard AI, and Bing Chat
Qarajeh, A., Tangpanithandee, S., Thongprayoon, C., Suppadungsuk, S., Krisanapan, P., Aiumtrakul, N., Garcia Valencia, O. A., Miao, J., Qureshi, F., & Cheungpasitporn, W. (2023) · Clinics and Practice · doi:10.3390/clinpract13050104 · Cited by 82
Song, H., Xia, Y., Luo, Z., Liu, H., Song, Y., Zeng, X., Li, T., Zhong, G., Li, J., Chen, M., et al. (2023) · Journal of Medical Systems · doi:10.1007/s10916-023-02021-3 · Cited by 81
Evaluating ChatGPT Responses on Thyroid Nodules for Patient Education
Campbell, D. J., Estephan, L. E., Sina, E. M., Mastrolonardo, E. V., Alapati, R., Amin, D. R., & Cottrill, E. E. (2024) · Thyroid® · doi:10.1089/thy.2023.0491 · Cited by 81
Seth, I., Lim, B., Xie, Y., Cevik, J., Rozen, W. M., Ross, R. J., & Lee, M. (2023) · Aesthetic Surgery Journal Open Forum · doi:10.1093/asjof/ojad084 · Cited by 78
“Dr ChatGPT”: Is it a reliable and useful source for common rheumatic diseases?
Uz, C., & Umay, E. (2023) · International Journal of Rheumatic Diseases · doi:10.1111/1756-185x.14749 · Cited by 77
Pushpanathan, K., Lim, Z. W., Er Yew, S. M., Chen, D. Z., Hui'En Lin, H. A., Lin Goh, J. H., Wong, W. M., Wang, X., Jin Tan, M. C., Chang Koh, V. T., et al. (2023) · iScience · doi:10.1016/j.isci.2023.108163 · Cited by 77
Coşkun, B. N., Yağız, B., Ocakoğlu, G., Dalkılıç, E., & Pehlivan, Y. (2023) · Rheumatology International · doi:10.1007/s00296-023-05473-5 · Cited by 73
Truhn, D., Weber, C. D., Braun, B. J., Bressem, K., Kather, J. N., Kuhl, C., & Nebelung, S. (2023) · Scientific Reports · doi:10.1038/s41598-023-47500-2 · Cited by 71 · cited 2×
“28,34,44,46,70,74,76,79,94,102 , speci fi city ( n = 13/89, 14.6”
InfluentialSelf-citationAccuracy of ChatGPT in Common Gastrointestinal Diseases: Impact for Patients and Providers
Kerbage, A., Kassab, J. T., Dahdah, J. E., Burke, C. A., Achkar, J., & Rouphael, C. (2023) · Clinical Gastroenterology and Hepatology · doi:10.1016/j.cgh.2023.11.008 · Cited by 70
Ye, C., Zweck, E., Ma, Z., Smith, J., & Katz, S. (2024) · Arthritis & Rheumatology · doi:10.1002/art.42737 · Cited by 69
Haver, H. L., Lin, C. T., Sirajuddin, A., Yi, P. H., & Jeudy, J. (2023) · American Journal of Roentgenology · doi:10.2214/ajr.23.29622 · Cited by 68
Sezgin, E., Chekeni, F., Lee, J., & Keim, S. (2023) · Journal of Medical Internet Research · doi:10.2196/49240 · Cited by 65
Seth, I., Xie, Y., Rodwell, A., Gracias, D., Bulloch, G., Hunter-Smith, D. J., & Rozen, W. M. (2023) · The Journal of Hand Surgery · doi:10.1016/j.jhsa.2023.07.003 · Cited by 62
ChatGPT passes German state examination in medicine with picture questions omitted
Jung, L. B., Gudera, J. A., Wiegand, T. L. T., Allmendinger, S., Dimitriadis, K., & Koerte, I. K. (2023) · Deutsches Ärzteblatt international · doi:10.3238/arztebl.m2023.0113 · Cited by 60
Scheschenja, M., Viniol, S., Bastian, M. B., Wessendorf, J., König, A. M., & Mahnken, A. H. (2024) · CardioVascular and Interventional Radiology · doi:10.1007/s00270-023-03563-2 · Cited by 60
Can ChatGPT help patients answer their otolaryngology questions?
Zalzal, H. G., Abraham, A. W., Cheng, J., & Shah, R. K. (2023) · Laryngoscope Investigative Otolaryngology · doi:10.1002/lio2.1193 · Cited by 60
Semantic Consistency for Assuring Reliability of Large Language ModelsPreprint
Raj, H., Gupta, V., Rosati, D., & Majumdar, S. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2308.09138 · Cited by 59
ChatGPT: Can You Prepare My Patients for [18F]FDG PET/CT and Explain My Reports?
Rogasch, J. M. M., Metzger, G., Preisler, M., Galler, M., Thiele, F., Brenner, W., Feldhaus, F., Wetz, C., Amthauer, H., Furth, C., et al. (2023) · Journal of Nuclear Medicine · doi:10.2967/jnumed.123.266114 · Cited by 58
Hermann, C. E., Patel, J. M., Boyd, L., Growdon, W. B., Aviki, E., & Stasenko, M. (2023) · Gynecologic Oncology · doi:10.1016/j.ygyno.2023.11.008 · Cited by 56
Stroop, A., Stroop, T., Alsofy, S. Z., Nakamura, M., Möllmann, F., Greiner, C., & Stroop, R. (2023) · European Spine Journal · doi:10.1007/s00586-023-07975-z · Cited by 55
ChatGPT and Patient Information in Nuclear Medicine: GPT-3.5 Versus GPT-4
Currie, G., Robbie, S., & Tually, P. (2023) · Journal of Nuclear Medicine Technology · doi:10.2967/jnmt.123.266151 · Cited by 54
Birkun, A. A., & Gautam, A. (2023) · Prehospital and Disaster Medicine · doi:10.1017/s1049023x23006568 · Cited by 54
Nielsen, J. P. S., von Buchwald, C., & Grønhøj, C. (2023) · Acta Oto-Laryngologica · doi:10.1080/00016489.2023.2254809 · Cited by 51
Shao, C.-Y., Li, H., Liu, X.-L., Li, C., Yang, L.-Q., Zhang, Y.-J., Luo, J., & Zhao, J. (2023) · Interactive Journal of Medical Research · doi:10.2196/46900 · Cited by 49
Durairaj, K. K., Baker, O., Bertossi, D., Dayan, S. H., Karimi, K., Kim, R. Y., Most, S. P., Robotti, E., & Rosengaus, F. (2023) · Facial Plastic Surgery & Aesthetic Medicine · doi:10.1089/fpsam.2023.0224 · Cited by 49
Kim, H.-W., Shin, D.-H., Kim, J., Lee, G.-H., & Cho, J. W. (2024) · Seizure: European Journal of Epilepsy · doi:10.1016/j.seizure.2023.11.013 · Cited by 48
Evaluating the Potential of LLMs and ChatGPT on Medical Diagnosis and Treatment
Panagoulias, D. P., Palamidas, F. A., Virvou, M. K., & Tsihrintzis, G. A. (2023) · International Conference on Information, Intelligence, Systems & Applications (IISA) · doi:10.1109/iisa59645.2023.10345968 · Cited by 48
Bushuven, S., Bentele, M., Bentele, S., Gerber, B., Bansbach, J., Ganter, J., Trifunovic-Koenig, M., & Ranisch, R. (2023) · Journal of Medical Systems · doi:10.1007/s10916-023-02019-x · Cited by 47
ChatGPT in Nuclear Medicine Education
Currie, G., & Barry, K. (2023) · Journal of Nuclear Medicine Technology · doi:10.2967/jnmt.123.265844 · Cited by 47
Assessing AI-Powered Patient Education: A Case Study in Radiology
Kuckelman, I. J., Yi, P. H., Bui, M., Onuh, I., Anderson, J. A., & Ross, A. B. (2024) · Academic Radiology · doi:10.1016/j.acra.2023.08.020 · Cited by 46
BPPV Information on Google Versus AI (ChatGPT)
Bellinger, J. R., De La Chapa, J. S., Kwak, M. W., Ramos, G. A., Morrison, D., & Kesser, B. W. (2024) · Otolaryngology–Head and Neck Surgery · doi:10.1002/ohn.506 · Cited by 44
Appropriateness of ChatGPT in Answering Heart Failure Related Questions
King, R. C., Samaan, J. S., Yeo, Y. H., Mody, B., Lombardo, D. M., & Ghashghaei, R. (2024) · Heart, Lung and Circulation · doi:10.1016/j.hlc.2024.03.005 · Cited by 44
Leveraging Large Language Models for Generating Responses to Patient Messages
Liu, S., McCoy, A. B., Wright, A. P., Carew, B., Genkins, J. Z., Huang, S. S., Peterson, J. F., Steitz, B., & Wright, A. (2023) · doi:10.1101/2023.07.14.23292669 · Cited by 43
The potential of chatbots in chronic venous disease patient management
Athavale, A., Baier, J., Ross, E., & Fukaya, E. (2023) · JVS-Vascular Insights · doi:10.1016/j.jvsvi.2023.100019 · Cited by 43
Hung, Y.-C., Chaker, S. C., Sigel, M., Saad, M., & Slater, E. D. (2023) · Annals of Plastic Surgery · doi:10.1097/sap.0000000000003634 · Cited by 43
Potential Use of ChatGPT for Patient Information in Periodontology: A Descriptive Pilot Study
Babayiğit, O., Tastan Eroglu, Z., Ozkan Sen, D., & Ucan Yarkac, F. (2023) · Cureus · doi:10.7759/cureus.48518 · Cited by 42
The Future of Patient Education: AI-Driven Guide for Type 2 Diabetes
Hernandez, C. A., Gonzalez, A. E. V., Polianovskaia, A., Sanchez, R. A., Arce, V. M., Mustafa, A., Vypritskaya, E., Gutierrez, O. P., Bashir, M., & Sedeh, A. E. (2023) · Cureus · doi:10.7759/cureus.48919 · Cited by 42
Certified Robustness for Large Language Models with Self-DenoisingPreprint
Zhang, Z., Zhang, G., Hou, B., Fan, W., Li, Q., Liu, S., Zhang, Y., & Chang, S. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2307.07171 · Cited by 41
Scquizzato, T., Semeraro, F. F., Swindell, P., Simpson, R. F. G., Angelini, M., Gazzato, A., Sajjad, U., Bignami, E. G., Landoni, G., Keeble, T., et al. (2023) · Resuscitation · doi:10.1016/j.resuscitation.2023.110077 · Cited by 38
Evaluation of ChatGPT Dermatology Responses to Common Patient Queries
Ferreira, A. L., Chu, B. K., Grant-Kels, J. M., Ogunleye, T. A., & Lipoff, J. B. (2023) · JMIR Dermatology · doi:10.2196/49280 · Cited by 37
Cankurtaran, R. E., Polat, Y. H., Aydemir, N. G., Umay, E., & Yurekli, O. T. (2023) · Cureus · doi:10.7759/cureus.46736 · Cited by 36
ChatGPT’s ability to comprehend and answer cirrhosis related questions in Arabic
Samaan, J. S., Yeo, Y. H., Ng, W. H., Ting, P.-S., Trivedi, H., Vipani, A., Yang, J. D., Liran, O., Spiegel, B., Kuo, A., et al. (2023) · Arab Journal of Gastroenterology · doi:10.1016/j.ajg.2023.08.001 · Cited by 35
GPT-4 outperforms ChatGPT in answering non-English questions related to cirrhosis
Yeo, Y. H., Samaan, J. S., Ng, W. H., Ma, X., Ting, P.-S., Kwak, M.-S., Panduro, A., Lizaola-Mayo, B., Trivedi, H., Vipani, A., et al. (2023) · doi:10.1101/2023.05.04.23289482 · Cited by 35 · cited 1×
“32,36 , insurance status 103 , underserved racial groups 26 , or underrepresented procedures 34 ( n = 1/89, 1.1%, each).”
InfluentialMandatory Disclaimers On Dietary Supplements Do Not Reliably Communicate The Intended Issues
Kesselheim, A. S., Connolly, J., Rogers, J. R., & Avorn, J. (2015) · Health Affairs · doi:10.1377/hlthaff.2014.0515 · Cited by 35
Dialect prejudice predicts AI decisions about people's character, employability, and criminality
Hofmann, V., Kalluri, P. R., Jurafsky, D., & King, S. (2024) · arXiv · doi:10.48550/arxiv.2403.00742 · Cited by 33
Knebel, D., Priglinger, S., Scherer, N., Klaas, J., Siedlecki, J., & Schworm, B. (2024) · Klinische Monatsblätter für Augenheilkunde · doi:10.1055/a-2149-0447 · Cited by 32
ChatGPT in Answering Queries Related to Lifestyle-Related Diseases and Disorders
Mondal, H., Dash, I., Mondal, S., & Behera, J. K. (2023) · Cureus · doi:10.7759/cureus.48296 · Cited by 32
Exploring Vulnerabilities and Protections in Large Language Models: A SurveyPreprint
Liu, F. W., & Hu, C. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2406.00240 · Cited by 32
Knebel, D., Priglinger, S., Scherer, N., Siedlecki, J., & Schworm, B. (2023) · doi:10.1101/2023.04.16.23288645 · Cited by 32
ChatGPT in the development of medical questionnaires. The example of the low back pain
Coraci, D., Maccarone, M. C., Regazzo, G., Accordi, G., Papathanasiou, J. V., & Masiero, S. (2023) · European Journal of Translational Myology · doi:10.4081/ejtm.2023.12114 · Cited by 31
Savage, T., Wang, J., & Shieh, L. (2023) · JMIR Medical Informatics · doi:10.2196/49886 · Cited by 30
Generating Informed Consent Documents Related to Blepharoplasty Using ChatGPT
Shiraishi, M., Tomioka, Y., Miyakuni, A., Moriwaki, Y., Yang, R., Oba, J., & Okazaki, M. (2023) · Ophthalmic Plastic and Reconstructive Surgery · doi:10.1097/iop.0000000000002574 · Cited by 30
Draschl, A., Hauer, G., Fischerauer, S. F., Kogler, A., Leitner, L., Andreou, D., Leithner, A., & Sadoghi, P. (2023) · Journal of Clinical Medicine · doi:10.3390/jcm12206655 · Cited by 29
Assessing Racial and Ethnic Bias in Text Generation for Healthcare-Related Tasks by ChatGPT 1
Hanna, J. J., Wakene, A. D., Lehmann, C. U., & Medford, R. J. (2023) · doi:10.1101/2023.08.28.23294730 · Cited by 28 · cited 1×
“24,31,43,48,49,57,59,62,67,79,88 – 91,97,102,106,107 , including clinical documentation”
Floyd, W., Kleber, T. J., Carpenter, D. J., Pasli, M., Qazi, J. J., Huang, C. C., Leng, J. X., Ackerson, B. G., Pierpoint, M., Salama, J. K., et al. (2023) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2023.10.020 · Cited by 28
Zhou, J., Li, T., Fong, S. J., Dey, N., & Crespo, R. A. G. (2023) · International Journal of Interactive Multimedia and Artificial Intelligence · doi:10.9781/ijimai.2023.04.007 · Cited by 28
Online patient education in body contouring: A comparison between Google and ChatGPT
Bonetti, M. A., Liu, H. Y., Palmesano, M., Nguyen, V. T., & Egro, F. M. (2023) · Journal of Plastic Reconstructive & Aesthetic Surgery · doi:10.1016/j.bjps.2023.10.091 · Cited by 27
Evaluation of a chat GPT generated patient information leaflet about laparoscopic cholecystectomy
Lockie, E., & Choi, J. (2023) · ANZ Journal of Surgery · doi:10.1111/ans.18834 · Cited by 26
Quantitative evaluation of ChatGPT versus Bard responses to anaesthesia-related queries
Patnaik, S. S., & Hoffmann, U. (2023) · British Journal of Anaesthesia · doi:10.1016/j.bja.2023.09.030 · Cited by 26
Promises and Pitfalls of Artificial Intelligence for Legal Applications
Kapoor, S., Henderson, P., & Narayanan, A. (2024) · doi:10.2139/ssrn.4695412 · Cited by 25 · cited 1×
“For example, if the exam questions or similar variants arepubliclyavailableand,thus,maybepresentinthetrainingdata,theLLM doesnotdemonstrateanyknowledgeoutsideoftrainingdata memorization 124 .”
Can ChatGPT explain it? Use of artificial intelligence in multiple sclerosis communication
Inojosa, H., Gilbert, S., Kather, J. N., Proschmann, U., Akgün, K., & Ziemssen, T. (2023) · Neurological Research and Practice · doi:10.1186/s42466-023-00270-8 · Cited by 25
Self-citationBarclay, K. S., You, J. Y., Coleman, M. J., Mathews, P. M., Ray, V., Riaz, K. M., Rojas, J. O. D., Wang, A. S., Watson, S. H., Koo, E. H., et al. (2023) · Cornea · doi:10.1097/ico.0000000000003439 · Cited by 22
ChatGPT and Rhinoplasty Recovery: An Exploration of AI's Role in Postoperative Guidance
Capelleras, M., Soto-Galindo, G. A., Cruellas, M., & Apaydın, F. (2023) · Facial Plastic Surgery · doi:10.1055/a-2219-4901 · Cited by 21
A large language model artificial intelligence for patient queries in atopic dermatitis
Sulejmani, P., Negris, O., Aoki, V., Chu, C., Eichenfield, L., Misery, L., Mosca, A., Orfali, R. L., Aroman, M. S., Stalder, J., et al. (2024) · Journal of the European Academy of Dermatology and Venereology · doi:10.1111/jdv.19737 · Cited by 20
Guidelines For Rigorous Evaluation of Clinical LLMs For Conversational ReasoningPreprint
Johri, S., Jeong, J., Tran, B. A., Schlessinger, D. I., Wongvibulsin, S., Cai, Z. R., Daneshjou, R., & Rajpurkar, P. (2023) · medRxiv · doi:10.1101/2023.09.12.23295399 · Cited by 17
Can Large Language Models Safely Address Patient Questions Following Cataract Surgery?
Chowdhury, M., Lim, E., Higham, A., McKinnon, R., Ventoura, N., He, Y., & De Pennington, N. (2023) · Proceedings of the 5th Clinical Natural Language Processing Workshop · doi:10.18653/v1/2023.clinicalnlp-1.17 · Cited by 17
Samaan, J. S., Issokson, K., Feldman, E., Fasulo, C., Rajeev, N. D., Ng, W. H., Hollander, B. S., Yeo, Y. H., & Vasiliauskas, E. A. (2024) · Crohn s & Colitis 360 · doi:10.1093/crocol/otae077 · Cited by 17
Ali, H., Patel, P., Obaitan, I., Mohan, B. P., Sohail, A. H., Smith-Martinez, L., Lambert, K., Gangwani, M. K., Easler, J. J., & Adler, D. G. (2023) · iGIE · doi:10.1016/j.igie.2023.10.001 · Cited by 15 · cited 5×
“34,50,58,60,73 .”
InfluentialUtility of GPT-4 as an Informational Patient Resource in Otolaryngology
Suresh, K., Rathi, V., Nwosu, O., Partain, M. P., Glicksman, J. T., Jowett, N., & Crowson, M. G. (2023) · doi:10.1101/2023.05.14.23289944 · Cited by 11
Oniani, D., Sreekumar, S., DeAlmeida, R., DeAlmeida, D., Hui, V. C. C., Lee, Y. J., Zhang, Y., Zhou, L., & Wang, Y. (2022) · PubMed Central · doi:10.48550/arxiv.2209.06723 · Cited by 10
Huang, S. S., Song, Q., Beiting, K. J., Duggan, M. C., Hines, K., Murff, H. J., Leung, V., Powers, J. S., Harvey, T. S., Malin, B., et al. (2023) · medRxiv · doi:10.1101/2023.09.04.23294917 · Cited by 9
Dorfner, F. J., Dada, A., Busch, F., Makowski, M. R., Han, T., Truhn, D., Kleesiek, J., Sushil, M., Lammert, J., Adams, L. C., et al. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2408.13833 · Cited by 9
Self-citationFact Check: Assessing the Response of ChatGPT to Alzheimer's Disease Myths
Huang, S. S., Song, Q., Beiting, K. J., Duggan, M. C., Hines, K., Murff, H., Leung, V., Powers, J., Harvey, T. S., Malin, B., et al. (2024) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2024.105178 · Cited by 9
On the Fairness ROAD: Robust Optimization for Adversarial DebiasingPreprint
Grari, V., Laugel, T., Hashimoto, T., Lamprier, S., & Detyniecki, M. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.18413 · Cited by 6
Increasing Women’s Knowledge about HPV Using BERT Text Summarization: An Online Randomized Study
Bitar, H., Babour, A., Nafa, F., Alzamzami, O., & Alismail, S. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19138100 · Cited by 5
Can ChatGPT be Your Personal Medical Assistant?
Biswas, M. R., Islam, A., Shah, Z., Zaghouani, W., & Belhouari, S. B. (2023) · International Conference on Social Networks Analysis, Management and Security (SNAMS) · doi:10.1109/snams60348.2023.10375477 · Cited by 5
Eromosele, O. '. B., Sobodu, T., Olayinka, O., & Ouyang, D. (2023) · medRxiv · doi:10.1101/2023.09.20.23295874 · Cited by 3
Use of ChatGPT in Pediatric Urology and its Relevance in Clinical Practice: Is it useful?Preprint
Braga, A. V. N. M., Nunes, N. C., Santos, E. N., Veiga, M. L., Braga, A. A. N. M., de Abreu, G. E., de Bessa, J., Braga, L. H., Kirsch, A. J., & Barroso, U. (2023) · medRxiv · doi:10.1101/2023.09.11.23295266 · Cited by 2
Chandra, A., Davis, M. J., Hamann, D. J., & Hamann, C. R. (2023) · Dermatitis · doi:10.1089/derm.2023.0059 · Cited by 2
OpenAI, Achiam, J., Adler, S., Agarwal, S., Ahmad, L., Akkaya, I., Aleman, F. L., Almeida, D., Altenschmidt, J., Altman, S., et al. (2023) · arXiv · doi:10.48550/arxiv.2303.08774
An Empirical Study of the Non-determinism of ChatGPT in Code Generation
Ouyang, S., Zhang, J. M., Harman, M., & Wang, M. (2023) · arXiv · doi:10.48550/arxiv.2308.02828
Cited by
A systematic review of large language model (LLM) evaluations in clinical medicine
Shool, S., Adimi, S., Saboori Amleshi, R., Bitaraf, E., Golpira, R., & Tara, M. (2025) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-025-02954-4 · Cited by 346
Large Language Models in Healthcare and Medical Applications: A Review
Maity, S., & Saikia, M. J. (2025) · Bioengineering · doi:10.3390/bioengineering12060631 · Cited by 249
“These findings highlight the importance of incorporating healthcare provider perspectives in the evaluation and implementation of LLMs in clinical settings [6,10].”
InfluentialLarge Language Models lack essential metacognition for reliable medical reasoning
Griot, M., Hemptinne, C., Vanderdonckt, J., & Yuksel, D. (2025) · Nature Communications · doi:10.1038/s41467-024-55628-6 · Cited by 172
Guo, S., Liu, D., Fang, X., Meng, Y. G., Zhou, Z.-Z., Li, J., Li, M., Luo, L. Q., Li, H.-L., Cai, X.-Y., et al. (2025) · International Journal of Surgery · doi:10.1097/js9.0000000000003668 · Cited by 164
ChatGPT Health performance in a structured test of triage recommendations
Ramaswamy, A., Tyagi, A., Hugo, H., Jiang, J. J., Jayaraman, P., Jangda, M., Te, A. E., Kaplan, S. A., Lampert, J. M., Freeman, R., et al. (2026) · Nature Medicine · doi:10.1038/s41591-026-04297-7 · Cited by 153
Metadata
- Authors
- Busch, F., Hoffmann, L., Rueger, C., van Dijk, E. H., Kader, R., Ortiz-Prado, E., Makowski, M. R., Saba, L., Hadamitzky, M., Kather, J. N., Truhn, D., Cuocolo, R., Adams, L. C., & Bressem, K. K.
- Affiliations
- TUM Klinikum (DE)
- Humboldt-Universität zu Berlin (DE)
- Leiden University Medical Center (NL)
- University College London (GB)
- Azienda Ospedaliero-Universitaria Cagliari (IT)
- Deutsches Herzzentrum München (DE)
- Heidelberg University (DE)
- Universitätsklinikum Aachen (DE)
- University of Salerno (IT)
- Corresponding author
- Busch, Felix
- ORCID
- Venue
- Communications Medicine
- Published
- 2025-01-21
- Volume
- 5
- Issue
- 1
- Pages
- 26-26
- ISSN
- 2730-664X (ISSN-L)
- PMC
- PMC11751060
- OpenAlex
- W4406658975
- Cited by
- 358
- References
- 142
- Citations by year
- 2026: 226 · 2025: 123
- FWCI
- 20.62
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Communications Medicine (publishedVersion, cc-by)
- medRxiv (acceptedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Leiden Repository (Leiden University) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- UNICA IRIS Institutional Research Information System (University of Cagliari) (submittedVersion, other-oa)
- mediaTUM (Technical University of Munich) (submittedVersion)
- RWTH Publications (RWTH Aachen) (submittedVersion, other-oa)
- Funders
- European Commission (101079894)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- large language models, patient care, GPT-3.5, GPT-4, patient education, medical question answering, medical text summarization, medical translation, clinical documentation, LLM limitations, algorithmic bias, reproducibility, data transparency, patient empowerment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.