Retrieval-Augmented Generation (RAG) in Healthcare: A Comprehensive Review
Open accessPublished version of a preprint
The DOI matches its Crossref record; 81 of the 81 references it cites were found in a registry or an index; 24 of the 47 sources its claims cite were checked for support.
Abstract
Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by integrating external knowledge retrieval to improve factual consistency and reduce hallucinations. Despite growing interest, its use in healthcare remains fragmented. This paper presents a Systematic Literature Review (SLR) following PRISMA guidelines, synthesizing 30 peer-reviewed studies on RAG in clinical domains, focusing on three of its most prevalent and promising applications in diagnostic support, electronic health record (EHR) summarization, and medical question answering. Persistent challenges are identified, including retrieval noise, domain shift, generation latency, and limited explainability.
Overview
CoChat Summary
TL;DR
This systematic review synthesizes 30 peer-reviewed studies on retrieval-augmented generation (RAG) in healthcare, focusing on diagnostic support, EHR summarization, and medical question answering. It argues that RAG improves factual grounding and interpretability, but healthcare deployment is still limited by retrieval noise, latency, explainability, privacy, and drift.
Key findings
- The review synthesized 30 peer-reviewed studies and organized them into healthcare use cases including diagnostic support, EHR summarization, medical question answering, chatbots, and specialty-specific systems.
- It identifies persistent challenges in healthcare RAG as retrieval noise, domain shift, generation latency, and limited explainability; later sections also add privacy, multimodal limitations, infrastructure constraints, knowledge drift, bias/fairness, and lack of human oversight.
- The paper highlights clinical evaluation metrics that are more suitable than generic NLP metrics, naming FactScore, RadGraph-F1, and MED-F1 as especially important for factual accuracy, medical validity, and clinical relevance.
- The authors conclude that Advanced RAG appears “most ready for pilot clinical use,” while Modular RAG has long-term potential but is harder to deploy because of higher complexity and computational cost.
Methods
- Systematic literature review following PRISMA 2020 guidelines, prospectively registered in OSF.
- Searched PubMed, IEEE Xplore, Scopus, Web of Science, Google Scholar, and ACM Digital Library for publications from 2022 to 2025 using RAG/healthcare/LLM-related search terms.
- Screening flow: 123 records identified, 46 duplicates removed, 77 screened by title/abstract, 47 excluded, and 30 full-text studies included.
- Studies were classified using a taxonomy of RAG applications and compared across architectural variants, applications, metrics, and challenges.
Limitations
- The paper states that the evolving terminology around RAG may have led to exclusion of some studies.
- It states the review relied solely on reported findings rather than raw experimental data and was constrained by a narrow publication window, which may limit completeness and generalizability.
- Evident from the text: the synthesis depends on English-language, peer-reviewed or high-quality preprint sources only, which the paper itself identifies as a source of selection bias.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
20 Valid · 25 Not valid · 23 Not checked · 119 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“However, these models required structured inputs and extensive manual feature engineering to extract meaningful signals from clinical text [13].”
What the sources say
- Partly supportedcites [13] Spasic, 2020, Clinical text data in machine learning: Systematic review, JMIR Med. Inform. sourceExperimental — accuracy not yet measured
The Results (Availability; page not provided) say that most reviewed studies relied on manual annotation of clinical text, and the Discussion identifies annotation as a key bottleneck. Manual annotation is not the same as manual feature engineering, however, and the review does not say that machine-learning models required structured inputs. (LLM, conf=0.83)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Introduced in 2020, Retrieval-Augmented Generation (RAG) mitigates these limitations by combining a retriever which accesses external sources such as clinical guidelines or EHRs with a generator that conditions responses on both the query and retrieved content [8].”
What the sources say
- Partly supportedcites [8] Lewis, 2020, Retrieval-augmented generation for knowledge-intensive nlp tasks, Adv. Neural Inf. Process. Syst. sourceExperimental — accuracy not yet measured
The Introduction (p. 2) and Methods (p. 2) describe a retriever that obtains documents and a generator conditioned on both the input and those documents; the Discussion (p. 9) reports benefits over a purely parametric model. The paper’s experiments use Wikipedia as the knowledge source (Experiments, p. 4), not clinical guidelines or EHRs, so the cited paper does not support those examples. (LLM, conf=0.86)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“While interest in RAG continues to grow, most prior work has focused either on architectural innovations [10] or on isolated components such as retriever and generator design [11].”
What the sources say
- Partly supportedcites [10] Gao, Y., Xiong, Y., Gao, X., Jia, K., Pan, J., Bi, Y., Dai, Y., Sun, J., Wang, H., and Wang, H. (2023). Retrieval-augmented generation for large language models: A survey. arXiv. sourceExperimental — accuracy not yet measured
The Introduction describes Retrieval and Generation as core components studied in the survey, and the Modular RAG section gives examples of refining retrievers and fine-tuning generators. But the paper also discusses interactions between modules; these passages do not establish that most prior work studied the components in isolation. The architectural-innovations clause is attached to a different citation and is not judged here. (LLM, conf=0.82)
- Partly supportedcites [11] Zhao, P., Zhang, H., Yu, Q., Wang, Z., Geng, Y., Fu, F., Yang, L., Zhang, W., Jiang, J., and Cui, B. (2024). Retrieval-Augmented Generation for AI-Generated Content: A Survey. arXiv. sourceExperimental — accuracy not yet measured
The Background (p. 1) says prior RAG enhancements include optimizations of individual components, and the Preliminary section (p. 3) discusses retrievers and generators. But the Background also describes holistic pipeline enhancements; the paper does not establish that most prior work focused on isolated components. The architectural-innovations clause is attached to a different citation and is not assessed here. (LLM, conf=0.84)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“medical domain-specific LLMs such as Medical Pathways Language Model (Med-PaLM) [2] and Biomedical Generative Pretrained Transformer (BioGPT) [3] have shown improved performance across various clinical natural language processing (NLP) tasks, including question answering, summarization, entity recognition, relation extraction, document classification, and literature mining.”
What the sources say
- Partly supportedcites [2] Singhal, 2025, Toward expert-level medical question answering with large language models, Nat. Med. sourceExperimental — accuracy not yet measured
The Abstract (page unavailable) reports improved Med-PaLM 2 performance on medical question-answering benchmarks, supporting the question-answering part of the claim. The cited paper does not establish improved Med-PaLM performance on the other listed tasks—summarization, entity recognition, relation extraction, document classification, or literature mining. BioGPT has a separate citation in the citing sentence and is not assessed here. (LLM, conf=0.86)
- Partly supportedcites [3] Luo, R., Sun, L., Xia, Y., Qin, T., Zhang, S., Poon, H., and Liu, T.Y. (2022). BioGPT: Generative pre-trained transformer for biomedical text generation and mining. Briefings Bioinform., 23. sourceExperimental — accuracy not yet measured
The Introduction (p. 1) identifies BioGPT as a domain-specific model and reports better performance on biomedical question answering, relation extraction, document classification, and text generation. The Experiments section (p. 4) lists those evaluated tasks, but not summarization or entity recognition; its biomedical-literature evaluations also do not establish improved performance across clinical NLP tasks generally. This verdict concerns BioGPT, not Med-PaLM, which has a separate citation. (LLM, conf=0.88)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Variants of Bidirectional Encoder Representations from Transformers (BERT) [5], such as Biomedical BERT (BioBERT) [6] and ClinicalBERT [7], improve the contextual understanding of medical terminology.”
What the sources say
- Not checked — no full text of the sourcecites [5] Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2019, January 2–7). Bert: Pre-training of deep bidirectional transformers for language understanding. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Minneapolis, MN, USA. source
- Supportedcites [6] Lee, 2020, BioBERT: A pre-trained biomedical language representation model for biomedical text mining, Bioinformatics source
The Introduction describes BioBERT as an adaptation of BERT to biomedical language, where specialized terms make general-domain models less effective. The Conclusion reports that BioBERT outperforms previous models on biomedical text-mining tasks. Citation [6] is attached to BioBERT; the separate ClinicalBERT citation [7] is not a claim this source needs to support. (LLM, conf=0.90)
- Supportedcites [7] Huang, K., Altosaar, J., and Ranganath, R. (2019). ClinicalBert: Modeling Clinical Notes and Predicting Hospital Readmission. arXiv. source
Our copy identifies ClinicalBERT as a BERT variant specialized to clinical notes ('ClinicalBERT is bert [11] specialized to clinical notes', 1.2 Significance, p. 2; Abstract, p. 1) and shows it improves contextual understanding of clinical/medical terminology: it outperforms bert on clinical language modeling (Table 1, p. 3), and its contextual embeddings correlate with physician-rated similarity of medical concepts (0.670 vs 0.553 Word2Vec and 0.487 FastText, Table 2, p. 4; §3.2.2, p. 4 'ClinicalBERT captures some clinical semantics'). The Background (p. 1) also motivates contextual BERT representations as needed to capture clinical meaning that local-context models miss. BioBERT itself is not discussed in this paper, but that element of the sentence carries its own separate citation ([6]), so it is not part of what is attributed here. (LLM, conf=0.85)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
36 more claims · 2 with their cited sources checked
Create a free account to see all 187 claims and to verify the 13 references still open.
- It may state two separate claims as one. 85
- Probably not a substantial claim. 119
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“RAG-based knowledge grounding in all three agents reduces hallucination rates and supports factual reliability claims that would be required in device submissions (Neha et al., 2025).”
From A generative AI multi-agent framework with integrated XAI governance for cancer diagnostics: from multi-omics interpretation to lifestyle risk stratification (2026) · cites this paper as Neha et al., 2025
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The LLM component, grounded in clinical epidemiology databases through RAG, provides causal annotation for each SHAP-ranked factor, distinguishing established causal risk factors from confounded associations and calibrating recommendation strength accordingly (Neha et al., 2025).”
From A generative AI multi-agent framework with integrated XAI governance for cancer diagnostics: from multi-omics interpretation to lifestyle risk stratification (2026) · cites this paper as Neha et al., 2025
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“It has been observed that LLMs are effective zero-shot or one-shot clinical information extractors.6”
From A Scalable Method for Validated Data Extraction from Electronic Health Records with Large Language Models (2025) · cites this paper as [6]
Experimental — accuracy not yet measured
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
BioBERT: a pre-trained biomedical language representation model for biomedical text mining
Lee, J., Yoon, W., Kim, S., Kim, D., Kim, S., So, C. H., & Kang, J. (2020) · Bioinformatics · doi:10.1093/bioinformatics/btz682 · Cited by 7,218 · cited 1×
“Variants of Bidirectional Encoder Representations from Transformers (BERT) [5], such as Biomedical BERT (BioBERT) [6] and ClinicalBERT [7], improve the contextual understanding of medical terminology.”
Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) Network
Sherstinsky, A. (2020) · Physica D: Nonlinear Phenomena · doi:10.1016/j.physd.2019.132306 · Cited by 5,680 · cited 1×
“Deep learning further advanced the field by enabling end-to-end processing of unstructured data, with early implementations using recurrent neural networks (RNNs) and Long Short-Term Memory (LSTM) networks [14].”
Dense passage retrieval for open-domain question answering
Karpukhin, V., Oguz, B., Min, S., Lewis, P., Wu, L., Edunov, S., Chen, D., & Yih, W.-T. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.550 · Cited by 3,575 · cited 1×
“Popular dense retrievers include dense passage retrieval (DPR) [21].”
MIMIC-IV, a freely accessible electronic health record dataset
Johnson, A. E. W., Bulgarelli, L., Shen, L., Gayles, A., Shammout, A., Horng, S., Pollard, T. J., Hao, S., Moody, B., Gow, B., et al. (2023) · Scientific Data · doi:10.1038/s41597-022-01899-x · Cited by 3,401 · cited 2×
“When pretrained on large-scale biomedical corpora such as the medical information mart for intensive care (MIMIC)-III clinical data [17] or medical literature, LLMs acquire domain-specific language understanding.”
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
Lewis, P., Perez, E., Piktus, A., Petroni, F., Karpukhin, V., Goyal, N., Küttler, H., Lewis, M., Yih, W.-T., Rocktäschel, T., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.11401 · Cited by 3,101 · cited 1×
“Introduced in 2020, Retrieval-Augmented Generation (RAG) mitigates these limitations by combining a retriever which accesses external sources such as clinical guidelines or EHRs with a generator that conditions responses on both the query and retrieved content [8].”
Domain-specific language model pretraining for biomedical natural language processing
Gu, Y., Tinn, R., Cheng, H., Lucas, M., Usuyama, N., Liu, X., Naumann, T., Gao, J., & Poon, H. (2022) · ACM Transactions on Computing for Healthcare · doi:10.1145/3458754 · Cited by 2,170 · cited 1×
“These systems use biomedical embeddings (e.g., BioBERT, PubMedBERT [30]), specialized corpora (e.g., PubMed abstracts and clinical notes), and domain-specific knowledge bases (e.g., unified medical language system (UMLS), MIMIC).”
Toward expert-level medical question answering with large language models
Singhal, K., Tu, T., Gottweis, J., Sayres, R., Wulczyn, E., Amin, M., Hou, L., Clark, K., Pfohl, S. R., Cole-Lewis, H., et al. (2025) · Nature Medicine · doi:10.1038/s41591-024-03423-7 · Cited by 1,734 · cited 1×
“To address these challenges, medical domain-specific LLMs such as Medical Path-ways Language Model (Med-PaLM) [2] and Biomedical Generative Pretrained Transformer (BioGPT) [3] have shown improved performance across various clinical natural language processing (NLP) tasks, including question…”
BioGPT: generative pre-trained transformer for biomedical text generation and mining
Luo, R., Sun, L., Xia, Y., Qin, T., Zhang, S., Poon, H., & Liu, T.-Y. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbac409 · Cited by 1,150
Retrieval-Augmented Generation for Large Language Models: A Survey
Gao, Y., Xiong, Y., Gao, X., Jia, K., Pan, J., Bi, Y., Dai, Y., Sun, J., Wang, M., & Wang, H. (2023) · arXiv · doi:10.48550/arxiv.2312.10997 · Cited by 876
Jin, D., Pan, E., Oufattole, N., Weng, W.-H., Fang, H., & Szolovits, P. (2021) · doi:10.20944/preprints202105.0498.v1 · Cited by 718 · cited 1×
“The following datasets are widely utilized for evaluating RAG systems in health-care contexts: • MedQA (USMLE): A multiple-choice question dataset derived from medical licensing exams, focused on clinical knowledge assessment [71].”
Jin, D., Pan, E., Oufattole, N., Weng, W.-H., Fang, H., & Szolovits, P. (2021) · Applied Sciences · doi:10.3390/app11146421 · Cited by 718
PubMedQA: A Dataset for Biomedical Research Question AnsweringPreprint
Jin, Q., Dhingra, B., Liu, Z., Cohen, W. W., & Lu, X. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.06146 · Cited by 714
PubMedQA: A Dataset for Biomedical Research Question Answering
Jin, Q., Dhingra, B., Liu, Z., Cohen, W., & Lu, X. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1259 · Cited by 685 · cited 1×
“• PubMedQA: Consists of biomedical abstracts paired with yes/no/maybe questions, requiring grounded reasoning and evidence-based answers [72].”
ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readmission
Huang, K., Altosaar, J., & Ranganath, R. (2019) · arXiv · doi:10.48550/arxiv.1904.05342 · Cited by 618 · cited 1×
“Variants of Bidirectional Encoder Representations from Transformers (BERT) [5], such as Biomedical BERT (BioBERT) [6] and ClinicalBERT [7], improve the contextual understanding of medical terminology.”
A framework to assess clinical safety and hallucination rates of LLMs for medical text summarisation
Asgari, E., Montaña-Brown, N., Dubois, M., Khalil, S., Balloch, J., Yeung, J. A., & Pimenta, D. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01670-7 · Cited by 423 · cited 1×
“By anchoring answers in peer-reviewed literature or structured medical knowledge, these systems reduce the hallucinations often seen in standalone LLMs [64].”
FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation
Min, S., Krishna, K., Lyu, X., Lewis, M., Yih, W.-T., Koh, P., Iyyer, M., Zettlemoyer, L., & Hajishirzi, H. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.741 · Cited by 407
CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparison
Irvin, J., Rajpurkar, P., Ko, M., Yu, Y., Ciurea-Ilcus, S., Chute, C., Marklund, H., Haghgoo, B., Ball, R., Shpanskaya, K., et al. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.3301590 · Cited by 392 · cited 1×
“• MED-F1 quantifies the alignment of extracted entities with standard clinical terminology and is frequently applied to tasks like medical named entity recognition, particularly in datasets such as CheXpert [70].”
Improving language models by retrieving from trillions of tokens
Borgeaud, S., Mensch, A., Hoffmann, J., Cai, T., Rutherford, E., Millican, K., Driessche, G. V. D., Lespiau, J.-B., Damoc, B., Clark, A., et al. (2021) · arXiv · doi:10.48550/arxiv.2112.04426 · Cited by 382 · cited 1×
“Foundational architectures, including REALM [24], Atlas [25], and RETRO [26], fall into this category.”
Clinical text data in machine learning: systematic review
Spasic, I., & Nenadic, G. (2020) · JMIR Medical Informatics · doi:10.2196/17984 · Cited by 358 · cited 1×
“However, these models required structured inputs and extensive manual feature engineering to extract meaningful signals from clinical text [13].”
Towards Expert-Level Medical Question Answering with Large Language Models
Singhal, K., Tu, T., Gottweis, J., Sayres, R., Wulczyn, E., Hou, L., Clark, K., Pfohl, S., Cole-Lewis, H., Neal, D., et al. (2023) · arXiv · doi:10.48550/arxiv.2305.09617 · Cited by 338
Document clustering: TF-IDF approach
Bafna, P., Pramod, D., & Vaidya, A. (2016) · 2016 International Conference on Electrical, Electronics, and Optimization Techniques (ICEEOT) · doi:10.1109/iceeot.2016.7754750 · Cited by 290 · cited 1×
“Common methods include Term Frequency-Inverse Document Frequency (TF-IDF) [19] and BM25 [20].”
Retrieval-Augmented Generation for AI-Generated Content: A Survey
Zhao, P., Zhang, H., Yu, Q., Wang, Z., Geng, Y., Fu, F., Yang, L., Zhang, W., Jiang, J., & Cui, B. (2024) · arXiv · doi:10.48550/arxiv.2402.19473 · Cited by 240 · cited 1×
“While interest in RAG continues to grow, most prior work has focused either on architectural innovations [10] or on isolated components such as retriever and generator design [11].”
Atlas: Few-shot Learning with Retrieval Augmented Language Models
Izacard, G., Lewis, P., Lomeli, M., Hosseini, L., Petroni, F., Schick, T., Dwivedi-Yu, J., Joulin, A., Riedel, S., & Grave, E. (2022) · arXiv · doi:10.48550/arxiv.2208.03299 · Cited by 213 · cited 1×
“Foundational architectures, including REALM [24], Atlas [25], and RETRO [26], fall into this category.”
Ge, J., Sun, S., Owens, J., Galvez, V., Gologorskaya, O., Lai, J. C., Pletcher, M. J., & Lai, K. (2024) · Hepatology · doi:10.1097/hep.0000000000000834 · Cited by 178 · cited 1×
“Ge et al. developed a liver disease-specific LLM using RAG within a Protected Health Information (PHI)-compliant system [50].”
Miao, J., Thongprayoon, C., Suppadungsuk, S., Garcia Valencia, O. A., & Cheungpasitporn, W. (2024) · Medicina · doi:10.3390/medicina60030445 · Cited by 164 · cited 1×
“Miao et al. explores integrating RAG with LLMs to improve accuracy in nephrology [49].”
From local to global: a graph rag approach to query-focused summarization
Edge, D., Trinh, H., Cheng, N., Bradley, J., Chao, A., Mody, A., Truitt, S., Metropolitansky, D., Ness, R. O., & Larson, J. (2024) · arXiv · doi:10.48550/arxiv.2404.16130 · Cited by 159
Alkhalaf, M., Yu, P., Yin, M., & Deng, C. (2024) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2024.104662 · Cited by 156 · cited 1×
“RAG supports clinical summarization by integrating longitudinal patient data [63].”
Zhao, X., Liu, S., Yang, S.-Y., & Miao, C. (2025) · Proceedings of the ACM on Web Conference 2025 · doi:10.1145/3696410.3714782 · Cited by 116 · cited 1×
“Models such as MedRAG [27], BioRAG [28], and ClinicalGPT [29] exemplify this approach.”
Ng, K. K. Y., Matsuba, I., & Zhang, P. C. (2025) · NEJM AI · doi:10.1056/aira2400380 · Cited by 107 · cited 1×
“…of condition-specific guidelines), domain shift (e.g., mismatched terminology between EHRs and biomedical literature), inference latency (e.g., delays in generating responses during emergencies), and limited interpretability (e.g., unclear how retrieved text shapes treatment suggestions) [9].”
Zhu, Y., Ren, C., Xie, S., Liu, S., Ji, H., Wang, Z., Sun, T., He, L., Li, Z., Zhu, X., et al. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.07016 · Cited by 98
Kotei, E., & Thirunavukarasu, R. (2023) · Information · doi:10.3390/info14030187 · Cited by 89 · cited 1×
“LLMs are built on transformer architectures and pretrained using self-supervised objectives such as masked language modeling (MLM) or causal language modeling (CLM) [16].”
Chow, J. C. L., & Li, K. (2025) · Information · doi:10.3390/info16070549 · Cited by 84
Wu, J., Zhu, J., Qi, Y., Chen, J., Xu, M., Menolascina, F., Jin, Y., & Grau, V. (2025) · Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2025.acl-long.1381 · Cited by 79
Han, B., Susnjak, T., & Mathrani, A. (2024) · Applied Sciences · doi:10.3390/app14199103 · Cited by 68 · cited 1×
“RAG facilitates dynamic literature review by retrieving and summarizing recent, domain-relevant publications in response to specific clinical or research queries [67].”
RadioRAG: Online Retrieval–Augmented Generation for Radiology Question Answering
Arasteh, S. T., Lotfinia, M., Bressem, K. K., Siepmann, R. M., Adams, L. C., Ferber, D., Kuhl, C. K., Kather, J. N., Nebelung, S., & Truhn, D. (2025) · Radiology Artificial Intelligence · doi:10.1148/ryai.240476 · Cited by 68 · cited 1×
“Arasteh et al. propose a RAG system for radiology QA that retrieves context from Radiopaedia [61].”
RadGraph: Extracting Clinical Entities and Relations from Radiology Reports
Jain, S., Agrawal, A., Saporta, A., Truong, S. Q., Duong, D. N., Bui, T., Chambon, P., Zhang, Y., Lungren, M. P., Ng, A. Y., et al. (2021) · arXiv · doi:10.48550/arxiv.2106.14463 · Cited by 66
ClinicalT5: A Generative Language Model for Clinical Text
Lu, Q., Dou, D., & Nguyen, T. (2022) · Findings of the Association for Computational Linguistics: EMNLP 2022 · doi:10.18653/v1/2022.findings-emnlp.398 · Cited by 64
Cheng, S., Wen, J., Kang, J., Wang, Y., Su, Y., Pan, H., Zhong, Z., & Hossain, M. S. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3521425 · Cited by 63 · cited 1×
“Su et al. propose a Hybrid RAG-based Multimodal LLM framework for secure IoMT data management, integrating RAG with a diffusion-based smart contract for explainable and trustworthy retrieval [59].”
ClinicalGPT: Large Language Models Finetuned with Diverse Medical Data and Comprehensive Evaluation
Wang, G., Yang, G., Du, Z., Fan, L., & Li, X. (2023) · arXiv · doi:10.48550/arxiv.2306.09968 · Cited by 53
Conversational health agents: a personalized large language model-powered agent framework
Abbasian, M., Azimi, I., Rahmani, A. M., & Jain, R. (2025) · JAMIA Open · doi:10.1093/jamiaopen/ooaf067 · Cited by 52
Upadhyay, R., & Viviani, M. (2025) · Discover Computing · doi:10.1007/s10791-025-09505-5 · Cited by 49 · cited 1×
“…et al. introduce a three-stage RAG-based model for health information retrieval that integrates PubMed-based passage extraction, LLM-generated text (GenText), and a dual scoring mechanism based on topical relevance (BM25) and factual accuracy (via stance detection and semantic similarity) [32].”
Neha, F., & Bhati, D. (2025) · International Conference on Soft Computing & Machine Intelligence (ISCMI) · doi:10.1109/iscmi67495.2025.11358595 · Cited by 49
Self-citationShi, W., Zhuang, Y., Zhu, Y., Iwinski, H., Wattenbarger, M., & Wang, M. D. (2023) · Proceedings of the 14th ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics · doi:10.1145/3584371.3612956 · Cited by 47 · cited 1×
“…LLM for shared decision-making in adolescent idiopathic scoliosis (AIS), combining ChatGPT with a structured AIS-specific knowledge base and dense retrieval using MPNet (Masked and Permuted Pretraining for Language Understanding) to enhance response accuracy, relevance, and transparency [58].”
Long, C., Subburam, D., Lowe, K., dos Santos, A., Zhang, J., Hwang, S., Saduka, N., Horev, Y., Su, T., Côté, D. W. J., et al. (2024) · Otolaryngology–Head and Neck Surgery · doi:10.1002/ohn.864 · Cited by 46
Ziletti, A., & D'Ambrosi, L. (2024) · Clinical Natural Language Processing Workshop (ClinicalNLP) · doi:10.18653/v1/2024.clinicalnlp-1.4 · Cited by 41
Rui-yu, X., Hong, Y., Zhang, F., & Xu, H. (2024) · Scientific Reports · doi:10.1038/s41598-024-81052-3 · Cited by 39 · cited 1×
“Xu et al. evaluate a RAG-enhanced GPT system for breast cancer nursing care, showing improved response accuracy and nurse satisfaction compared to direct GPT outputs, while maintaining an empathetic tone [35].”
Large Language Models with Retrieval-Augmented Generation for Zero-Shot Disease PhenotypingPreprint
Thompson, W. E., Vidmar, D., Freitas, J. K. D., Pfeifer, J. M., Fornwalt, B. K., Chen, R., Altay, G., Manghnani, K., Nelsen, A. C., Morland, K., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2312.06457 · Cited by 39
Amati, G. (2009) · Encyclopedia of Database Systems · doi:10.1007/978-0-387-39940-9_921 · Cited by 30
Neha, F., & Bhati, D. (2025) · doi:10.36227/techrxiv.173896582.25938392/v1 · Cited by 29
Self-citationNayinzira, J. P., & Adda, M. (2024) · Procedia Computer Science · doi:10.1016/j.procs.2024.11.118 · Cited by 27 · cited 1×
“Nayinzira et al. introduce a mental health chatbot combining RAG and sentiment analysis [47].”
Improving the RAG-based Personalized Discharge Care System by Introducing the Memory Mechanism
Yang, Y., Xu, C., Guo, J., Feng, T., & Ruan, C. (2025) · International Conference on Computer Research and Development · doi:10.1109/iccrd64588.2025.10963086 · Cited by 26 · cited 1×
“Yang et al. propose a lightweight RAG-based personalized discharge care system enhanced with a memory mechanism to support neurological patients post-hospitalization [33].”
MedPlan: A Two-Stage RAG-Based System for Personalized Medical Plan GenerationPreprint
Hsu, H.-L., Dao, C.-T., Wang, L., Shuai, Z., Phan, T. N. M., Ding, J.-E., Liao, C.-C., Hu, P., Han, X., Hsu, C.-H., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.17900 · Cited by 26
Hamane, Z., Ben-Bouazza, F.-E., & Fennan, A. (2024) · International Conference on Intelligent Systems and Computer Vision (ISCV) · doi:10.1109/iscv60512.2024.10620139 · Cited by 22 · cited 1×
“Hammane et al. introduce a medical reasoning framework that enhances RAG with a self-evaluation mechanism to improve answer accuracy and clinical trustworthiness [34].”
A Retrieval-augmented Generation application for Question-Answering in Nutrigenetics Domain
Benfenati, D., Filippis, G. M. D., Rinaldi, A. M., Russo, C., & Tommasino, C. (2024) · Procedia Computer Science · doi:10.1016/j.procs.2024.09.467 · Cited by 21 · cited 1×
“Benfenati et al. propose a RAG-based question-answering (QA) framework for nu-trigenetics that combines general-purpose text embeddings, a vector database, and LLMs to enhance answer relevance without requiring model retraining [39].”
Retrieval-Augmented Generation: Advancing personalized care and research in oncology
Zarfati, M., Soffer, S., Nadkarni, G. N., & Klang, E. (2025) · European Journal of Cancer · doi:10.1016/j.ejca.2025.115341 · Cited by 20 · cited 1×
“RAG enables precise clinical trial matching by aligning patient profiles with the eligibility criteria extracted from trial registries [66].”
Shin, M., Song, J., Kim, M.-G., Yu, H. W., Choe, E. K., & Chai, Y. J. (2025) · Journal of Clinical Medicine · doi:10.3390/jcm14072450 · Cited by 20 · cited 1×
“Shin et al. present a RAG-based chatbot for thyroid disease management that integrates ChatGPT-4o with a vector database built from guidelines and textbooks [48].”
Sree, Y. B., Sathvik, A., Akshit, D. S. H., Kumar, O. N. V. P. B., & Rao, B. S. P. (2024) · International Conference on Electrical, Control and Instrumentation Engineering (ICECIE) · doi:10.1109/icecie63774.2024.10815693 · Cited by 19 · cited 1×
“Sree et al. introduce a RAG-based LLM chatbot for physical and mental healthcare, integrating external data sources to enhance diagnostic support and personalization [45].”
Chen, R., Zhang, S., Zheng, Y., Yu, Q., & Wang, C. (2025) · Frontiers in Medicine · doi:10.3389/fmed.2025.1599241 · Cited by 16 · cited 1×
“Chen et al. introduce a clinical decision-support system for chronic low back pain that combines LLMs, RAG, and least-to-most prompting [53].”
BioRAG: A RAG-LLM Framework for Biological Question Reasoning
Wang, C., Long, Q., Xiao, M., Cai, X., Wu, C., Meng, Z., Wang, X., & Zhou, Y. (2024) · arXiv · doi:10.48550/arxiv.2408.01107 · Cited by 16 · cited 1×
“Models such as MedRAG [27], BioRAG [28], and ClinicalGPT [29] exemplify this approach.”
Enhancing Healthcare Accessibility: A RAG- Based Medical Chatbot Using Transformer Models
Kulshreshtha, A., Choudhary, A. V., Taneja, T., & Verma, S. (2025) · International Conference on IT Innovation and Knowledge Discovery (ITIKD) · doi:10.1109/itikd63574.2025.11005179 · Cited by 15 · cited 1×
“Kulshreshtha et al. propose a RAG-based medical chatbot using standalone LLMs (LLaMa, LangChain, and BERT) to improve healthcare accessibility [43].”
To Enhance Graph-Based Retrieval-Augmented Generation (RAG) with Robust Retrieval Techniques
Rani, M., Mishra, B. K., Thakker, D., & Khan, M. N. (2024) · International Conference on Open Source Systems and Technologies (ICOSST) · doi:10.1109/icosst64562.2024.10871140 · Cited by 14 · cited 1×
“Rani et al. propose a graph-based RAG framework for diabetes care, addressing hallucination, explainability, and source traceability in LLMs [54].”
FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation
Min, S., Krishna, K., Lyu, X., Lewis, M., Yih, W.-T., Koh, P. W., Iyyer, M., Zettlemoyer, L., & Hajishirzi, H. (2023) · arXiv · doi:10.48550/arxiv.2305.14251 · Cited by 14
A Framework to Assess Clinical Safety and Hallucination Rates of LLMs for Medical Text SummarisationPreprint
Asgari, E., Khalil, S., Montaña-Brown, N., et al. (2024) · medRxiv · doi:10.1101/2024.09.12.24313556 · Cited by 13
MedDialog: Two Large-scale Medical Dialogue Datasets
He, X., Chen, S., Ju, Z., Dong, X., Fang, H., Wang, S., Yang, Y., Zeng, J., Zhang, R., Zhang, R., et al. (2020) · arXiv · doi:10.48550/arxiv.2004.03329 · Cited by 12
Modular RAG: Transforming RAG Systems into LEGO-like Reconfigurable Frameworks
Gao, Y., Xiong, Y., Wang, M., & Wang, H. (2024) · arXiv · doi:10.48550/arxiv.2407.21059 · Cited by 12
Long, C., Subburam, D., Lowe, K., et al. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4571725 · Cited by 10
LLM-Therapist: A RAG-Based Multimodal Behavioral Therapist as Healthcare Assistant
Shafi, F. R., & Hossain, M. A. (2024) · Globecom · doi:10.1109/globecom52923.2024.10901139 · Cited by 9 · cited 1×
“Shafi et al. present LLM-Therapist, a multimodal healthcare assistant combining RAG and real-time function calling for personalized behavioral support [44].”
Leveraging Graph-RAG for Enhanced Diagnostic and Treatment Strategies in Dentistry
Sophaken, C., Vongpanich, K., Intaphan, W., Utasri, T., Deepho, C., & Takhom, A. (2024) · doi:10.1109/incit63192.2024.10810521 · Cited by 8 · cited 1×
“Sophaken et al. present a Graph-RAG pipeline for dentistry that integrates named entity recognition (NER), Resource Description Framework (RDF) triples, and RAG to support clinical decision-making [57].”
MedPlan: A Two-Stage RAG-Based System for Personalized Medical Plan Generation
Hsu, H.-L., Dao, C.-T., Wang, L., Shuai, Z., Phan, T. N. M., Ding, J.-E., Liao, C.-C., Hu, P., Han, X., Hsu, C.-H., et al. (2025) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2025.acl-industry.76 · Cited by 8
Papageorgiou, P. S., Christodoulou, R. C., Pitsillos, R., Petrou, V., Vamvouras, G., Kormentza, E. V., Papagelopoulos, P. J., & Georgiou, M. F. (2025) · Applied Sciences · doi:10.3390/app15169005 · Cited by 8
Less Context, Same Performance: A RAG Framework for Resource-Efficient LLM-Based Clinical NLPPreprint
Cheetirala, S. N., Raut, G., Patel, D. D., Sanatana, F., Freeman, R., Levin, M. A., Nadkarni, G. N., Dawkins, O., Miller, R., Steinhagen, R. M., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2505.20320 · Cited by 7
Developing a RAG Agent for Personalized Fitness and Dietary Guidance
Pyae, M. S., Phyo, S. S., Kyaw, S. T. M. M., Lin, T. S., & Chondamrongkul, N. (2025) · Joint International Conference on Digital Arts, Media and Technology with ECTI Northern Section Conference on Electrical, Electronics, Computer and Telecommunications Engineering (ECTI DAMT & NCON) · doi:10.1109/ectidamtncon64748.2025.10961967 · Cited by 5 · cited 1×
“Pyae et al. present a RAG-based system for personalized fitness and dietary guidance using wearable data and a curated knowledge base [41].”
Healthcare Diagnostic RAG-Based Chatbot Triage Enabled by BioMistral-7B
Sinha, K., Singh, V., Vishnoi, A., Madan, P., & Shukla, Y. (2024) · International Conference on Emerging Technologies and Innovation for Sustainability (EmergIN) · doi:10.1109/emergin63207.2024.10961136 · Cited by 5 · cited 1×
“Sinha et al. propose a RAG-based chatbot for medical triage that integrates LLMs with vector embeddings and a retrieval system to generate efficient, context-aware responses [46].”
GlaucoRAG: A Retrieval-Augmented Large Language Model for Expert-Level Glaucoma AssessmentPreprint
Aminan, M., Darnell, S. S., Delsoz, M., Nabavi, A., Wright, C., Jerkins, B. M., & Yousefi, S. (2025) · medRxiv · doi:10.1101/2025.07.03.25330805 · Cited by 5 · cited 1×
“5 and a custom retrieval-response framework for diagnostic support [37].”
Jabarulla, M. Y., Oeltze‐Jafra, S., Beerbaum, P., & Uden, T. (2025) · Proceedings - IEEE Symposium on Computer-Based Medical Systems · doi:10.1109/cbms65348.2025.00172 · Cited by 4 · cited 1×
“Jabarulla et al. present a blockchain-enabled RAG system for pediatric clinical decision support, combining semantic search over guideline PDFs with LLMs to generate responses, which clinicians evaluate and store via smart contracts on a permissioned blockchain [60].”
Wu, J., Zhu, J., Qi, Y., Chen, J., Xu, M., Menolascina, F., & Grau, V. (2024) · arXiv · doi:10.48550/arxiv.2408.04187
Improving the RAG-based Personalized Discharge Care System by Introducing the Memory Mechanism
Yang, Y., Xu, C., Guo, J., et al. (2024) · doi:10.20944/preprints202410.1696.v1
Research works printed but not linked: 3
- Gaur, M. (2022). Knowledge-Infused Learning. [Ph.D. Thesis, University of South Carolina].
- Kirubakaran, S.S., Kathrine, J.W.G., Kanaga, G.M., Raja, M.J., Singh, R.G., and Yuvaraajan, E. (2024, January 24–26). A RAG-based Medical Assistant Especially for Infectious Diseases. Proceedings of the 2024 International Conference on Inventive Computation Technologies (ICICT), Lalitpur, Nepal.
- Yu, H., Guo, P., and Sano, A. (2023, January 10). Zero-Shot ECG Diagnosis with Large Language Models and Retrieval-Augmented Generation. Proceedings of the 3rd Machine Learning for Health Symposium, PMLR, Orleans, LA, USA.
Cited by
Simou, E. (2025) · International Medical Education · doi:10.3390/ime4040050 · Cited by 35
“By retrieving verifiable evidence and displaying inline citations, RAG architectures further enhance epistemic trust and accountability, enabling learners to appraise the provenance, coherence, and ethical dimensions of AI-generated reasoning critically [159,160].”
InfluentialWołk, K. (2025) · Electronics · doi:10.3390/electronics14214227 · Cited by 27
“The system requires both retrieval and generation operations to finish within 2 s for clinical workflow integration [7].”
Stuhlmiller, T. J., Rabe, A., Rapp, J., Awawda, A., Kouser, H., Lui, K., Salamon, H., Chuyka, D., Mahoney, W., Furgason, J. M., et al. (2025) · medRxiv · doi:10.1101/2025.02.25.25322898 · Cited by 13
Gkousis, S., Vasilaki, V., & Katsou, E. (2025) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2025.116577 · Cited by 14
Saidu, F. A., & Wall, J. (2026) · Electronics · doi:10.3390/electronics15030555 · Cited by 9
“In line with the G7 AI Code of Conduct, which advocates continuous risk assessment and transparency, the study prioritised transparency in its methodologies and results [36,37].”
Metadata
- Authors
- Neha, F., Bhati, D., & Shukla, D. K.
- Affiliations
- Kent State University (US)
- Rutgers, The State University of New Jersey (US)
- Corresponding author
- Neha, Fnu
- Venue
- AI
- Publisher
- MDPI AG
- Published
- 2025-09-11
- Volume
- 6
- Issue
- 9
- Pages
- 226
- ISSN
- 2673-2688 (ISSN-L)
- OpenAlex
- W4414128336
- Cited by
- 117
- References
- 55
- Citations by year
- 2026: 103 · 2025: 14
- FWCI
- 27.92
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- AI (publishedVersion, cc-by)
- Preprints.org (acceptedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Kent State University’s Open Access APC Support Fund
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Keywords
- retrieval-augmented generation, health care, large language models, hallucination mitigation, medical question answering, domain shift, explainability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.