Retrieval augmented generation for large language models in healthcare: A systematic review
Open accessThe DOI matches its Crossref record; 161 of the 161 references it cites were found in a registry or an index.
Abstract
Large Language Models (LLMs) have demonstrated promising capabilities to solve complex tasks in critical sectors such as healthcare. However, LLMs are limited by their training data which is often outdated, the tendency to generate inaccurate (“hallucinated”) content and a lack of transparency in the content they generate. To address these limitations, retrieval augmented generation (RAG) grounds the responses of LLMs by exposing them to external knowledge sources. However, in the healthcare domain there is currently a lack of systematic understanding of which datasets, RAG methodologies and evaluation frameworks are available. This review aims to bridge this gap by assessing RAG-based approaches employed by LLMs in healthcare, focusing on the different steps of retrieval, augmentation and generation. Additionally, we identify the limitations, strengths and gaps in the existing literature. Our synthesis shows that 78.9% of studies used English datasets and 21.1% of the datasets are in Chinese. We find that a range of techniques are employed RAG-based LLMs in healthcare, including Naive RAG, Advanced RAG, and Modular RAG. Surprisingly, proprietary models such as GPT-3.5/4 are the most used for RAG applications in healthcare. We find that there is a lack of standardised evaluation frameworks for RAG-based applications. In addition, the majority of the studies do not assess or address ethical considerations related to RAG in healthcare. It is important to account for ethical challenges that are inherent when AI systems are implemented in the clinical setting. Lastly, we highlight the need for further research and development to ensure responsible and effective adoption of RAG in the medical domain.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
![Fig 1 PRISMA [25] workflow applied to the search, identification and selection of the studies that were included in the systematic review.](https://figures.cochat.ai/paper-figures/558117d130e94385a047aeb76b2922c7/retrieval-augmented-generation-for-large-language-models-in-healthcare-a-figure-1.jpg)



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Some general-purpose LLMs, including GPT-4-based models, can be customized through methods such as prompt engineering and in-context learning (e.g., PharmacyGPT), 10 and augmented with domain-specific external knowledge sources, enabling responses grounded in relevant databases or documents.114”
From Large Language Models in Pharmacist-Led Direct Patient Care: A Rapid Review of Published Evaluations (2026) · cites this paper as [114]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173 · cited 1×
“Models such as BioBERT [8] and ClinicalBERT [9] have been proposed, leveraging the power of Bidirectional Encoder Representations from Transformers (BERT) [10].”
XGBoost: A Scalable Tree Boosting System
Chen, T., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939785 · Cited by 54,569 · cited 1×
“A recent study by Jin et al. [69] proposed a framework that integrates advanced techniques such as large-scale feature extraction combined with RAG, accurate scoring of features from medical knowledge using LlamaIndex, and XGBoost [131] algorithm for prediction.”
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164 · cited 1×
“All studies included met the inclusion criteria shown in Table 1.”
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
BioBERT: a pre-trained biomedical language representation model for biomedical text mining
Lee, J., Yoon, W., Kim, S., Kim, D., Kim, S., So, C. H., & Kang, J. (2020) · Bioinformatics · doi:10.1093/bioinformatics/btz682 · Cited by 7,218 · cited 1×
“Models such as BioBERT [8] and ClinicalBERT [9] have been proposed, leveraging the power of Bidirectional Encoder Representations from Transformers (BERT) [10].”
Survey of Hallucination in Natural Language Generation
Ji, Z., Lee, N., Frieske, R., Yu, T., Su, D., Xu, Y., Ishii, E., Bang, Y. J., Madotto, A., & Fung, P. (2023) · ACM Computing Surveys · doi:10.1145/3571730 · Cited by 5,025 · cited 1×
“This issue is often referred to as "model hallucinations" [6] and methodologies for its mitigation are still an active area of research [7].”
Bag of Tricks for Efficient Text Classification
Joulin, A., Grave, E., Bojanowski, P., & Mikolov, T. (2017) · Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers · doi:10.18653/v1/e17-2068 · Cited by 4,545
Bag of Tricks for Efficient Text Classification
Joulin, A., Grave, E., Bojanowski, P., & Mikolov, T. (2016) · arXiv · doi:10.48550/arxiv.1607.01759 · Cited by 4,542
Large language models encode clinical knowledge
Singhal, K., Azizi, S., Tu, T., Mahdavi, S. S., Wei, J., Chung, H. W., Scales, N., Tanwani, A., Cole-Lewis, H., Pfohl, S., et al. (2023) · Nature · doi:10.1038/s41586-023-06291-2 · Cited by 4,083 · cited 1×
“To address this contextual need in medicine, Med-Palm was introduced demonstrating good performance in retrieving clinical knowledge and excelling in decision-making on several clinical tasks [11].”
Research works printed but not linked: 4
- Abacha AB, Agichtein E, Pinter Y, Demner-Fushman D. Overview of the medical question answering task at TREC 2017 LiveQA. In: Text Retrieval Conference; 2017. Available from: https://api.semanticscholar.org/CorpusID:3902472
- Wang J, Yang Z, Yao Z, Yu H. JMLR: joint medical LLM and retrieval training for enhancing reasoning and professional question answering capability. 2024.
- H Yu, 2023, Zero-shot ECG diagnosis with large language models and retrieval-augmented generation., 650
- DD Team, 2024, DeepEval: the open-source LLM evaluation framework
Cited by
Items 301–367 of 367
Adem, J. B., & Alhur, A. (2026) · PLOS Digital Health · doi:10.1371/journal.pdig.0001748
“Therefore, GenAI should be regarded as a decision-support tool that complements, rather than replaces, clinical expertise, and AI-generated recommendations should continue to encourage consultation with qualified healthcare professionals before diagnostic or therapeutic decisions are made [92,93].”
Gatimu, K. C., Mwikya, J., & Mageto, S. (2026) · International Journal of Research Publication and Reviews · doi:10.55248/gengpi.07.0926.2903
Moussaoui, Y. E., & Adda, M. (2026) · Procedia Computer Science · doi:10.1016/j.procs.2026.08.392
Garcia, I., & Herrera, D. (2026) · Journal of Health Informatics and Digital Systems · doi:10.68159/q638866091
Yadav, S. A., & Assumption, M. (2026) · International Journal of Drug Delivery Technology · doi:10.25258/ijddt.16.84s.201
Beyond text: quantifying the impact of figure-guided retrieval in biomedical RAG systems
Venkatesh, R. J., Gajendran, S., & Kumar, C. U. O. (2026) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2026.1861611 · Cited by 1
Subahan, A. S., Khan, S. J., Sarkar, S., Saha, S., Dhakshinamoorthy, K. T., & Randhawa, P. (2026) · International Conference on Secure Information Systems and Technologies (ICSIST) · doi:10.1109/icsist70215.2026.11706296
Colson, H., & Ballard, H. O. (2026) · Medical Science Educator · doi:10.1007/s40670-026-02907-0
Tejaswi, D. S., Reddy, P. R. S., Shailaja, K., & Murthy, G. V. (2026) · International Engineering Data Analytics and Management Conference (EAMCON) · doi:10.68337/cpsm.v1.i1.2026-008
Stuhlmiller, T. J., Rabe, A. P. J., Rapp, J., Awawda, A., Kouser, H., Lui, K., Salamon, H., Chuyka, D., Mahoney, W., Furgason, J. M., et al. (2026) · AI in Precision Oncology · doi:10.1177/2993091x261492372
Pradana, B. I., Irawan, M. C., Zhorif, K. Y. M., Haz, A. L., Fajrianti, E. D., Sukaridhoto, S., Wibowo, A., & Mufid, M. R. (2026) · International Electronics Symposium (IES) · doi:10.1109/ies71033.2026.11702720
Prompt engineering for academic and clinical writing: A practical guide for clinicians
CASSAI, A. D., Pistollato, E., Pettenuzzo, T., Dost, B., Sella, N., & Boscolo, A. (2026) · Saudi Journal of Anaesthesia · doi:10.4103/sja.sja_501_26
“…published literature, or uploaded documents by asking the LLM to retrieve the document or if it unable by directly uploading it in the LLMs. [15] Rather than relying exclusively on knowledge encoded during pretraining, the model first retrieves relevant information and subsequently…”
Bloch, T. A., Dave, D., & Chandraparsad (2026) · International Conference on Smart Communication and Sustainable Technologies (ICSCST) · doi:10.1109/icscst70031.2026.11709750
“However, when not based on external information, independent generative models like GPT-2 [14], [15], T5, and even LLaMA [16] frequently hallucinate facts, which is especially troublesome in clinical circumstances.”
J, J. T., Rajagopalan, N., & Gopal, S. (2026) · International Conference on Smart Communication and Sustainable Technologies (ICSCST) · doi:10.1109/icscst70031.2026.11709521
“L. M. Amugongo et al. [7] reviewed evaluation frameworks for RAG systems in healthcare, highlighting models such as GPT-3.”
IMicAP: an intelligent microbial application platform for knowledge-driven microbiome research
Zhu, C., Wang, X., Feng, L., Xu, M., Huang, Z., Chen, W., & Liu, L. (2026) · Frontiers in Microbiology · doi:10.3389/fmicb.2026.1955928
“…datasets and researcher needs by integrating: (1) Qwen3-Max-Thinking-Preview’s natural language generation capabilities (Yang et al., 2025); (2) A Retrieval-Augmented Generation (RAG) architecture for information retrieval (Amugongo et al., 2025); (3) Our curated microbial knowledge base.”
A., D. A. A., Hazriani, H., & Yuyun, Y. (2026) · MALCOM Indonesian Journal of Machine Learning and Computer Science · doi:10.57152/malcom.v6i3.2632
Chai, Z., Zhou, Y., & Yu, H. (2026) · International Conference on Automation and Computing (ICAC) · doi:10.1109/icac70325.2026.11712318
“Retrieval-augmented generation (RAG) may improve reliability by grounding outputs in external knowledge, reducing hallucination [18].”
Jovanović, N. (2025) · University of Maribor digital library (University of Maribor)
Privacy Risks in Retrieval Augmented and Multi-Agent LLM Architectures Handling PHI
Koduri, S. K. A. (2026) · International Conference on Emerging Techniques in Computational Intelligence (ICETCI) · doi:10.1109/icetci71772.2026.11710536
“The rapid integration of both Retrieval-Augmented Generation (RAG) and multi-agent Large Language Model (LLM) systems into healthcare is reshaping the sector, enhancing clinical decision support and patient triage [1], [2].”
Kővári, A. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-02312-x
“This case study is best seen as an emphasis on the need for context orchestration in high-stakes settings, instead of being considered as proof of superiority over the prompting technique [15, 20].”
InfluentialArdiyansah, S., & Yugopuspito, P. (2026) · International Conference on Technology Innovation and Its Applications (ICTIIA) · doi:10.1109/ictiia70925.2026.11717347
Heckmann, M., Dias, G. S. M., Amorim, W. P., Bugatti, P. H., Santos, C. A. N., & Saito, P. T. M. (2026) · Proceedings - IEEE Symposium on Computer-Based Medical Systems · doi:10.1109/cbms69103.2026.00284
“Instead of relying solely on internal parametric knowledge, RAG retrieves relevant biomedical literature and conditions generation on those sources, enabling evidence-backed reasoning and independent verification [7], [8].”
Zong, H., Wang, J., Cha, J., Wu, R., Hu, S., Zhao, Y., & Shen, B. (2026) · PLOS Digital Health · doi:10.1371/journal.pdig.0001773
“Integration with retrieval-augmented generation pipelines, medical ontologies and knowledge graph frameworks may further improve reasoning quality in factual consistency, faithfulness, and patient instruction generation [43–45].”
Xu, H., Guo, L., Shen, L., Zhu, T., Huang, X., & Ding, L. (2026) · Health Science Reports · doi:10.1002/hsr2.73381
“The higher DISCERN and EQIP scores observed for Copilot and Perplexity Pro are broadly consistent with evidence suggesting that access to external knowledge sources may improve the completeness, currency, and guideline alignment of medical responses [8, 27].”
Lao, J., & Xu, L. (2026) · Research Square · doi:10.21203/rs.3.rs-10990696/v1
Budrevich, A. D., Abramskiy, M. M., & Valishin, I. A. (2026) · Automatic Documentation and Mathematical Linguistics · doi:10.3103/s0005105526700858
Beem, V. R. (2026) · International Journal of Engineering Science and Information Technology · doi:10.52088/ijesty.v6i2.2023
Ayadi, M. G., Ghazouani, A., & Achour, H. (2026) · Network Modeling Analysis in Health Informatics and Bioinformatics · doi:10.1007/s13721-026-00890-5
Valdez, D., Ćavar, D., Parker, M. A., Liu, X.-J., & Agley, J. D. (2026) · npj Digital Public Health · doi:10.1038/s44482-026-00048-0
“With the added oRAG inferencing layer, LLM outputs are tailored more effectively to domain-speci fi c tasks 20 .”
Nahid, K., Anam, M., Hossain, M. S., Any, O. H., Hassan, K. M. R., & Anwar, M. M. (2026) · medRxiv · doi:10.64898/2026.10.14.26365587
Gatimu, K. C., Mwikya, J., & Mageto, S. (2026) · International Journal of Research Publication and Reviews · doi:10.55248/gengpi.07.1026.3208
Blinded professional ratings of artificial intelligence–generated and dietitian-designed meal plans
Abhulime, E. W. M., da Cunha, D. T., Monaco, V., de Melo, R., & Benatti, F. B. (2026) · Nutrition · doi:10.1016/j.nut.2026.113428
Moghadam, S. T., & Jabin, M. S. R. (2026) · Research Square · doi:10.21203/rs.3.rs-11197970/v1
Prastica, S. I., Saputra, R. M., & Suharso, W. (2026) · Jurnal Teknik Informatika (Jutif) · doi:10.52436/1.jutif.2026.7.5.5755
An Agentic Retrieval-Augmented Generation Framework for Reliable Biomedical Evidence Summarization
Baig, S. M. M., Azhar, S. A., & Karwande, V. S. (2026) · Multidisciplinary Journal of Research in Engineering and Technology · doi:10.65521/mjret.v13i1.3195
Kumar, P., Singh, S., Kumar, A., Sharma, A., Shrivastava, A., & Kumar, N. (2026) · International Conference on Computational Intelligence: Methods, Models, and Real-World Applications (ICCIMMR) · doi:10.1109/iccimmr71310.2026.11731659
“RAG is a system that can be used to achieve large language models that can be trained on external knowledge bases to produce high-quality and context-sensitive answers by accessing the corresponding information stored in the data sources of a specific domain [17].”
You, C., Chen, X., & Wang, X. (2026) · Lecture notes in civil engineering · doi:10.1007/978-3-032-28520-1_3
Omidi, M., Bacsu, J.-D., Absher, J. R., Babaieasl, F., Kooshiar, H., Imani, S. M., Ebrahimi, N., Smith, M. L., & Rahemi, Z. (2026) · Bioengineering · doi:10.3390/bioengineering13101225
“…in verified medical databases via RAG and paired with uncertainty estimation so that low-confidence answers are flagged and users are directed to a clinician, although LLMs’ self-reported (verbalized) confidence tends to be overconfident and less reliable than consistency-based measures [96,97].”
Towards an Adaptive and Intelligent Dashboard for AI-Driven Clinical Decision Support
Orji, F. A., Motolani, A., Ataguba, G., Rudzicz, F., & Orji, R. (2026) · IEEE International Conference on Intelligent Systems · doi:10.1109/is71416.2026.11727218
“Systematic reviews of LLM and RAG use in healthcare further emphasize that retrieval can improve grounding and transparency, while also identifying continuing gaps in evaluation methods, safety assessment, bias, and responsible clinical deployment [15], [16].”
Moghadam, S. T., & Jabin, M. S. R. (2026) · Research Square · doi:10.21203/rs.3.rs-11233939/v1
Agent-Enabled Reliable Augmented Generation System for Medical Research Summarization
Baig, S. M. M., Karwande, V. S., & Khan, A. A. (2026) · International Journal of Advance Scientific Research and Engineering Trends · doi:10.65521/ijasret.v10i1.4081
Jayasrilakshmi, S., Mahapatra, A., Kujur, A., Baban, C. A., Singh, A. K., & Mohanty, S. N. (2026) · Digital Health · doi:10.1177/20552076261500454
Saweris, R. G. E. (2026) · Research Square · doi:10.21203/rs.3.rs-11460520/v1
Hysenaj, M. (2025) · International Scientific Conference ITEMA. Recent Advances in Information Technology, Tourism, Economics, Management and Agriculture · doi:10.31410/itema.2025.1
Silva, M. M., Ismael, S., Dias, M. C., Gaudêncio, T., Malheiros, Y., & Barufaldi (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.31606
“However, evaluation protocols remain heterogeneous [1], and expert assessment has identified retrieval and evidence selection as important failure points [12].”
Srichok, T., Khonjun, S., Pitakaso, R., Chiaranai, S., Khampukka, P., Songserm, N., Nanthasamroeng, N., Gonwirat, S., Enkvetchakul, P., & Kaewta, C. (2026) · Journal of Market Access & Health Policy · doi:10.3390/jmahp14040062
Risks and Ethical Concerns of Artificial Intelligence in Plastic Surgery
Özmen, B. B., & Schwarz, G. S. (2026) · Clinics in Plastic Surgery · doi:10.1016/j.cps.2026.09.004
Sakaguchi, S., Otsuka, T., & Oyama, S. (2026) · International Conference on Computer and Communications Management (ICCCM) · doi:10.1145/3841323.3841348
Benchmarking ‘Ask Eolas’-a medical AI tool for antimicrobial advice available in UK hospitalsPreprint
Cui, H., Pradhan, A., Hammond, R., Cokljat, M., Johnstone, K., Luk, A., Yuan, Z., Yang, Y., ZHANG, J., Gu, T., et al. (2026) · medRxiv · doi:10.64898/2026.10.22.26366212
AI -Augmented Patient Data Analysis for Research Driven Diagnostics
Rajathi, N., & Deeksha, R. (2026) · doi:10.1109/icsl-dsga70378.2026.11736716
“In [1] Retrieval-Augmented Generation (RAG) applications to the healthcare context with large language models (LLMs).”
Comparative evaluation of similarity metrics for Chinese retrieval augmented generation
Chen, R. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-02613-1
Thibaut, J., Tunc, M., Smedt, J. D., Raymenants, J., Geenen, C., Cavillot, L., & André, E. (2026) · medRxiv · doi:10.64898/2026.10.28.26366693
Integrating Artificial Intelligence (AI) Chatbots to Promote Health Behaviors in Adolescents
Tan, Q., & Chen, S. (2026) · Children · doi:10.3390/children13111495
AI-Driven Medical Misinformation Detection and Health Guidance System
Jecob, J. J., Naik, B. D., Maneesh, S., & Shrivatsa, S. (2026) · INTERANTIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT · doi:10.55041/ijsrem68626
Bakalos, G., Loenneker, T., Srock, S., Das-Gupta, A., Canon, A., Buechele, T., Martinalbo, J., Lindegger, N., Zharkov, A., Doxani, C., et al. (2026) · Pharmaceutical Medicine · doi:10.1007/s40290-026-00644-8
Pereira, D. E., Gomes, H. M., Campelo, C. E. C., & Araújo, E. (2026) · doi:10.5753/se4as.2026.32997
The Clinical AI Safety Gap from Correct Answers to Safer DecisionsPreprint
Carrasco, J. A. V. (2026) · doi:10.66977/xsci.2611.000e
Zouakia, Z., Szymczak, A., Tordjman, S., Logak, E., Meyre, T., Resche‐Rigon, M., Cariou, A., Burgun, A., & Tsopra, R. (2026) · JMIR Medical Education · doi:10.2196/94795
Retrieval-Verification Separation: A Dual-Metric Architecture for Self-monitoring RAG Systems
Gálvez, J., Mendoza, E., Bolio, I., & Rodríguez, D. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-44191-1_36
Supervised agentic AI for precision oncology
Kurz, C., Merzhevich, T., Eskofier, B. M., Lammert, J., & Gmeiner, B. (2026) · Discover Oncology · doi:10.1007/s12672-026-06237-w
A Hybrid Sparse-Dense RAG Framework for Automated Clinical Specialty Classification
Paikrao, P. D., Wagh, M., Narwade, P., Goswami, P., & Choi, K. (2026) · Computer Modeling in Engineering & Sciences · doi:10.32604/cmes.2026.089401
Retrieval Augmented Generation for Large Language Models: A Methodological Survey
Rekkas, V. P., & Vretos, N. (2026) · Technologies · doi:10.3390/technologies14110715
Guo, S., Chen, K., Wu, H. Y., & Ye, Q. (2026) · Journal of Medical Systems · doi:10.1007/s10916-026-02485-z
Hines, D. E., Bian, J., Ceger, P. C., Deziel, N. C., Harris, N. L., He, X., Hu, H. Z., Cummins, M. R., Moxon, S. A. T., Mungall, C., et al. (2026) · Scientific Reviews · doi:10.1038/s44573-026-00023-z
Chen, M., Ma, A., Wang, C., Lyu, C., He, Y., Xu, Z., Li, X., Cheng, D., Jie, L., & Wang, L. (2026) · Journal of Medical Internet Research · doi:10.2196/98495
Chen, N. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-02384-9
Metadata
- Authors
- Amugongo, L. M., Mascheroni, P., Brooks, S., Doering, S., & Seidel, J.
- Affiliations
- Boehringer Ingelheim (Germany) (DE)
- Boehringer Ingelheim (China) (CN)
- Corresponding author
- Amugongo, Lameck Mbangula
- Venue
- PLOS Digital Health
- Publisher
- Public Library of Science (PLoS)
- Published
- 2025-06-11
- Volume
- 4
- Issue
- 6
- Pages
- e0000877
- ISSN
- 2767-3170 (ISSN-L)
- PMC
- PMC12157099
- OpenAlex
- W4411203672
- Semantic Scholar
- 5879575701b9b65b5cc56c00d9eebbfa219e0428
- Cited by
- 267
- References
- 126
- Citations by year
- 2026: 218 · 2025: 48
- FWCI
- 15.74
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLOS Digital Health (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Keywords
- retrieval-augmented generation, large language models, health care, medical question answering, hallucinations, external knowledge sources, medical datasets
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.