Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Sign Up
PreprintCited by 343Topic ModelingInformation Retrieval and Search BehaviorMultimodal Machine Learning Applications

The DOI matches its DataCite record; 7 of the 7 references it cites were found in a registry or an index; none of the 73 sources its claims cite is checked for support yet.

A Comprehensive Survey of Retrieval-Augmented Generation (RAG): Evolution, Current Landscape and Future Directions

Open access
Gupta, Shailja, Ranjan, Rajesh, Singh, Surya Narayan·2024·arXiv
DOI 10.48550/arxiv.2410.12837arXiv 2410.12837
Open this paper in CoChat — free accountOpen PDF

Abstract

This paper presents a comprehensive study of Retrieval-Augmented Generation (RAG), tracing its evolution from foundational concepts to the current state of the art. RAG combines retrieval mechanisms with generative language models to enhance the accuracy of outputs, addressing key limitations of LLMs. The study explores the basic architecture of RAG, focusing on how retrieval and generation are integrated to handle knowledge-intensive tasks. A detailed review of the significant technological advancements in RAG is provided, including key innovations in retrieval-augmented language models and applications across various domains such as question-answering, summarization, and knowledge-based tasks. Recent research breakthroughs are discussed, highlighting novel methods for improving retrieval efficiency. Furthermore, the paper examines ongoing challenges such as scalability, bias, and ethical concerns in deployment. Future research directions are proposed, focusing on improving the robustness of RAG models, expanding the scope of application of RAG models, and addressing societal implications. This survey aims to serve as a foundational resource for researchers and practitioners in understanding the potential of RAG and its trajectory in natural language processing.

Overview

CoChat Summary

TL;DR

This survey traces Retrieval-Augmented Generation (RAG) from foundational retrieval and generation models to current architectures, applications, and recent research advances. It also outlines persistent challenges—scalability, retrieval quality, bias, coherence, and transparency—and proposes future directions including multimodal integration, personalization, and cross-lingual support.

Key findings

  • RAG combines a retriever, such as BM25 or Dense Passage Retrieval (DPR), with a generator, such as T5 or BART, to ground generated text in external knowledge and reduce hallucinations.
  • The paper traces an evolution from retrieval-only or generation-only systems to hybrid models like DrQA, REALM, and RAG, with REALM jointly training retrieval and generation and RAG using dense passage retrieval plus BART.
  • Recent advances include Self-RAG, RAFT, FILCO, RAPTOR, HyPA-RAG, MemoRAG, and NLLB-E5; RAPTOR is reported to improve accuracy on the QuALITY benchmark by 20% when paired with GPT-4.
  • The survey identifies ongoing challenges in scalability and efficiency, retrieval quality and relevance, bias and fairness, coherence, and interpretability and transparency.

Methods

  • Design: a comprehensive survey/narrative review of RAG, covering its evolution, core components, modalities, recent advancements, challenges, and future research directions.
  • Data or sample: no primary dataset, experimental sample, or empirical evaluation is reported; the paper synthesizes prior literature and cited systems.
  • Main analysis: thematic review and qualitative synthesis of RAG architectures, applications, and recent research; no formal systematic review protocol or meta-analysis is stated.

Limitations

  • Paper-stated limitations of RAG include scalability and efficiency, retrieval quality and relevance, bias and fairness, coherence between retrieved passages and generated text, and interpretability/transparency.
  • Evident from the text: as a narrative survey, it does not report a systematic search strategy, inclusion/exclusion criteria, or quantitative synthesis across studies.
  • Evident from the text: the survey does not present its own benchmark results or primary evaluation, so claims about performance rely on cited works.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

DataCite · 10.48550/arxiv.2410.12837

Cites

7 of 7 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 Trends in RAG captured from recent research papers
Figure 1 Trends in RAG captured from recent research papersCC-BY-NC-ND · From the PDF
Figure 2 A basic flow of the RAG system along with its component
Figure 2 A basic flow of the RAG system along with its componentCC-BY-NC-ND · From the PDF
Figure 3 Timeline of the evolution of the RAG system and its components
Figure 3 Timeline of the evolution of the RAG system and its componentsCC-BY-NC-ND · From the PDF
Figure 4 Evolving Trends in RAG captured from research papers
Figure 4 Evolving Trends in RAG captured from research papersCC-BY-NC-ND · From the PDF

Verification

Claims the paper makes

0 Valid · 1 Not valid · 62 Not checked · 27 Own results and interpretations

31 more claims

Create a free account to see all 90 claims and to verify the 11 references still open.

See all claims — free account
  • Probably not a substantial claim. 22
  • It may state two separate claims as one. 43

Create a free account to see these claims.

Create a free account to see these assumptions.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

3 of 3

Citations

Cites

Show all 7 references

Research works printed but not linked: 56

  1. Acharya, A., Murthy, R., Kumar, V., & Sen, J. (2024). NLLB-E5: A Scalable Multilingual Retrieval Model. ArXiv. /abs/2409.05401
  2. Alayrac, J., Donahue, J., Luc, P., Miech, A., Barr, I., Hasson, Y., Lenc, K., Mensch, A., Millican, K., Reynolds, M., Ring, R., Rutherford, E., Cabi, S., Han, T., Gong, Z., Samangooei, S., Monteiro, M., Menick, J., Borgeaud, S., . . . Simonyan, K. (2022). Flamingo: A Visual Language Model for Few-Shot Learning. ArXiv. /abs/2204.14198
  3. Baevski, A., Zhou, H., Mohamed, A., & Auli, M. (2020). Wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations. ArXiv. /abs/2006.11477
  4. Bertasius, G., Wang, H., & Torresani, L. (2021). Is Space-Time Attention All You Need for Video Understanding? ArXiv. /abs/2102.05095
  5. Binns, R. (2018). Fairness in machine learning: Lessons from political philosophy. Proceedings of the 2018 Conference on Fairness, Accountability, and Transparency (pp. 149-159).
  6. Borgeaud, S., Mensch, A., Hoffmann, J., Cai, T., Rutherford, E., Millican, K., Driessche, G. V., Lespiau, J., Damoc, B., Clark, A., Casas, D. D., Guy, A., Menick, J., Ring, R., Hennigan, T., Huang, S., Maggiore, L., Jones, C., Cassirer, A., . . . Sifre, L. (2021). Improving language models by retrieving from trillions of tokens. ArXiv. /abs/2112.04426
  7. Chang, R., & Zhang, J. (2024). CommunityKG-RAG: Leveraging Community Structures in Knowledge Graphs for Advanced Retrieval-Augmented Generation in Fact-Checking. ArXiv. /abs/2408.08535
  8. Chen, D., Fisch, A., Weston, J., & Bordes, A. (2017). Reading Wikipedia to answer open-domain questions. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) (pp. 1870-1879).
  9. Chen, W., Hu, H., Chen, X., Verga, P., & Cohen, W. W. (2022). MuRAG: Multimodal Retrieval-Augmented Generator for Open Question Answering over Images and Text. ArXiv. /abs/2210.02928
  10. Chirkova, N., Rau, D., Déjean, H., Formal, T., Clinchant, S., & Nikoulina, V. (2024). Retrieval-augmented generation in multilingual settings. ArXiv. /abs/2407.01463
  11. Dai, Z., & Callan, J. (2019). Context-Aware Sentence/Passage Term Importance Estimation For First Stage Retrieval. ArXiv. /abs/1910.10687
  12. Devlin, J., Chang, M. W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (pp. 4171-4186).
  13. Devlin, J., Chang, M., Lee, K., & Toutanova, K. (2018). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. ArXiv. /abs/1810.04805
  14. Gan, C., Yang, D., Hu, B., Zhang, H., Li, S., Liu, Z., Shen, Y., Ju, L., Zhang, Z., Gu, J., Liang, L., & Zhou, J. (2024). Similarity is Not All You Need: Endowing Retrieval Augmented Generation with Multi Layered Thoughts. ArXiv. /abs/2405.19893
  15. Gatt, A., & Krahmer, & E. (2018). Survey of the state of the art in natural language generation: Core tasks, applications, and evaluation. Journal of Artificial Intelligence Research, 61, 65-170.
  16. Gupta, S., & Ranjan, R. (2024). Evaluation of LLMs Biases Towards Elite Universities: A Persona-Based Exploration. ArXiv. /abs/2407.12801
  17. Gupta, S., Ranjan, R., & Singh, S. N. (2024). Comprehensive Study on Sentiment Analysis: From Rule-based to modern LLM based system. ArXiv. /abs/2409.09989
  18. Guu, K., Lee, K., Tung, Z., Pasupat, P., & Chang, M. (2020). REALM: Retrieval-augmented language model pre-training. In Proceedings of the 37th International Conference on Machine Learning (pp. 3929-3938).
  19. Han, S., Pool, J., Tran, J., & Dally, W. J. (2015). Learning both weights and connections for efficient neural network. In Advances in Neural Information Processing Systems (pp. 1135-1143).
  20. Izacard, G., & Grave, E. (2021). Leveraging passage retrieval with generative models for open domain question answering. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume (pp. 874-880).
  21. Kalra, R., Wu, Z., Gulley, A., Hilliard, A., Guan, X., Koshiyama, A., & Treleaven, P. (2024). HyPA-RAG: A Hybrid Parameter Adaptive Retrieval-Augmented Generation System for AI Legal and Policy Applications. ArXiv. /abs/2409.09046
  22. Karpukhin, V., Oguz, B., Min, S., Lewis, P., Wu, L., Edunov, S., Chen, D. & Yih, W. T. (2020). Dense passage retrieval for open-domain question answering. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) (pp. 6769-6781).
  23. Lewis, P., Perez, E., Piktus, A., Petroni, F., Karpukhin, V., Goyal, N., ... & Riedel, S. (2020). Retrieval-augmented generation for knowledge-intensive NLP tasks. In Proceedings of the 34th International Conference on Neural Information Processing System ( pp. 9459-9474).
  24. Li, C., Liu, Z., Xiao, S., & Shao, Y. (2023). Making Large Language Models A Better Foundation For Dense Retrieval. ArXiv. /abs/2312.15503
  25. Li, F., Zhu, L., Wang, T., Li, J., Zhang, Z., & Shen, H. T. (2023). Cross-Modal Retrieval: A Systematic Review of Methods and Future Directions. ArXiv. /abs/2308.14263
  26. Li, S., Shang, H., Wei, D., Guo, J., Li, Z., He, X., Zhang, M., & Yang, H. (2024). LA-RAG:Enhancing LLM-based ASR Accuracy with Retrieval-Augmented Generation. ArXiv. /abs/2409.08597
  27. Li, S., Park, S., Lee, I., & Bastani, O. (2023). TRAQ: Trustworthy Retrieval Augmented Question Answering via Conformal Prediction. ArXiv. /abs/2307.04642
  28. Li, Z., Li, C., Zhang, M., Mei, Q., & Bendersky, M. (2024). Retrieval Augmented Generation or Long-Context LLMs? A Comprehensive Study and Hybrid Approach. ArXiv. /abs/2407.16833
  29. Liu, Z., Wang, H., Niu, Z., Wu, H., Che, W., & Liu, T. (2020). Towards Conversational Recommendation over Multi-Type Dialogs. ArXiv. /abs/2005.03954
  30. Mallen, A., Asai, A., Zhong, V., Das, R., Khashabi, D., & Hajishirzi, H. (2022). When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memories. ArXiv. /abs/2212.10511
  31. Mombaerts, L., Ding, T., Banerjee, A., Felice, F., Taws, J., & Borogovac, T. (2024). Meta Knowledge for Retrieval Augmented Large Language Models. ArXiv. /abs/2408.09017
  32. Nguyen, X., Pandit, S., Purushwalkam, S., Xu, A., Chen, H., Ming, Y., Ke, Z., Savarese, S., Xong, C., & Joty, S. (2024). SFR-RAG: Towards Contextually Faithful LLMs. ArXiv. /abs/2409.09916
  33. Niu, C., Wu, Y., Zhu, J., Xu, S., Shum, K., Zhong, R., Song, J., & Zhang, T. (2023). RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models. ArXiv. /abs/2401.00396
  34. Qian, H., Zhang, P., Liu, Z., Mao, K., & Dou, Z. (2024). MemoRAG: Moving towards Next-Gen RAG Via Memory-Inspired Knowledge Discovery. ArXiv. /abs/2409.05591
  35. Radford, A., Wu, J., Child, R., Luan, D., Amodei, D., & Sutskever, I. (2019). Language models are unsupervised multitask learners. OpenAI Blog, 1(8), 9.
  36. Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019). Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer. ArXiv. /abs/1910.10683
  37. Ranjan, R., Gupta, S., & Singh, S. N. (2024). A Comprehensive Survey of Bias in LLMs: Current Landscape and Future Directions. ArXiv. /abs/2409.16430
  38. Ravuru, C., Sakhinana, S. S., & Runkana, V. (2024). Agentic Retrieval-Augmented Generation for Time Series Analysis. ArXiv. /abs/2408.14484
  39. Robertson, S.G., & Zaragoza,H., (2009). The Probabilistic Relevance Framework: BM25 and Beyond, Foundations and Trends in Information Retrieval, 3(4), pp. 333-389.
  40. Roller, S., Dinan, E., Goyal, N., Ju, D., Williamson, M., Liu, Y., Xu, J., Ott, M., Shuster, K., Smith, E. M., Boureau, Y., & Weston, J. (2020). Recipes for building an open-domain chatbot. ArXiv. /abs/2004.13637
  41. Salton, G., Wong, A., & Yang, C. S. (1975). A vector space model for automatic indexing. Communications of the ACM, 18(11), 613-620.
  42. Sanh, V., Debut, L., Chaumond, J., & Wolf, T. (2019). DistilBERT, a distilled version of BERT: Smaller, faster, cheaper and lighter. ArXiv. /abs/1910.01108
  43. Sarthi, P., Abdullah, S., Tuli, A., Khanna, S., Goldie, A., & Manning, C. D. (2024). RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval. ArXiv. /abs/2401.18059
  44. Shrestha, R., Zou, Y., Chen, Q., Li, Z., Xie, Y., & Deng, S. (2024). FairRAG: Fair Human Generation via Fair Retrieval Augmentation. ArXiv. /abs/2403.19964
  45. Sutskever, I., Vinyals, O., & Le, Q. V. (2014). Sequence to sequence learning with neural networks. In Advances in Neural Information Processing Systems (pp. 3104-3112).
  46. Thakur, N., Bonifacio, L., Zhang, X., Ogundepo, O., Kamalloo, E., Li, X., Liu, Q., Chen, B., Rezagholizadeh, M., & Lin, J. (2023). NoMIRACL: Knowing When You Don't Know for Robust Multilingual Retrieval-Augmented Generation. ArXiv. /abs/2312.11361
  47. Thakur, N., Reimers, N., Ruckl'e, A., Srivastava, A., & Gurevych, I. (2021). BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models. ArXiv, abs/2104.08663. · arXiv
  48. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, Ł., & Polosukhin, I. (2017). Attention is all you need. In Advances in Neural Information Processing Systems (pp. 5998-6008).
  49. Wang, X., Wang, Z., Gao, X., Zhang, F., Wu, Y., Xu, Z., Shi, T., Wang, Z., Li, S., Qian, Q., Yin, R., Lv, C., Zheng, X., & Huang, X. (2024). Searching for Best Practices in Retrieval-Augmented Generation. ArXiv. /abs/2407.01219
  50. Wang, Z., Araki, J., Jiang, Z., Parvez, M. R., & Neubig, G. (2023). Learning to Filter Context for Retrieval-Augmented Generation. ArXiv. /abs/2311.08377
  51. Xia, P., Zhu, K., Li, H., Zhu, H., Li, Y., Li, G., Zhang, L., & Yao, H. (2024). RULE: Reliable Multimodal RAG for Factuality in Medical Vision Language Models. ArXiv. /abs/2407.05131
  52. Xie, S., Sun, C., Huang, J., Tu, Z., & Murphy, K. (2017). Rethinking Spatiotemporal Feature Learning: Speed-Accuracy Trade-offs in Video Classification. ArXiv. /abs/1712.04851
  53. Xiong, L., Xiong, C., Li, Y., Tang, K., Liu, J., Bennett, P., Ahmed, J., & Overwijk, A. (2020). Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval. ArXiv. /abs/2007.00808
  54. Yasunaga, M., Aghajanyan, A., Shi, W., James, R., Leskovec, J., Liang, P., Lewis, M., Zettlemoyer, L., & Yih, W. (2022). Retrieval-Augmented Multimodal Language Modeling. ArXiv. /abs/2211.12561
  55. Zhang, T., Patil, S. G., Jain, N., Shen, S., Zaharia, M., Stoica, I., & Gonzalez, J. E. (2024). RAFT: Adapting Language Model to Domain Specific RAG. ArXiv. /abs/2403.10131
  56. Zhu, Y., Ren, C., Xie, S., Liu, S., Ji, H., Wang, Z., Sun, T., He, L., Li, Z., Zhu, X., & Pan, C. (2024). REALM: RAG-Driven Enhancement of Multimodal Electronic Health Records Analysis via Large Language Models. ArXiv. /abs/2402.07016

Cited by

Related

See all

Metadata

Authors
Gupta, S., Ranjan, R., & Singh, S. N.
Venue
arXiv
Publisher
arXiv
Published
2024
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2410.12837
arXiv
2410.12837
OpenAlex
W4403578737
Cited by
342
References
7
Citations by year
2026: 200 · 2025: 141 · 2024: 1
Type
posted content
Language
en
Open access
Licence
Locations
  • arXiv (Cornell University) (submittedVersion, cc-by-nc-nd)
  • arXiv (Cornell University) (cc-by-nc-nd)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
Keywords
retrieval-augmented generation, retrieval-augmented language models, generative language models, question answering, text summarization, retrieval efficiency, scalability, bias, ethical considerations, robustness

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-11-14, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-11-14 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.