A Survey on Knowledge-Oriented Retrieval-Augmented Generation

TL;DR

This survey reviews retrieval-augmented generation (RAG) through a knowledge-centric lens, organizing the field around the lifecycle of external knowledge: sourcing, retrieval, integration, reasoning, and generation. It proposes a taxonomy spanning basic approaches, advanced approaches (training, multimodal, memory, agentic, parametric RAG), and evaluation strategies.

Key findings

• The authors structure RAG as a multi-stage knowledge lifecycle and propose a taxonomy with three branches: basic approaches (user intent understanding, knowledge source/parsing, embedding, indexing, retrieval, integration, answer generation, citation), advanced approaches (RAG training, multimodal RAG, memory RAG, agentic RAG, parametric RAG), and evaluation strategies (effectiveness and efficiency).
• Knowledge integration is categorized by architectural stage: input-layer (text-level concatenation or feature-level), intermediate-layer (e.g., RETRO's cross-attention, TOME/LongMem memory, weighted addition), and output-layer (kNN-LM interpolation, calibration-based methods, and Contrastive Decoding as post-hoc logit-level alignment).
• Parametric RAG parameterizes documents as low-rank LoRA matrices merged into feed-forward layers; the survey reports that on HotpotQA, 2WikiMultihopQA, and ComplexWebQuestions it "reduces inference time by up to 36% while maintaining or exceeding in-context RAG baselines."
• Evaluation is split into effectiveness (query-context relevance, context-answer coherence, query-answer accuracy) and efficiency (latency, throughput, resource utilization), with benchmarks such as ARES, RAGAS, TruLens, KILT, CRUD, RECALL, CRAG, and RGB.

Methods

• Design: a systematic literature survey, not an empirical study; the stated unique contribution is organizing RAG research around the lifecycle of knowledge rather than by model architecture or task.
• Scope: covers RAG origins (2020 onward), core pipeline components, a taxonomy of basic and advanced methods, evaluation benchmarks and metrics, downstream tasks (QA, information extraction, text understanding/generation), and domain applications (science, finance, education, healthcare, legal, industry).
• Analysis: narrative synthesis with comparison tables (e.g., Table 1 comparing prior RAG surveys; Table 2 embedding models and dimensions; Table 3 retrieval models; Table 4 comparing implicit/explicit/working memory; Table 5 datasets by task).

Limitations

• The paper does not state explicit limitations of the survey itself; it instead lists open issues for RAG subfields (e.g., lack of systematic multi-source heterogeneous graph integration, dynamic graph updating, multimodal alignment and real-time retrieval, absence of a universally accepted trustworthiness framework, and ineffective defenses against knowledge poisoning).
• Evident from the text: as a survey, it reports no original experiments or quantitative comparisons of its own, and its performance figures (e.g., the 36% inference-time reduction) are drawn from cited primary work rather than independently verified.
• Evident from the text: the survey notes that existing benchmarks often focus on single-modality or offline use cases and that there is no unified standard for quantifying interpretability, trustworthiness, or uncertainty handling.