CoChat
Sign Up
PreprintCited by 240Topic ModelingInformation Retrieval and Search BehaviorMultimodal Machine Learning Applications

Retrieval-Augmented Generation for AI-Generated Content: A Survey

Open access
Zhao, Penghao, Zhang, Hailin, Yu, Qinhan, Wang, Zhengren, Geng, Yunteng, Fu, Fangcheng, Yang, Ling, Zhang, Wentao +2 more·2024·arXiv
DOI 10.48550/arxiv.2402.19473arXiv 2402.19473
Open this paper in CoChat — free account

Abstract

Advancements in model algorithms, the growth of foundational models, and access to high-quality datasets have propelled the evolution of Artificial Intelligence Generated Content (AIGC). Despite its notable successes, AIGC still faces hurdles such as updating knowledge, handling long-tail data, mitigating data leakage, and managing high training and inference costs. Retrieval-Augmented Generation (RAG) has recently emerged as a paradigm to address such challenges. In particular, RAG introduces the information retrieval process, which enhances the generation process by retrieving relevant objects from available data stores, leading to higher accuracy and better robustness. In this paper, we comprehensively review existing efforts that integrate RAG technique into AIGC scenarios. We first classify RAG foundations according to how the retriever augments the generator, distilling the fundamental abstractions of the augmentation methodologies for various retrievers and generators. This unified perspective encompasses all RAG scenarios, illuminating advancements and pivotal technologies that help with potential future progress. We also summarize additional enhancements methods for RAG, facilitating effective engineering and implementation of RAG systems. Then from another view, we survey on practical applications of RAG across different modalities and tasks, offering valuable references for researchers and practitioners. Furthermore, we introduce the benchmarks for RAG, discuss the limitations of current RAG systems, and suggest potential directions for future research. Github: https://github.com/PKU-DAIR/RAG-Survey.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2402.19473

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Recent memory-augmented neural architectures suffer from computational overhead, lack interpretability, or fail to capture the nuanced temporal dynamics essential for robust episodic memory.

    “However, these solutions often suffer from computational overhead, lack interpretability (Zhao et al. 2024), or fail to capture the nuanced temporal dynamics essential for robust episodic memory (Wang et al. 2023).”

    From ARTEM: Enhancing Large Language Model Agents with Spatial-Temporal Episodic Memory (2026) · cites this paper as Zhao et al. 2024

    The survey’s “Extra Overhead” discussion (A. Limitations, p. 16) says retrieval and interaction add latency and incur non-negligible overhead in most cases. It does not establish the lack of interpretability attributed to Zhao et al., and its overhead discussion concerns RAG systems rather than episodic-memory architectures. The temporal-dynamics clause is cited to Wang et al., not Zhao et al. (LLM, conf=0.86)

    Experimental — accuracy not yet measured

  • In the Retrieval-Augmented Generation framework, a retriever that demonstrates high recall in a particular test set may not enhance the performance of subsequent question-answering tasks.

    “For instance, within the Retrieval-Augmented Generation (RAG) framework [252, 253], a retriever that demonstrates high 'recall' in a particular test set may not enhance the performance of subsequent questionanswering tasks.”

    From Human-inspired Perspectives: A Survey on AI Long-term Memory (2024) · cites this paper as [253]

    The survey’s Limitations section (p. 16) says retriever and generator objectives may not align and that better retrieval accuracy does not necessarily improve generation. Its RAG for Text section (p. 9) also reports that RAG does not invariably benefit question answering. It does not establish the specific example of a retriever with high recall on a test set failing to improve a downstream question-answering task. (LLM, conf=0.82)

    Experimental — accuracy not yet measured

  • Most prior work has focused either on architectural innovations or on isolated components such as retriever and generator design.

    “While interest in RAG continues to grow, most prior work has focused either on architectural innovations [10] or on isolated components such as retriever and generator design [11].”

    From Retrieval-Augmented Generation (RAG) in Healthcare: A Comprehensive Review (2025) · cites this paper as [11]

    The Background (p. 1) says prior RAG enhancements include optimizations of individual components, and the Preliminary section (p. 3) discusses retrievers and generators. But the Background also describes holistic pipeline enhancements; the paper does not establish that most prior work focused on isolated components. The architectural-innovations clause is attached to a different citation and is not assessed here. (LLM, conf=0.84)

    Experimental — accuracy not yet measured

  • Modular RAG [28] and related surveys [24, 35, 86, 126] focus on conceptual overviews and lack implementation or evaluation support for GraphRAG.

    “However, Modular RAG [28] and related surveys [24, 35, 86, 126] focus on conceptual overviews and lack implementation or evaluation support for GraphRAG.”

    From LEGO-GraphRAG: Modularizing Graph-Based Retrieval-Augmented Generation for Design Space Exploration (2025) · cites this paper as [126]

    The Contribution section (p. 2) identifies this paper as a survey of RAG foundations, enhancements, applications, and limitations, supporting its characterization as an overview. The Conclusion (p. 17) and Benchmark section (p. 15) say it reviews existing RAG benchmarks, but the passages do not establish whether it provides implementation or evaluation support specifically for GraphRAG. (LLM, conf=0.82)

    Experimental — accuracy not yet measured

  • The lack of a unified categorization for systematically analyzing GraphRAG techniques hinders effective research summarization and identification of promising candidates.

    “The lack of a unified categorization for systematically analyzing these techniques-despite prior efforts such as Modular RAG [28] and other surveys [24, 35, 86, 126] on LLMs with graphs-hinders effective research summarization and the identification of promising candidates for further study.”

    From LEGO-GraphRAG: Modularizing Graph-Based Retrieval-Augmented Generation for Design Space Exploration (2025) · cites this paper as [126]

    The Background (p. 2) says the absence of a systematic RAG review hinders the field, and Related Work (pp. 2–3) describes a need for a comprehensive overview. Those passages concern RAG broadly, not a unified categorization of GraphRAG techniques or its effect on identifying promising candidates. The cited paper is also a broad RAG survey, not the “Modular RAG” effort to which this citation is attached. (LLM, conf=0.82)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

The citation lists haven’t been fetched yet

References 198 · Cited by 240

Research works printed but not linked: 324

  1. [1][1] T. B. Brown, B. Mann et al., 'Language models are few-shot learners,' in NeurIPS, 2020. -
  2. [2][2] M. Chen, J. Tworek et al., 'Evaluating large language models trained on code,' arXiv:2107.03374, 2021. - · arXiv
  3. [3][3] OpenAI, 'GPT-4 technical report,' arXiv:2303.08774, 2023. - · arXiv
  4. [4][4] H. Touvron, T. Lavril et al., 'Llama: Open and efficient foundation language models,' arXiv:2302.13971, 2023. - · arXiv
  5. [5][5] H. Touvron, L. Martin et al., 'Llama 2: Open foundation and fine-tuned chat models,' arXiv:2307.09288, 2023. - · arXiv
  6. [6][6] B. Rozi` ere, J. Gehring et al., 'Code llama: Open foundation models for code,' arXiv:2308.12950, 2023. - · arXiv
  7. [7][7] A. Ramesh, M. Pavlov, G. Goh et al., 'Zero-shot text-to-image generation,' in ICML, 2021. -
  8. [8][8] A. Ramesh, P. Dhariwal, A. Nichol et al., 'Hierarchical text-conditional image generation with CLIP latents,' arXiv:2204.06125, 2022. - · arXiv
  9. [9][9] J. Betker, G. Goh, L. Jing et al., 'Improving image generation with better captions,' Computer Science, vol. 2, no. 3, p. 8, 2023. -
  10. [10][10] R. Rombach, A. Blattmann, D. Lorenz et al., 'High-resolution image synthesis with latent diffusion models,' in IEEE/CVF, 2022. -
  11. [12][12] S. Hochreiter and J. Schmidhuber, 'Long short-term memory,' Neural Comput., vol. 9, no. 8, pp. 1735-1780, 1997. -
  12. [13][13] A. Vaswani, N. Shazeer, N. Parmar et al., 'Attention is all you need,' in NeurIPS, 2017. -
  13. [14][14] I. Goodfellow, J. Pouget-Abadie, M. Mirza et al., 'Generative adversarial networks,' CACM, vol. 63, no. 11, pp. 139-144, 2020. -
  14. [15][15] J. Devlin, M. Chang et al., 'BERT: pre-training of deep bidirectional transformers for language understanding,' in NAACL-HLT, 2019. -
  15. [16][16] C. Raffel, N. Shazeer, A. Roberts et al., 'Exploring the limits of transfer learning with a unified text-to-text transformer,' JMLR, vol. 21, pp. 140:1-140:67, 2020. -
  16. [17][17] W. Fedus, B. Zoph, and N. Shazeer, 'Switch transformers: Scaling to trillion parameter models with simple and efficient sparsity,' JMLR, vol. 23, no. 120, pp. 1-39, 2022. -
  17. [19][19] S. E. Robertson and H. Zaragoza, 'The probabilistic relevance framework: BM25 and beyond,' FTIR, vol. 3, no. 4, pp. 333-389, 2009. -
  18. [20][20] V. Karpukhin, B. Oguz, S. Min et al., 'Dense passage retrieval for open-domain question answering,' in EMNLP, 2020. -
  19. [21][21] J. Johnson, M. Douze, and H. J´ egou, 'Billion-scale similarity search with gpus,' IEEE Trans. Big Data, vol. 7, no. 3, pp. 535-547, 2021. -
  20. [22][22] Q. Chen, B. Zhao, H. Wang et al., 'SPANN: highly-efficient billionscale approximate nearest neighborhood search,' in NeurIPS, 2021. -
  21. [23][23] R. Datta, D. Joshi, J. Li et al., 'Image retrieval: Ideas, influences, and trends of the new age,' CSUR, vol. 40, no. 2, pp. 5:1-5:60, 2008. -
  22. [24][24] A. Radford, J. W. Kim, C. Hallacy et al., 'Learning transferable visual models from natural language supervision,' in ICML, 2021. -
  23. [25][25] Z. Feng, D. Guo et al., 'Codebert: A pre-trained model for programming and natural languages,' in EMNLP Findings, 2020. -
  24. [26][26] Y. Wu, K. Chen, T. Zhang et al., 'Large-scale contrastive languageaudio pretraining with feature fusion and keyword-to-caption augmentation,' in ICASSP, 2023. -
  25. [27][27] A. Mallen, A. Asai, V. Zhong et al., 'When not to trust language models: Investigating effectiveness of parametric and non-parametric memories,' in ACL, 2023. -
  26. [28][28] N. Carlini, F. Tram` er et al., 'Extracting training data from large language models,' in USENIX, 2021. -
  27. [29][29] M. Kang, N. M. G¨ urel et al., 'C-RAG: certified generation risks for retrieval-augmented language models,' arXiv:2402.03181, 2024. - · arXiv
  28. [30][30] G. Izacard, P. Lewis, M. Lomeli et al., 'Atlas: Few-shot learning with retrieval augmented language models,' arXiv:2208.03299, 2022. - · arXiv
  29. [31][31] Y. Wu, M. N. Rabe, D. Hutchins, and C. Szegedy, 'Memorizing transformers,' in ICLR, 2022. -
  30. [32][32] Z. He, Z. Zhong, T. Cai et al., 'REST: retrieval-based speculative decoding,' arxiv:2311.08252, 2023. - · arXiv
  31. [33][33] K. Guu, K. Lee, Z. Tung et al., 'REALM: retrieval-augmented language model pre-training,' ICML, 2020. -
  32. [34][34] P. S. H. Lewis, E. Perez, A. Piktus et al., 'Retrieval-augmented generation for knowledge-intensive NLP tasks,' in NeurIPS, 2020. -
  33. [35][35] G. Izacard and E. Grave, 'Leveraging passage retrieval with generative models for open domain question answering,' in EACL, 2021. -
  34. [36][36] S. Borgeaud, A. Mensch et al., 'Improving language models by retrieving from trillions of tokens,' in ICML, 2022. -
  35. [37][37] U. Khandelwal, O. Levy, D. Jurafsky et al., 'Generalization through memorization: Nearest neighbor language models,' in ICLR, 2020. -
  36. [38][38] J. He, G. Neubig, and T. Berg-Kirkpatrick, 'Efficient nearest neighbor language models,' in EMNLP, 2021. -
  37. [40][40] M. R. Parvez, W. U. Ahmad et al., 'Retrieval augmented code generation and summarization,' in EMNLP Findings, 2021. -
  38. [41][41] W. U. Ahmad, S. Chakraborty, B. Ray et al., 'Unified pre-training for program understanding and generation,' in NAACL-HLT, 2021. -
  39. [42][42] S. Zhou, U. Alon, F. F. Xu et al., 'Docprompting: Generating code by retrieving the docs,' in ICLR, 2023. -
  40. [43][43] Y. Koizumi, Y. Ohishi et al., 'Audio captioning using pre-trained largescale language model guided by audio-based similar caption retrieval,' arXiv:2012.07331, 2020. - · arXiv
  41. [44][44] R. Huang, J. Huang, D. Yang et al., 'Make-an-audio: Text-to-audio generation with prompt-enhanced diffusion models,' in ICML, 2023. -
  42. [45][45] H.-Y. Tseng, H.-Y. Lee et al., 'Retrievegan: Image synthesis via differentiable patch retrieval,' in ECCV, 2020. -
  43. [47][47] R. Ramos, B. Martins et al., 'Smallcap: lightweight image captioning prompted with retrieval augmentation,' in CVPR, 2023. -
  44. [48][48] J. Chen, Y. Pan, Y. Li et al., 'Retrieval augmented convolutional encoder-decoder networks for video captioning,' TOMCCAP, vol. 19, no. 1s, pp. 48:1-48:24, 2023. -
  45. [49][49] J. Xu, Y. Huang, J. Hou et al., 'Retrieval-augmented egocentric video captioning,' arXiv:2401.00789, 2024. - · arXiv
  46. [50][50] J. Seo, S. Hong et al., 'Retrieval-augmented score distillation for textto-3d generation,' arXiv:2402.02972, 2024. - · arXiv
  47. [51][51] M. Zhang, X. Guo, L. Pan et al., 'Remodiffuse: Retrieval-augmented motion diffusion model,' in ICCV, 2023. -
  48. [52][52] X. Hu, X. Wu, Y. Shu, and Y. Qu, 'Logical form generation via multitask learning for complex question answering over knowledge bases,' in COLING, 2022. -
  49. [53][53] X. Huang, J. Kim, and B. Zou, 'Unseen entity handling in complex question answering over knowledge base via language generation,' in EMNLP Findings, 2021. -
  50. [54][54] R. Das, M. Zaheer, D. Thai et al., 'Case-based reasoning for natural language queries over knowledge bases,' in EMNLP, 2021. -
  51. [55][55] Z. Wang, W. Nie, Z. Qiao et al., 'Retrieval-based controllable molecule generation,' in ICLR, 2022. -
  52. [56][56] Q. Jin, Y. Yang, Q. Chen, and Z. Lu, 'Genegpt: Augmenting large language models with domain tools for improved access to biomedical information,' Bioinformatics, vol. 40, no. 2, p. btae075, 2024. -
  53. [57][57] H. Li, Y. Su, D. Cai et al., 'A survey on retrieval-augmented text generation,' arxiv:2202.01110, 2022. - · arXiv
  54. [58][58] A. Asai, S. Min, Z. Zhong, and D. Chen, 'Acl 2023 tutorial: Retrievalbased language models and applications,' ACL 2023, 2023. -
  55. [59][59] Y. Gao, Y. Xiong et al., 'Retrieval-augmented generation for large language models: A survey,' arxiv:2312.10997, 2023. - · arXiv
  56. [60][60] R. Zhao, H. Chen et al., 'Retrieving multimodal information for augmented generation: A survey,' in EMNLP, 2023. -
  57. [61][61] Y. Ding, W. Fan et al., 'A survey on rag meets llms: Towards retrievalaugmented large language models,' arXiv:2405.06211, 2024. - · arXiv
  58. [62][62] J. Chen, H. Guo, K. Yi et al., 'Visualgpt: Data-efficient adaptation of pretrained language models for image captioning,' in CVPR, 2022. -
  59. [63][63] Y. Tay, M. Dehghani, D. Bahri, and D. Metzler, 'Efficient transformers: A survey,' CSUR, vol. 55, no. 6, pp. 109:1-109:28, 2023. -
  60. [64][64] G. V. Houdt et al., 'A review on the long short-term memory model,' Artif. Intell. Rev., vol. 53, no. 8, pp. 5929-5955, 2020. -
  61. [65][65] L. Yang, Z. Zhang et al., 'Diffusion models: A comprehensive survey of methods and applications,' CSUR, vol. 56, no. 4, pp. 1-39, 2023. -
  62. [66][66] J. Gui, Z. Sun, Y. Wen et al., 'A review on generative adversarial networks: Algorithms, theory, and applications,' TKDE, vol. 35, no. 4, pp. 3313-3332, 2023. -
  63. [67][67] S. E. Robertson and S. Walker, 'On relevance weights with little relevance information,' in SIGIR, 1997. -
  64. [68][68] J. D. Lafferty and C. Zhai, 'Document language models, query models, and risk minimization for information retrieval,' in SIGIR, 2001. -
  65. [69][69] S. Hershey, S. Chaudhuri et al., 'CNN architectures for large-scale audio classification,' in ICASSP, 2017. -
  66. [70][70] J. Dong, X. Li, C. Xu et al., 'Dual encoding for zero-example video retrieval,' in CVPR, 2019. -
  67. [71][71] L. Xiong, C. Xiong, Y. Li et al., 'Approximate nearest neighbor negative contrastive learning for dense text retrieval,' in ICLR, 2021. -
  68. [72][72] J. L. Bentley, 'Multidimensional binary search trees used for associative searching,' CACM, vol. 18, no. 9, pp. 509-517, 1975. -
  69. [75][75] Y. A. Malkov and D. A. Yashunin, 'Efficient and robust approximate nearest neighbor search using hierarchical navigable small world graphs,' TPAMI, vol. 42, no. 4, pp. 824-836, 2018. -
  70. [76][76] S. Jayaram Subramanya, F. Devvrit et al., 'Diskann: Fast accurate billion-point nearest neighbor search on a single node,' NeurIPS, 2019. -
  71. [77][77] Y. Wang, Y. Hou, H. Wang et al., 'A neural corpus indexer for document retrieval,' in NeurIPS, 2022. -
  72. [78][78] H. Zhang, Y. Wang, Q. Chen et al., 'Model-enhanced vector index,' in NeurIPS, 2023. -
  73. [79][79] S. A. Hayati, R. Olivier, P. Avvaru et al., 'Retrieval-based neural code generation,' in EMNLP, 2018. -
  74. [80][80] J. Zhang, X. Wang, H. Zhang et al., 'Retrieval-based neural source code summarization,' in ICSE, 2020. -
  75. [81][81] G. Poesia, A. Polozov, V. Le et al., 'Synchromesh: Reliable code generation from pre-trained language models,' in ICLR, 2022. -
  76. [82][82] X. Ye, S. Yavuz et al., 'RNG-KBQA: generation augmented iterative ranking for knowledge base question answering,' in ACL, 2022. -
  77. [83][83] Y. Shu et al., 'TIARA: multi-grained retrieval for robust question answering over large knowledge bases,' arXiv:2210.12925, 2022. - · arXiv
  78. [84][84] X. V. Lin, R. Socher et al., 'Bridging textual and tabular data for cross-domain text-to-sql semantic parsing,' arXiv:2012.12627, 2020. - · arXiv
  79. [85][85] A. Asai, Z. Wu, Y. Wang et al., 'Self-rag: Learning to retrieve, generate, and critique through self-reflection,' arxiv:2310.11511, 2023. - · arXiv
  80. [86][86] W. Shi, S. Min, M. Yasunaga et al., 'Replug: Retrieval-augmented black-box language models,' arXiv:2301.12652, 2023. - · arXiv
  81. [87][87] O. Ram, Y. Levine, I. Dalmedigos et al., 'In-context retrievalaugmented language models,' arXiv:2302.00083, 2023. - · arXiv
  82. [88][88] D. Zan, B. Chen, Z. Lin et al., 'When language model meets private library,' in EMNLP Findings, 2022. -
  83. [89][89] N. Nashid, M. Sintaha, and A. Mesbah, 'Retrieval-based prompt selection for code-related few-shot learning,' in ICSE, 2023. -
  84. [90][90] M. Jin, S. Shahriar, M. Tufano et al., 'Inferfix: End-to-end program repair with llms,' in ESEC/FSE, 2023. -
  85. [91][91] S. Lu, N. Duan, H. Han et al., 'Reacc: A retrieval-augmented code completion framework,' in ACL, 2022. -
  86. [92][92] Y. Liu et al., 'Uni-parser: Unified semantic parser for question answering on knowledge base and database,' in EMNLP, 2022. -
  87. [93][93] Z. Yang, X. Du, E. Cambria et al., 'End-to-end case-based reasoning for commonsense knowledge base completion,' in EACL, 2023. -
  88. [94][94] W. Shi, Y. Zhuang, Y. Zhu et al., 'Retrieval-augmented large language models for adolescent idiopathic scoliosis patients in shared decisionmaking,' in ACM-BCB, 2023. -
  89. [95][95] A. Casanova, M. Careil, J. Verbeek et al., 'Instance-conditioned gan,' in NeurIPS, 2021. -
  90. [97][97] Y. Kuratov, A. Bulatov et al., 'In search of needles in a 10m haystack: Recurrent memory finds what llms miss,' arXiv:2402.10790, 2024. - · arXiv
  91. [100][100] T. B. Hashimoto, K. Guu, Y. Oren, and P. Liang, 'A retrieve-and-edit framework for predicting structured outputs,' in NeurIPS, 2018. -
  92. [102][102] E. Shi, Y. Wang, W. Tao et al., 'RACE: retrieval-augmented commit message generation,' in EMNLP, 2022. -
  93. [103][103] W. Chen, H. Hu, C. Saharia, and W. W. Cohen, 'Re-imagen: Retrievalaugmented text-to-image generator,' in ICLR, 2023. -
  94. [104][104] S. Sheynin, O. Ashual, A. Polyak et al., 'Knn-diffusion: Image generation via large-scale retrieval,' in ICLR, 2023. -
  95. [105][105] A. Blattmann, R. Rombach, K. Oktay et al., 'Retrieval-augmented diffusion models,' in NeurIPS, 2022. -
  96. [106][106] R. Rombach, A. Blattmann, and B. Ommer, 'Text-guided synthesis of artistic images with retrieval-augmented diffusion models,' arXiv:2207.13038, 2022. - · arXiv
  97. [107][107] B. Li, P. H. Torr, and T. Lukasiewicz, 'Memory-driven text-to-image generation,' arXiv:2208.07022, 2022. - · arXiv
  98. [108][108] B. Oguz, X. Chen, V. Karpukhin et al., 'Unik-qa: Unified representations of structured and unstructured knowledge for open-domain question answering,' in NAACL Findings, 2022. -
  99. [109][109] D. Yu, S. Zhang et al., 'Decaf: Joint decoding of answers and logical forms for question answering over knowledge bases,' in ICLR, 2023. -
  100. [110][110] G. Dong, R. Li, S. Wang et al., 'Bridging the kb-text gap: Leveraging structured knowledge-aware pre-training for KBQA,' in CIKM, 2023. -
  101. [111][111] K. Wang, F. Duan, S. Wang et al., 'Knowledge-driven cot: Exploring faithful reasoning in llms for knowledge-intensive question answering,' arXiv:2308.13259, 2023. - · arXiv
  102. [112][112] D. Yu and Y. Yang, 'Retrieval-enhanced generative model for largescale knowledge graph completion,' in SIGIR, 2023. -
  103. [113][113] T. F´ evry, L. B. Soares et al., 'Entities as experts: Sparse memory access with entity supervision,' in EMNLP, 2020. -
  104. [114][114] M. de Jong, Y. Zemlyanskiy, N. FitzGerald et al., 'Mention memory: incorporating textual knowledge into transformers through entity mention attention,' in ICLR, 2021. -
  105. [115][115] B. Jing, Y. Zhang, Z. Song et al., 'Amd: Anatomical motion diffusion with interpretable motion decomposition and fusion,' in AAAI, 2024. -
  106. [116][116] Y. Yuan, H. Liu, X. Liu et al., 'Retrieval-augmented text-to-audio generation,' in ICASSP, 2024. -
  107. [117][117] B. Yang, M. Cao, and Y. Zou, 'Concept-aware video captioning: Describing videos with effective prior information,' TIP, vol. 32, pp. 5366-5378, 2023. -
  108. [118][118] Z. Zhong, T. Lei, and D. Chen, 'Training language models with memory augmentation,' in EMNLP, 2022. -
  109. [119][119] S. Min, W. Shi, M. Lewis et al., 'Nonparametric masked language modeling,' in ACL Findings, 2023. -
  110. [120][120] X. Zhang, Y. Zhou, G. Yang, and T. Chen, 'Syntax-aware retrieval augmented code generation,' in EMNLP Findings, 2023. -
  111. [121][121] Z. Fei, 'Memory-augmented image captioning,' in AAAI, 2021. -
  112. [122][122] Y. Leviathan, M. Kalman, and Y. Matias, 'Fast inference from transformers via speculative decoding,' in ICML, 2023. -
  113. [123][123] T. Lan, D. Cai, Y. Wang et al., 'Copy is all you need,' in ICLR, 2023. -
  114. [124][124] B. Cao, D. Cai, L. Cui et al., 'Retrieval is accurate generation,' arXiv:2402.17532, 2024. - · arXiv
  115. [125][125] L. Wang, N. Yang, and F. Wei, 'Query2doc: Query expansion with large language models,' in EMNLP, 2023. -
  116. [126][126] L. Gao, X. Ma, J. Lin, and J. Callan, 'Precise zero-shot dense retrieval without relevance labels,' in ACL, 2023. -
  117. [127][127] G. Kim, S. Kim, B. Jeon et al., 'Tree of clarifications: Answering ambiguous questions with retrieval-augmented large language models,' in EMNLP, 2023. -
  118. [128][128] C.-M. Chan, C. Xu et al., 'Rq-rag: Learning to refine queries for retrieval augmented generation,' arXiv:2404.00610, 2024. - · arXiv
  119. [130][130] M. Xia, S. Malladi, S. Gururangan et al., 'LESS: selecting influential data for targeted instruction tuning,' arXiv:2402.04333, 2024. - · arXiv
  120. [131][131] A.-L. Bornea, F. Ayed et al., 'Telco-rag: Navigating the challenges of retrieval-augmented language models for telecommunications,' arXiv:2404.15939, 2024. - · arXiv
  121. [132][132] S. Yao, J. Zhao, D. Yu et al., 'React: Synergizing reasoning and acting in language models,' in ICLR, 2023. -
  122. [133][133] J. Wei, X. Wang, D. Schuurmans et al., 'Chain-of-thought prompting elicits reasoning in large language models,' in NeurIPS, 2022. -
  123. [134][134] T. Pouplin, H. Sun, S. Holt, and M. Van der Schaar, 'Retrievalaugmented thought process as sequential decision making,' arXiv:2402.07812, 2024. - · arXiv
  124. [136][136] P. Sarthi, S. Abdullah, A. Tuli et al., 'Raptor: Recursive abstractive processing for tree-organized retrieval,' in ICLR, 2023. -
  125. [137][137] B. Kang, J. Kim et al., 'Prompt-rag: Pioneering vector embeddingfree retrieval-augmented generation in niche domains, exemplified by korean medicine,' arXiv:2401.11246, 2024. - · arXiv
  126. [138][138] V. Raina et al., 'Question-based retrieval using atomic units for enterprise rag,' arXiv:2405.12363, 2024. - · arXiv
  127. [139][139] S. Xiao, Z. Liu, P. Zhang et al., 'C-pack: Packaged resources to advance general chinese embedding,' arxiv:2309.07597, 2023. - · arXiv
  128. [140][140] J. Chen, S. Xiao, P. Zhang et al., 'Bge m3-embedding: Multi-lingual, multi-functionality, multi-granularity text embeddings through selfknowledge distillation,' arxiv:2309.07597, 2023. - · arXiv
  129. [141][141] S. Xiao, Z. Liu, P. Zhang, and X. Xing, 'Lm-cocktail: Resilient tuning of language models via model merging,' arxiv:2311.13534, 2023. - · arXiv
  130. [142][142] P. Zhang, S. Xiao, Z. Liu, Z. Dou, and J.-Y. Nie, 'Retrieve anything to augment large language models,' arxiv:2310.07554, 2023. - · arXiv
  131. [143][143] M. Kulkarni, P. Tangarajan, K. Kim et al., 'Reinforcement learning for optimizing RAG for domain chatbots,' arXiv:2401.06800, 2024. - · arXiv
  132. [144][144] W. Wang, Y. Wang et al., 'Rap-gen: Retrieval-augmented patch generation with codet5 for automatic program repair,' in ESEC/FSE, 2023. -
  133. [145][145] K. Sawarkar, A. Mangal et al., 'Blended rag: Improving rag (retrieveraugmented generation) accuracy with semantic search and hybrid query-based retrievers,' arXiv:2404.07220, 2024. - · arXiv
  134. [146][146] S.-Q. Yan, J.-C. Gu, Y. Zhu, and Z.-H. Ling, 'Corrective retrieval augmented generation,' arXiv:2401.15884, 2024. - · arXiv
  135. [147][147] W. Huang, M. Lapata, P. Vougiouklis et al., 'Retrieval augmented generation with rich answer encoding,' in IJCNLP-AACL, 2023. -
  136. [148][148] H. Wang, W. Huang, Y. Deng et al., 'Unims-rag: A unified multi-source retrieval-augmented generation for personalized dialogue systems,' arXiv:2401.13256, 2024. - · arXiv
  137. [149][149] S. Koley, A. K. Bhunia et al., 'You'll never walk alone: A sketch and text duet for fine-grained image retrieval,' in CVPR, 2024. -
  138. [150][150] M. R. Glass, G. Rossiello, M. F. M. Chowdhury et al., 'Re2g: Retrieve, rerank, generate,' in NAACL, 2022. -
  139. [151][151] R. F. Nogueira and K. Cho, 'Passage re-ranking with BERT,' arxiv:1901.04085, 2019. - · arXiv
  140. [152][152] J. Li, Y. Zhao, Y. Li et al., 'Acecoder: Utilizing existing code to enhance code generation,' arXiv:2303.17780, 2023. - · arXiv
  141. [153][153] P. Shi, R. Zhang, H. Bai, and J. Lin, 'XRICL: cross-lingual retrievalaugmented in-context learning for cross-lingual text-to-sql semantic parsing,' in EMNLP Findings, 2022. -
  142. [154][154] K. Rangan and Y. Yin, 'A fine-tuning enhanced rag system with quantized influence measure as ai judge,' arXiv:2402.17081, 2024. - · arXiv
  143. [155][155] J. Saad-Falcon, O. Khattab, K. Santhanam et al., 'Udapdr: Unsupervised domain adaptation via llm prompting and distillation of rerankers,' in EMNLP, 2023. -
  144. [156][156] L. Wang, N. Yang, and F. Wei, 'Learning to retrieve in-context examples for large language models,' arXiv:2307.07164, 2023. - · arXiv
  145. [157][157] P. Finardi, L. Avila et al., 'The chronicles of rag: The retriever, the chunk and the generator,' arXiv:2401.07883, 2024. - · arXiv
  146. [158][158] J. Li, Y. Yuan, and Z. Zhang, 'Enhancing llm factual accuracy with rag to counter hallucinations: A case study on domain-specific queries in private knowledge-bases,' arXiv:2403.10446, 2024. - · arXiv
  147. [159][159] Z. Wang, J. Araki, Z. Jiang et al., 'Learning to filter context for retrieval-augmented generation,' arxiv:2311.08377, 2023. - · arXiv
  148. [160][160] S. Hofst¨ atter, J. Chen, K. Raman, and H. Zamani, 'Fid-light: Efficient and effective retrieval-augmented text generation,' in SIGIR, 2023. -
  149. [161][161] D. Arora, A. Kini, S. R. Chowdhury et al., 'Gar-meets-rag paradigm for zero-shot information retrieval,' arXiv:2310.20158, 2023. - · arXiv
  150. [163][163] W. Yu, D. Iter et al., 'Generate rather than retrieve: Large language models are strong context generators,' arXiv:2209.10063, 2022. - · arXiv
  151. [164][164] A. Abdallah and A. Jatowt, 'Generator-retriever-generator: A novel approach to open-domain question answering,' arXiv:2307.11278, 2023. - · arXiv
  152. [165][165] M. Besta, A. Kubicek et al., 'Multi-head rag: Solving multi-aspect problems with llms,' arXiv:2406.05085, 2024. - · arXiv
  153. [167][167] H. S. Zheng, S. Mishra et al., 'Take a step back: Evoking reasoning via abstraction in large language models,' arxiv:2310.06117, 2023. - · arXiv
  154. [168][168] S. Diao, P. Wang, Y. Lin, and T. Zhang, 'Active prompting with chainof-thought for large language models,' arxiv:2302.12246, 2023. - · arXiv
  155. [170][170] N. F. Liu, K. Lin, J. Hewitt et al., 'Lost in the middle: How language models use long contexts,' arxiv:2307.03172, 2023. - · arXiv
  156. [171][171] T. Ahmed, K. S. Pai, P. Devanbu, and E. T. Barr, 'Automatic semantic augmentation of language model prompts (for code summarization),' arXiv:2304.06815, 2024. - · arXiv
  157. [172][172] Z. Xu, Z. Liu, Y. Liu et al., 'Activerag: Revealing the treasures of knowledge via active learning,' arXiv:2402.13547, 2024. - · arXiv
  158. [173][173] E. Nijkamp, B. Pang, H. Hayashi et al., 'A conversational paradigm for program synthesis,' arxiv:2203.13474, 2022. - · arXiv
  159. [174][174] Y. He, M. Xia, H. Chen et al., 'Animate-a-story: Storytelling with retrieval-augmented video generation,' arXiv:2307.06940, 2023. - · arXiv
  160. [175][175] E. J. Hu, Y. Shen, P. Wallis et al., 'Lora: Low-rank adaptation of large language models,' in ICLR, 2022. -
  161. [176][176] C. Liu, P. C ¸ etin, Y . Patodia et al., 'Automated code editing with searchgenerate-modify,' arXiv:2306.06490, 2023. - · arXiv
  162. [177][177] H. Joshi, J. P. C. S´ anchez, S. Gulwani et al., 'Repair is nearly generation: Multilingual program repair with llms,' in AAAI, 2023. -
  163. [178][178] Z. Jiang, F. F. Xu, L. Gao et al., 'Active retrieval augmented generation,' arXiv:2305.06983, 2023. - · arXiv
  164. [179][179] A. Mallen, A. Asai, V. Zhong et al., 'When not to trust language models: Investigating effectiveness of parametric and non-parametric memories,' in ACL, 2023. -
  165. [180][180] Z. Jiang, J. Araki, H. Ding, and G. Neubig, 'How can we know When language models know? on the calibration of language models for question answering,' TACL, 2021. -
  166. [181][181] N. Kandpal, H. Deng, A. Roberts et al., 'Large language models struggle to learn long-tail knowledge,' in ICML, 2023. -
  167. [182][182] R. Ren, Y. Wang, Y. Qu et al., 'Investigating the factual knowledge boundary of large language models with retrieval augmentation,' arxiv:2307.11019, 2023. - · arXiv
  168. [183][183] Y. Wang, P. Li, M. Sun, and Y. Liu, 'Self-knowledge guided retrieval augmentation for large language models,' in EMNLP Findings, 2023. -
  169. [184][184] H. Ding, L. Pang, Z. Wei et al., 'Retrieve only when it needs: Adaptive retrieval augmentation for hallucination mitigation in large language models,' arXiv:2402.10612, 2024. - · arXiv
  170. [185][185] S. Jeong, J. Baek, S. Cho et al., 'Adaptive-rag: Learning to adapt retrieval-augmented large language models through question complexity,' arXiv:2403.14403, 2024. - · arXiv
  171. [186][186] F. Zhang, B. Chen et al., 'Repocoder: Repository-level code completion through iterative retrieval and generation,' in EMNLP, 2023. -
  172. [187][187] Z. Shao, Y. Gong, Y. Shen et al., 'Enhancing retrieval-augmented large language models with iterative retrieval-generation synergy,' in EMNLP Findings, 2023. -
  173. [188][188] X. Cheng, D. Luo, X. Chen et al., 'Lift yourself up: Retrievalaugmented text generation with self-memory,' in NeurIPS, 2023. -
  174. [189][189] Z. Wang, A. Liu, H. Lin et al., 'Rat: Retrieval augmented thoughts elicit context-aware reasoning in long-horizon generation,' arXiv:2403.05313, 2024. - · arXiv
  175. [190][190] O. Agarwal, H. Ge, S. Shakeri, and R. Al-Rfou, 'Knowledge graph based synthetic corpus generation for knowledge-enhanced language model pre-training,' in NAACL-HLT, 2021. -
  176. [191][191] J. Sun, C. Xu, L. Tang et al., 'Think-on-graph: Deep and responsible reasoning of large language model with knowledge graph,' arXiv:2307.07697, 2023. - · arXiv
  177. [192][192] P. Limkonchotiwat, W. Ponwitayarat, C. Udomcharoenchaikit et al., 'Cl-relkt: Cross-lingual language knowledge transfer for multilingual retrieval question answering,' in NAACL Findings, 2022. -
  178. [193][193] A. Asai, X. Yu, J. Kasai, and H. Hajishirzi, 'One question answering model for many languages with cross-lingual dense passage retrieval,' in NeurIPS, 2021. -
  179. [194][194] K. Lee, S. Han et al., 'When to read documents or QA history: On unified and selective open-domain QA,' in ACL Findings, 2023. -
  180. [195][195] S. Yue, W. Chen et al., 'Disc-lawllm: Fine-tuning large language models for intelligent legal services,' arXiv:2309.11325, 2023. - · arXiv
  181. [196][196] S. Siriwardhana, R. Weerasekera, T. Kaluarachchi et al., 'Improving the domain adaptation of retrieval augmented generation (RAG) models for open domain question answering,' TACL, vol. 11, pp. 1-17, 2023. -
  182. [197][197] Y. Tang and Y. Yang, 'Multihop-rag: Benchmarking retrievalaugmented generation for multi-hop queries,' arXiv:2401.15391, 2024. - · arXiv
  183. [198][198] K. Huang, C. Zhai, and H. Ji, 'CONCRETE: improving cross-lingual fact-checking with cross-lingual retrieval,' in COLING, 2022. -
  184. [199][199] L. Hagstr¨ om, D. Saynova, T. Norlund et al., 'The effect of scaling, retrieval augmentation and form on the factual consistency of language models,' arXiv:2311.01307, 2023. - · arXiv
  185. [200][200] H. Zamani and M. Bendersky, 'Stochastic rag: End-to-end retrievalaugmented generation through expected utility maximization,' arXiv:2405.02816, 2024. - · arXiv
  186. [201][201] Y. Liu, Y. Wan et al., 'KG-BART: knowledge graph-augmented BART for generative commonsense reasoning,' in AAAI, 2021. -
  187. [202][202] A. Wan, E. Wallace, and D. Klein, 'What evidence do language models find convincing?' arXiv:2402.11782, 2024. - · arXiv
  188. [203][203] H. Zhang, Z. Liu et al., 'Grounded conversation generation as guided traverses in commonsense knowledge graphs,' in ACL, 2020. -
  189. [204][204] D. Cai, Y. Wang, W. Bi et al., 'Skeleton-to-response: Dialogue generation guided by retrieval memory,' in NAACL-HLT, 2019. -
  190. [205][205] M. Komeili, K. Shuster, and J. Weston, 'Internet-augmented dialogue generation,' in ACL, 2022. -
  191. [206][206] K. Shuster, J. Xu et al., 'Blenderbot 3: a deployed conversational agent that continually learns to responsibly engage,' arXiv:2208.03188, 2022. - · arXiv
  192. [207][207] S. Kim, J. Y. Jang, M. Jung, and S. Shin, 'A model of cross-lingual knowledge-grounded response generation for open-domain dialogue systems,' in EMNLP Findings, 2021. -
  193. [208][208] E. Nie, S. Liang, H. Schmid, and H. Sch¨ utze, 'Cross-lingual retrieval augmented prompt for low-resource languages,' in ACL, 2023. -
  194. [209][209] X. Li, E. Nie, and S. Liang, 'From classification to generation: Insights into crosslingual retrieval augmented icl,' in NeurIPS, 2023. -
  195. [210][210] W. Li, J. Li, W. Ma, and Y. Liu, 'Citation-enhanced generation for 16. llm-based chatbot,' arXiv:2402.16063, 2024. - · arXiv
  196. [211][211] D. Cai, Y. Wang, H. Li et al., 'Neural machine translation with monolingual translation memory,' in ACL/IJCNLP, 2021. -
  197. [212][212] U. Khandelwal, A. Fan, D. Jurafsky et al., 'Nearest neighbor machine translation,' in ICLR, 2021. -
  198. [213][213] X. Du and H. Ji, 'Retrieval-augmented generative question answering for event argument extraction,' in EMNLP, 2022. -
  199. [214][214] Y. Gao, Q. Yin, Z. Li et al., 'Retrieval-augmented multilingual keyphrase generation with retriever-generator iterative training,' in NAACL Findings, 2022. -
  200. [215][215] J. Zhang, E. J. Yu, Q. Chen et al., 'Retrieval-based full-length wikipedia generation for emergent events,' arXiv:2402.18264, 2024. - · arXiv

200 of 324 shown

Authors
Zhao, P., Zhang, H., Yu, Q., Wang, Z., Geng, Y., Fu, F., Yang, L., Zhang, W., Jiang, J., & Cui, B.
Affiliations
  • Peking University (CN)
  • Shanghai Jiao Tong University (CN)
  • Tencent (China) (CN)
Corresponding author
  • Fu, Fangcheng
  • Zhang, Wentao
  • Cui, Bin
ORCID
Venue
arXiv
Publisher
arXiv
Published
2024
Volume
11
Issue
1
Pages
1-29
ISSN
2364-1185 (ISSN-L)
DOI
10.48550/arxiv.2402.19473
arXiv
2402.19473
OpenAlex
W7118085507
Cited by
240
References
198
Citations by year
2026: 119 · 2025: 97 · 2024: 24
FWCI
406.66
Type
journal article
Language
en
Open access
Licence
Locations
  • Data Science and Engineering (publishedVersion, cc-by-nc-nd)
  • arXiv (Cornell University) (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • arXiv (Cornell University)
Funders
National Natural Science Foundation of China (U23B2048, 62402011)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
Keywords
retrieval-augmented generation, AI-generated content, information retrieval, knowledge updating, long-tailed data, data leakage, large language models

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review