The DOI matches its DataCite record; 231 of the 231 references it cites were found in a registry or an index; none of the 119 sources its claims cite is checked for support yet.
Retrieval Augmented Generation (RAG) and Beyond: A Comprehensive Survey on How to Make your LLMs use External Data More Wisely
Open accessAbstract
Large language models (LLMs) augmented with external data have demonstrated remarkable capabilities in completing real-world tasks. Techniques for integrating external data into LLMs, such as Retrieval-Augmented Generation (RAG) and fine-tuning, are gaining increasing attention and widespread application. Nonetheless, the effective deployment of data-augmented LLMs across various specialized fields presents substantial challenges. These challenges encompass a wide range of issues, from retrieving relevant data and accurately interpreting user intent to fully harnessing the reasoning capabilities of LLMs for complex tasks. We believe that there is no one-size-fits-all solution for data-augmented LLM applications. In practice, underperformance often arises from a failure to correctly identify the core focus of a task or because the task inherently requires a blend of multiple capabilities that must be disentangled for better resolution. In this survey, we propose a RAG task categorization method, classifying user queries into four levels based on the type of external data required and primary focus of the task: explicit fact queries, implicit fact queries, interpretable rationale queries, and hidden rationale queries. We define these levels of queries, provide relevant datasets, and summarize the key challenges and most effective techniques for addressing these challenges. Finally, we discuss three main forms of integrating external data into LLMs: context, small model, and fine-tuning, highlighting their respective strengths, limitations, and the types of problems they are suited to solve. This work aims to help readers thoroughly understand and decompose the data requirements and key bottlenecks in building LLM applications, offering solutions to the different challenges and serving as a guide to systematically developing such applications.
Overview
CoChat Summary
TL;DR
This survey proposes a four-level categorization of queries for data-augmented LLM applications—explicit facts, implicit facts, interpretable rationales, and hidden rationales—and maps each level to suitable techniques. It also compares three ways to inject external data into LLMs: context, small model, and fine-tuning.
Key findings
- Proposes a RAG task categorization into four levels based on the type of external data required and the task’s primary focus: explicit fact queries, implicit fact queries, interpretable rationale queries, and hidden rationale queries.
- Recommends techniques by level: basic RAG for explicit facts; iterative RAG, graph/tree QA, and NL2SQL for implicit facts; prompt tuning and CoT prompting for interpretable rationales; offline learning, in-context learning, and fine-tuning for hidden rationales.
- Identifies three main forms of integrating external data into LLMs: context, small model, and fine-tuning, with increasing requirements for data volume, training duration, and computational resources.
- Notes there is no one-size-fits-all solution; misclassifying query levels can cause performance pitfalls, such as retrieving superficial information for explicit queries or insufficient data for implicit queries.
Methods
- Survey/position paper: proposes a query stratification method and reviews relevant datasets, challenges, and techniques for data-augmented LLM applications.
- Uses existing literature and common QA datasets (Table 1 stratifies datasets such as NQ, MS MARCO, TriviaQA, SQuAD, ASQA, and WebQSP as Level 1; HotPotQA, 2WikiMultiHopQA, MuSiQue, and others as Level 2) rather than new experiments.
- Main analysis is conceptual synthesis: defines each query level, summarizes key challenges and effective techniques, and discusses context, small-model, and fine-tuning integration strategies.
Limitations
- The paper does not state a formal limitations section; it acknowledges that data-augmented LLM applications are not one-size-fits-all and that challenges span retrieval, intent interpretation, and reasoning.
- Evident from the text: as a survey, it provides no empirical evaluation, no quantitative benchmark results, and no systematic review protocol; its recommendations are based on literature review and expert discussions.
- Evident: the four-level taxonomy and technique mappings are conceptual and may require validation across domains and mixed-query routing pipelines.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 Valid · 2 Not valid · 71 Not checked · 52 Own results and interpretations
None of the sources cited for this claim could be matched to a paper in Crossref, so there is nothing to check it against.
In the paper
“Numerous studies have explored various methods of blending dense vector indexing with sparse encoder indexing to better capture the semantic information of text blocks and enhance the precision of targeted paragraph retrieval [69,70,71].”
§ Retrieval Augmented Generation (RAG) and Beyond: A Comprehensive Survey on How to Make your LLMs use External Data More Wisely A PREPRINT > Indexing
What the sources say
- Not matchedcites [69]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites [70]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites [71]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
None of the sources cited for this claim could be matched to a paper in Crossref, so there is nothing to check it against.
In the paper
“Yet, research efforts and existing relevant surveys [6,7,8,9,10,11,12,13] frequently focus on only one of these levels or a particular topic of technologies.”
§ Retrieval Augmented Generation (RAG) and Beyond: A Comprehensive Survey on How to Make your LLMs use External Data More Wisely A PREPRINT > 1 Introduction
What the sources say
- Not matchedcites [6]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites [7]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites [8]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites [9]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites [10]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites [11]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites [12]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites [13]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
In the paper
“Kim et al. (2023) introduced a tree-like recursive retrieval method, incorporating pruning strategies to incrementally break down ambiguous questions into disambiguated ones, ultimately arriving at the closest correct answer [82].”
§ Retrieval Augmented Generation (RAG) and Beyond: A Comprehensive Survey on How to Make your LLMs use External Data More Wisely A PREPRINT > Query Document Alignment
What the sources say
- Not matchedcites [82]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
None of the sources cited for this claim could be matched to a paper in Crossref, so there is nothing to check it against.
In the paper
“Using feedback from LLMs to guide the training objectives of retrievers can also effectively enhance the retriever's suitability for LLMs [61,62,63].”
§ Retrieval Augmented Generation (RAG) and Beyond: A Comprehensive Survey on How to Make your LLMs use External Data More Wisely A PREPRINT > Indexing
What the sources say
- Not matchedcites [61]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites [62]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites [63]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
In the paper
“Additionally, some research focuses on pre-training a small language model dedicated to fact verification, which is used to filter out incorrect retrieved text chunks, thus improving the quality of the recalled text [81].”
§ Retrieval Augmented Generation (RAG) and Beyond: A Comprehensive Survey on How to Make your LLMs use External Data More Wisely A PREPRINT > Query Document Alignment
What the sources say
- Not matchedcites [81]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
32 more claims
Create a free account to see all 125 claims and every source verdict.
- Probably not a substantial claim. 66
- It may state two separate claims as one. 51
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Retrieval Augmented Generation (RAG) and Beyond: A Comprehensive Survey on How to Make your LLMs use External Data More Wisely A PREPRINT > 5.4 CoT Prompting
“Similarly, sophisticated agent systems have been designed in fields such as customer service [134] and medical question answering [135].”
§ Retrieval Augmented Generation (RAG) and Beyond: A Comprehensive Survey on How to Make your LLMs use External Data More Wisely A PREPRINT > References
“134. Mahyar Abbasian, Iman Azimi, Amir M Rahmani, and Ramesh Jain. Conversational health agents: A personal- ized llm-powered agent framework.”
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
LoRA: Low-Rank Adaptation of Large Language Models
Hu, E. J., Shen, Y., Wallis, P., Allen-Zhu, Z., Li, Y., Wang, S., Wang, L., & Chen, W. (2021) · arXiv · doi:10.48550/arxiv.2106.09685 · Cited by 13,453 · cited 1×
“Low-Rank Adaptation [179, 180, 181, 182, 183] reduces the number of trainable parameters needed for adapting to downstream tasks by imposing low-rank constraints on each dense layer to approximate the update matrices.”
BackgroundExploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1264 · Cited by 6,208 · cited 1×
“…References QA NQ(Natural Questions)[15] 1 - Explicit Facts False MS MARCO [16] 1 - Explicit Facts False TriviaQA[17] 1 - Explicit Facts False SQuAD [18] 1 - Explicit Facts False ASQA [19] 1 - Explicit Facts False WebQSP [20] 1 - Explicit Facts False HotPotQA[21] 2 - Implicit Facts True…”
BackgroundDense Passage Retrieval for Open-Domain Question Answering
Karpukhin, V., Oğuz, B., Min, S., Lewis, P., Wu, L., Edunov, S., Chen, D., & Yih, W.-T. (2020) · arXiv · doi:10.48550/arxiv.2004.04906 · Cited by 5,311
LLaMA: Open and Efficient Foundation Language Models
Touvron, H., Lavril, T., Izacard, G., Martinet, X., Lachaux, M.-A., Lacroix, T., Rozière, B., Goyal, N., Hambro, E., Azhar, F., et al. (2023) · arXiv · doi:10.48550/arxiv.2302.13971 · Cited by 4,602
Chain-Of-Thought Prompting Elicits Reasoning in Large Language Models
Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q. V., & Zhou, D. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-1800 · Cited by 4,505
Dense passage retrieval for open-domain question answering
Karpukhin, V., Oguz, B., Min, S., Lewis, P., Wu, L., Edunov, S., Chen, D., & Yih, W.-T. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.550 · Cited by 3,575
Training Language Models to Follow Instructions with Human Feedback
Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., et al. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-2011 · Cited by 3,117
SimCSE: Simple Contrastive Learning of Sentence Embeddings
Gao, T., Yao, X., & Chen, D. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.552 · Cited by 2,851
MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework
Hong, S., Zhuge, M., Chen, J., Zheng, X., Cheng, Y., Zhang, C., Wang, J., Wang, Z., Yau, S. K. S., Lin, Z., et al. (2023) · arXiv · doi:10.48550/arxiv.2308.00352 · Cited by 2,825
Self-citationLlama 2: Open Foundation and Fine-Tuned Chat Models
Touvron, H., Martin, L., Stone, K., Albert, P., Almahairi, A., Babaei, Y., Bashlykov, N., Batra, S., Bhargava, P., Bhosale, S., et al. (2023) · arXiv · doi:10.48550/arxiv.2307.09288 · Cited by 2,604
MS MARCO: A Human Generated MAchine Reading COmprehension Dataset
Bajaj, P., Campos, D., Craswell, N., Deng, L., Gao, J., Liu, X., Majumder, R., McNamara, A., Mitra, B., Nguyen, T., et al. (2016) · arXiv · doi:10.48550/arxiv.1611.09268 · Cited by 2,473
Parameter-efficient transfer learning for NLP
Houlsby, N., Giurgiu, A., Jastrzebski, S., Morrone, B., de Laroussilhe, Q., Gesmundo, A., Attariyan, M., & Gelly, S. (2019) · arXiv · doi:10.48550/arxiv.1902.00751 · Cited by 2,270
Natural Questions: A benchmark for question answering research
Kwiatkowski, T., Palomaki, J., Redfield, O., Collins, M., Parikh, A., Alberti, C., Epstein, D., Polosukhin, I., Devlin, J., Lee, K., et al. (2019) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00276 · Cited by 2,069
Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning StepsPreprint
Ho, X., Nguyễn, Á. D., Sugawara, S., & Aizawa, A. (2020) · International Conference on Computational Linguistics · doi:10.48550/arxiv.2011.01060 · Cited by 1,950
A survey on large language model based autonomous agents
Wang, L., Ma, C., Feng, X., Zhang, Z., Yang, H., Zhang, J., Chen, Z., Tang, J., Chen, X., Lin, Y., et al. (2024) · Frontiers of Computer Science · doi:10.1007/s11704-024-40231-1 · Cited by 1,941
TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehension
Joshi, M., Choi, E., Weld, D., & Zettlemoyer, L. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1147 · Cited by 1,690
TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehension
Joshi, M., Choi, E., Weld, D. S., & Zettlemoyer, L. (2017) · arXiv · doi:10.48550/arxiv.1705.03551 · Cited by 1,650
Lost in the Middle: How Language Models Use Long Contexts
Liu, N. F., Lin, K., Hewitt, J., Paranjape, A., Bevilacqua, M., Petroni, F., & Liang, P. (2024) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00638 · Cited by 1,612
WizardLM: Empowering large pre-trained language models to follow complex instructionsPreprint
Xu, C., Sun, Q., Zheng, K., Geng, X., Zhao, P., Feng, J., Tao, C., Lin, Q., & Jiang, D. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2304.12244 · Cited by 1,531
Tree of Thoughts: Deliberate Problem Solving with Large Language Models
Yao, S., Yu, D., Zhao, J., Shafran, I., Griffiths, T. L., Cao, Y., & Narasimhan, K. (2023) · arXiv · doi:10.48550/arxiv.2305.10601 · Cited by 1,158
DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-Correction
Pourreza, M., & Rafiei, D. (2023) · neural information processing systems · doi:10.52202/075280-1577 · Cited by 1,144
Reflexion: Language Agents with Verbal Reinforcement Learning
Shinn, N., Cassano, F., Berman, E., Gopinath, A., Narasimhan, K., & Yao, S. (2023) · arXiv · doi:10.48550/arxiv.2303.11366 · Cited by 1,087 · cited 1×
“Furthermore, the Reflexion framework [121] introduces a novel prompt optimization approach based on linguistic feedback, using a language model to analyze and store reflections on LLM outputs in an episodic memory buffer.”
MethodRetrieval-Augmented Generation for Large Language Models: A Survey
Gao, Y., Xiong, Y., Gao, X., Jia, K., Pan, J., Bi, Y., Dai, Y., Sun, J., Wang, M., & Wang, H. (2023) · arXiv · doi:10.48550/arxiv.2312.10997 · Cited by 876
Self-Consistency Improves Chain of Thought Reasoning in Language Models
Wang, X., Wei, J., Schuurmans, D., Le, Q., Chi, E., Narang, S., Chowdhery, A., & Zhou, D. (2022) · arXiv · doi:10.48550/arxiv.2203.11171 · Cited by 829
A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Models
Fan, W., Ding, Y., Ning, L., Wang, S., Li, H., Yin, D., Chua, T.-S., & Li, Q. (2024) · Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining · doi:10.1145/3637528.3671470 · Cited by 827
Chen, J., Xiao, S., Zhang, P., Luo, K., Lian, D., & Liu, Z. (2024) · Findings of the Association for Computational Linguistics ACL 2024 · doi:10.18653/v1/2024.findings-acl.137 · Cited by 757
Large Dual Encoders Are Generalizable RetrieversPreprint
Ni, J., Qu, C., Lu, J., Dai, Z., Abrego, G. H., Ma, J., Zhao, V., Luan, Y., Hall, K. B., Chang, M.-W., et al. (2021) · Conference on Empirical Methods in Natural Language Processing · doi:10.48550/arxiv.2112.07899 · Cited by 715
Self-citationLLM2Vec: Large Language Models Are Secretly Powerful Text EncodersPreprint
BehnamGhader, P., Adlakha, V., Mosbach, M., Bahdanau, D., Chapados, N., & Reddy, S. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2404.05961 · Cited by 705
Large Language Models for Mathematical Reasoning: Progresses and Challenges
Ahn, J., Verma, R., Lou, R., Liu, D., Zhang, R., & Yin, W. (2024) · Conference of the European Chapter of the Association for Computational Linguistics: Student Research Workshop (EACL SRW) · doi:10.18653/v1/2024.eacl-srw.17 · Cited by 701
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016) · arXiv · doi:10.48550/arxiv.1606.05250 · Cited by 678
Multitask Prompted Training Enables Zero-Shot Task Generalization
Sanh, V., Webson, A., Raffel, C., Bach, S. H., Sutawika, L., Alyafeai, Z., Chaffin, A., Stiegler, A., Scao, T. L., Raja, A., et al. (2021) · arXiv · doi:10.48550/arxiv.2110.08207 · Cited by 612 · cited 1×
“There are three primary methods for constructing an instruction dataset: a) deriving from existing datasets [161, 162], b) manually creating through handcrafted instructions [163, 164, 165], and c) generating synthetic data using powerful LLMs [166, 154].”
MethodReAct: Synergizing Reasoning and Acting in Language Models
Yao, S., Zhao, J., Yu, D., Du, N., Shafran, I., Narasimhan, K., & Cao, Y. (2022) · arXiv · doi:10.48550/arxiv.2210.03629 · Cited by 608
MedAgents: Large Language Models as Collaborators for Zero-shot Medical ReasoningPreprint
Tang, X., Zou, A.-N., Zhang, Z., Li, Z.-M., Zhao, Y., Zhang, X., Cohan, A., & Gerstein, M. (2023) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2311.10537 · Cited by 585
Fine-Tuning LLaMA for Multi-Stage Text Retrieval
Ma, X., Wang, L., Yang, N., Wei, F., & Lin, J. (2024) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3626772.3657951 · Cited by 539
How Far Can Camels Go? Exploring the State of Instruction Tuning on Open Resources
Wang, Y., Ivison, H., Dasigi, P., Hessel, J., Khot, T., Chandu, K., Wadden, D., MacMillan, K., Smith, N., Beltagy, I., et al. (2023) · neural information processing systems · doi:10.52202/075280-3268 · Cited by 536
The Web as a Knowledge-Base for Answering Complex Questions
Talmor, A., & Berant, J. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1059 · Cited by 520 · cited 1×
“…Facts True MuSiQue[23] 2 - Implicit Facts True Bamboogle[24] 2 - Implicit Facts True StrategyQA[25] 2 - Implicit Facts True ComplexWebQuestions [26] 2 - Implicit Facts True WebQuestions [27] 2 - Implicit Facts True Mintaka [28] 2 - Implicit Facts True MetaQA [29] 2 - Implicit Facts True qasper…”
BackgroundActive Retrieval Augmented Generation
Jiang, Z., Xu, F., Gao, L., Sun, Z., Liu, Q., Dwivedi-Yu, J., Yang, Y., Callan, J., & Neubig, G. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.495 · Cited by 497
Self-citationValipour, M., Rezagholizadeh, M., Kobyzev, I., & Ghodsi, A. (2023) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2023.eacl-main.239 · Cited by 491
Recommendation as Instruction Following: A Large Language Model Empowered Recommendation Approach
Zhang, J., Xie, R., Hou, Y., Zhao, W. X., Lin, L., & Wen, J.-R. (2024) · ACM Transactions on Information Systems · doi:10.1145/3708882 · Cited by 485
FinGPT: Open-Source Financial Large Language Models
Yang, H., Liu, X.-Y., & Wang, C. D. (2023) · doi:10.2139/ssrn.4489826 · Cited by 475
LISA: Reasoning Segmentation via Large Language Model
Lai, X., Tian, Z., Chen, Y., Li, Y., Yuan, Y., Liu, S., & Jia, J. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.00915 · Cited by 466
Parameter-efficient Multi-task Fine-tuning for Transformers via Shared Hypernetworks
Mahabadi, R. K., Ruder, S., Dehghani, M., & Henderson, J. (2021) · Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2021.acl-long.47 · Cited by 462
Variational Reasoning for Question Answering With Knowledge Graph
Zhang, Y., Dai, H., Kozareva, Z., Smola, A., & Song, L. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12057 · Cited by 462
The Value of Semantic Parse Labeling for Knowledge Base Question Answering
Yih, W.-T., Richardson, M., Meek, C., Chang, M.-W., & Suh, J. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p16-2033 · Cited by 461
In-Context Retrieval-Augmented Language Models
Ram, O., Levine, Y., Dalmedigos, I., Muhlgay, D., Shashua, A., Leyton-Brown, K., & Shoham, Y. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00605 · Cited by 449
OpenAssistant Conversations - Democratizing Large Language Model Alignment
Köpf, A., Kilcher, Y., von Rütte, D., Anagnostidis, S., Tam, Z. R., Stevens, K., Barhoum, A., Nguyen, D., Stanley, O., Nagyfi, R., et al. (2023) · neural information processing systems · doi:10.52202/075280-2064 · Cited by 402
LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression
Jiang, H., Wu, Q., Luo, X., Li, D., Lin, C.-Y., Yang, Y., & Qiu, L. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2024.acl-long.91 · Cited by 400
Self-citationA Survey of Large Language Models for Financial Applications: Progress, Prospects and ChallengesPreprint
Nie, Y., Kong, Y., Dong, X., Mulvey, J. M., Poor, H. V., Wen, Q., & Zohren, S. (2024) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.2406.11903 · Cited by 398
Large Language Models for Mathematical Reasoning: Progresses and ChallengesPreprint
Ahn, J., Verma, R., Lou, R., Liu, D., Zhang, R., & Yin, W. (2024) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.48550/arxiv.2402.00157 · Cited by 382
Improving language models by retrieving from trillions of tokens
Borgeaud, S., Mensch, A., Hoffmann, J., Cai, T., Rutherford, E., Millican, K., Driessche, G. V. D., Lespiau, J.-B., Damoc, B., Clark, A., et al. (2021) · arXiv · doi:10.48550/arxiv.2112.04426 · Cited by 382 · cited 1×
“Using feedback from LLMs to guide the training objectives of retrievers can also effectively enhance the retriever’s suitability for LLMs [61, 62, 63].”
MethodMedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoning
Tang, X., Zou, A., Zhang, Z., Li, Z., Zhao, Y., Zhang, X., Cohan, A., & Gerstein, M. (2024) · Findings of the Association for Computational Linguistics ACL 2024 · doi:10.18653/v1/2024.findings-acl.33 · Cited by 376
Sparse, Dense, and Attentional Representations for Text Retrieval
Luan, Y., Eisenstein, J., Toutanova, K., & Collins, M. (2021) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00369 · Cited by 363 · cited 1×
“Numerous studies have explored various methods of blending dense vector indexing with sparse encoder indexing to better capture the semantic information of text blocks and enhance the precision of targeted paragraph retrieval [69, 70, 71].”
MethodPrecise Zero-Shot Dense Retrieval without Relevance Labels
Gao, L., Ma, X., Lin, J., & Callan, J. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.99 · Cited by 362
Precise Zero-Shot Dense Retrieval without Relevance Labels
Gao, L., Ma, X., Lin, J., & Callan, J. (2022) · arXiv · doi:10.48550/arxiv.2212.10496 · Cited by 362
Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions
Trivedi, H., Balasubramanian, N., Khot, T., & Sabharwal, A. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.557 · Cited by 349
Valipour, M., Rezagholizadeh, M., Kobyzev, I., et al. (2022) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.48550/arxiv.2210.07558 · Cited by 337
Large Language Models Are Human-Level Prompt Engineers
Zhou, Y., Muresanu, A. I., Han, Z., Paster, K., Pitis, S., Chan, H., & Ba, J. (2022) · arXiv · doi:10.48550/arxiv.2211.01910 · Cited by 330
FinGPT: Open-Source Financial Large Language Models
Yang, H., Liu, X.-Y., & Wang, C. D. (2023) · arXiv · doi:10.48550/arxiv.2306.06031 · Cited by 326
ASQA: Factoid Questions Meet Long-Form AnswersPreprint
Stelmakh, I., Luan, Y., Dhingra, B., et al. (2022) · Conference on Empirical Methods in Natural Language Processing · doi:10.48550/arxiv.2204.06092 · Cited by 323
Wang, X., Zhu, W., Saxon, M., Steyvers, M., & Wang, W. Y. (2023) · neural information processing systems · doi:10.52202/075280-0687 · Cited by 310
Measuring and Narrowing the Compositionality Gap in Language Models
Press, O., Zhang, M., Min, S., Schmidt, L., Smith, N., & Lewis, M. (2023) · Findings of the Association for Computational Linguistics: EMNLP 2023 · doi:10.18653/v1/2023.findings-emnlp.378 · Cited by 303
Measuring and Narrowing the Compositionality Gap in Language Models
Press, O., Zhang, M., Min, S., Schmidt, L., Smith, N. A., & Lewis, M. (2022) · arXiv · doi:10.48550/arxiv.2210.03350 · Cited by 294 · cited 2×
“…Explicit Facts False HotPotQA[21] 2 - Implicit Facts True 2WikiMultiHopQA[22] 2 - Implicit Facts True MuSiQue[23] 2 - Implicit Facts True Bamboogle[24] 2 - Implicit Facts True StrategyQA[25] 2 - Implicit Facts True ComplexWebQuestions [26] 2 - Implicit Facts True WebQuestions [27] 2 - Implicit…”
BackgroundEfficiently Teaching an Effective Dense Retriever with Balanced Topic Aware Sampling
Hofstätter, S., Lin, S.-C., Yang, J.-H., Lin, J., & Hanbury, A. (2021) · Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3404835.3462891 · Cited by 293
Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Steps
Ho, X., Duong Nguyen, A.-K., Sugawara, S., & Aizawa, A. (2020) · Proceedings of the 28th International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.580 · Cited by 287
♫ MuSiQue: Multihop Questions via Single-hop Question Composition
Trivedi, H., Balasubramanian, N., Khot, T., & Sabharwal, A. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00475 · Cited by 283
Automatic Chain of Thought Prompting in Large Language Models
Zhang, Z., Zhang, A., Li, M., & Smola, A. (2022) · arXiv · doi:10.48550/arxiv.2210.03493 · Cited by 274
ViperGPT: Visual Inference via Python Execution for Reasoning
Surís, D., Menon, S., & Vondrick, C. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01092 · Cited by 273
Towards a Unified View of Parameter-Efficient Transfer Learning
He, J., Zhou, C., Ma, X., Berg-Kirkpatrick, T., & Neubig, G. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.04366 · Cited by 268
Query Rewriting in Retrieval-Augmented Large Language Models
Ma, X., Gong, Y., He, P., Zhao, H., & Duan, N. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.322 · Cited by 263
DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-Correction
Pourreza, M., & Rafiei, D. (2023) · arXiv · doi:10.48550/arxiv.2304.11015 · Cited by 248
Unified Demonstration Retriever for In-Context Learning
Li, X., Lv, K., Yan, H., Lin, T., Zhu, W., Ni, Y., Xie, G., Wang, X., & Qiu, X. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.256 · Cited by 243
Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategies
Geva, M., Khashabi, D., Segal, E., Khot, T., Roth, D., & Berant, J. (2021) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00370 · Cited by 242
Instruction Tuning for Large Language Models: A Survey
Zhang, S., Dong, L., Li, X., Zhang, S., Sun, X., Wang, S., Li, J., Hu, R., Zhang, T., Wu, F., et al. (2023) · arXiv · doi:10.48550/arxiv.2308.10792 · Cited by 241
Retrieval-Augmented Generation for AI-Generated Content: A Survey
Zhao, P., Zhang, H., Yu, Q., Wang, Z., Geng, Y., Fu, F., Yang, L., Zhang, W., Jiang, J., & Cui, B. (2024) · arXiv · doi:10.48550/arxiv.2402.19473 · Cited by 240 · cited 1×
“Yet, research efforts and existing relevant surveys [6, 7, 8, 9, 10, 11, 12, 13] frequently focus on only one of these levels or a particular topic of technologies.”
BackgroundSelf-citationDROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphs
Dua, D., Wang, Y., Dasigi, P., Stanovsky, G., Singh, S., & Gardner, M. (2019) · arXiv · doi:10.48550/arxiv.1903.00161 · Cited by 238
DISC-LawLLM: Fine-tuning Large Language Models for Intelligent Legal ServicesPreprint
Yue, S., Chen, W., Wang, S., Li, B., Shen, C., Liu, S., Zhou, Y., Xiao, Y., Yun, S., Huang, X., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2309.11325 · Cited by 235
Sparse Low-rank Adaptation of Pre-trained Language Models
Ding, N., Lv, X., Wang, Q., Chen, Y., Zhou, B., Liu, Z., & Sun, M. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.252 · Cited by 233
Unified Demonstration Retriever for In-Context LearningPreprint
Li, X., Lv, K., Yan, H., Lin, T., Zhu, W., Ni, Y., Xie, G.-T., Wang, X., & Qiu, X. (2023) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2305.04320 · Cited by 224
Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval
Xiong, L., Xiong, C., Li, Y., Tang, K.-F., Liu, J., Bennett, P., Ahmed, J., & Overwijk, A. (2020) · arXiv · doi:10.48550/arxiv.2007.00808 · Cited by 204
A Multi-Task Embedder For Retrieval Augmented LLMs
Zhang, P., Liu, Z., Xiao, S., Dou, Z., & Nie, J. (2024) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2024.acl-long.194 · Cited by 199
Financial Report Chunking for Effective Retrieval Augmented GenerationPreprint
Yepes, A. J., You, Y., Milczek, J., Laverde, S., & Li, L. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.05131 · Cited by 193
Automatic Prompt Optimization with “Gradient Descent” and Beam Search
Pryzant, R., Iter, D., Li, J., Lee, Y., Zhu, C., & Zeng, M. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.494 · Cited by 191
Automatic Prompt Optimization with "Gradient Descent" and Beam Search
Pryzant, R., Iter, D., Li, J., Lee, Y. T., Zhu, C., & Zeng, M. (2023) · arXiv · doi:10.48550/arxiv.2305.03495 · Cited by 191 · cited 1×
“Recent advancements [118, 119] have also seen the rise of using LLMs themselves to facilitate prompt optimization.”
BackgroundCorrective Retrieval Augmented Generation
Yan, S.-Q., Gu, J.-C., Zhu, Y., & Ling, Z.-H. (2024) · arXiv · doi:10.48550/arxiv.2401.15884 · Cited by 182 · cited 1×
“Additionally, some research focuses on pre-training a small language model dedicated to fact verification, which is used to filter out incorrect retrieved text chunks, thus improving the quality of the recalled text[81].”
BackgroundInstruction Tuning for Large Language Models: A Survey
Zhang, S., Dong, L., Li, X., Zhang, S., Sun, X., Wang, S., Li, J., Hu, R., Zhang, T., Wang, G., et al. (2026) · ACM Computing Surveys · doi:10.1145/3777411 · Cited by 182
(2022) · doi:10.52202/068431-1126 · Cited by 182
Bridging Textual and Tabular Data for Cross-Domain Text-to-SQL Semantic Parsing
Lin, X. V., Socher, R., & Xiong, C. (2020) · Findings of the Association for Computational Linguistics: EMNLP 2020 · doi:10.18653/v1/2020.findings-emnlp.438 · Cited by 181
Learning from models beyond fine-tuning
Zheng, H., Shen, L., Tang, A., Luo, Y., Hu, H., Du, B., Wen, Y., & Tao, D. (2025) · Nature Machine Intelligence · doi:10.1038/s42256-024-00961-0 · Cited by 180
GrIPS: Gradient-free, Edit-based Instruction Search for Prompting Large Language ModelsPreprint
Prasad, A., Hase, P., Zhou, X., & Bansal, M. (2022) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.48550/arxiv.2203.07281 · Cited by 180
Can Generalist Foundation Models Outcompete Special-Purpose Tuning? Case Study in Medicine
Nori, H., Lee, Y. T., Zhang, S., Carignan, D., Edgar, R., Fusi, N., King, N., Larson, J., Li, Y., Liu, W., et al. (2023) · arXiv · doi:10.48550/arxiv.2311.16452 · Cited by 178 · cited 1×
“Some integrated methods, like MedPrompt [143], include GPT-4-generated chains of thought for training examples with self-validation, using these in conjunction with a KNN retrieval in-context learning approach.”
Method(2022) · doi:10.18653/v1/2022.emnlp-main.669 · Cited by 177
Self-citationFrom Matching to Generation: A Survey on Generative Information Retrieval
Li, X., Jin, J., Zhou, Y., Zhang, Y., Zhang, P., Zhu, Y., & Dou, Z. (2025) · ACM Transactions on Information Systems · doi:10.1145/3722552 · Cited by 172 · cited 1×
“Yet, research efforts and existing relevant surveys [6, 7, 8, 9, 10, 11, 12, 13] frequently focus on only one of these levels or a particular topic of technologies.”
BackgroundUnsupervised Dense Information Retrieval with Contrastive Learning
Izacard, G., Caron, M., Hosseini, L., Riedel, S., Bojanowski, P., Joulin, A., & Grave, E. (2021) · arXiv · doi:10.48550/arxiv.2112.09118 · Cited by 172
Knowledge Graph Prompting for Multi-Document Question Answering
Wang, Y., Lipka, N., Rossi, R. A., Siu, A., Zhang, R., & Derr, T. (2023) · arXiv · doi:10.48550/arxiv.2308.11730 · Cited by 170
Enhancing Noise Robustness of Retrieval-Augmented Language Models with Adaptive Adversarial Training
Fang, F., Bai, Y., Ni, S., Yang, M., Chen, X., & Xu, R. (2024) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2024.acl-long.540 · Cited by 169
LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Models
Jiang, H., Wu, Q., Lin, C.-Y., Yang, Y., & Qiu, L. (2023) · arXiv · Cited by 168 · cited 1×
“Most RAG systems use the relevance scores provided by the retriever as the basis for ranking, while some studies employ specific metrics such as perplexity or perplexity gain as ranking criteria [78, 79].”
MethodSelf-citationLLMLingua: Compressing Prompts for Accelerated Inference of Large Language Models
Jiang, H., Wu, Q., Lin, C.-Y., Yang, Y., & Qiu, L. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.825 · Cited by 168
Self-citationTree of Clarifications: Answering Ambiguous Questions with Retrieval-Augmented Large Language Models
Kim, G., Kim, S., Jeon, B., Park, J., & Kang, J. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.63 · Cited by 156
Sparse Low-rank Adaptation of Pre-trained Language Models
Ding, N., Lv, X.-T., Wang, Q., et al. (2023) · Conference on Empirical Methods in Natural Language Processing · doi:10.48550/arxiv.2311.11696 · Cited by 151
Large Language Models as Optimizers
Yang, C., Wang, X., Lu, Y., Liu, H., Le, Q. V., Zhou, D., & Chen, X. (2023) · arXiv · doi:10.48550/arxiv.2309.03409 · Cited by 151
Conversational Health Agents: A Personalized LLM-Powered Agent FrameworkPreprint
Abbasian, M., Azimi, I., Rahmani, A. M., et al. (2023) · arXiv.org · doi:10.48550/arxiv.2310.02374 · Cited by 150
What Makes Good In-Context Examples for GPT-$3$?
Liu, J., Shen, D., Zhang, Y., Dolan, B., Carin, L., & Chen, W. (2021) · arXiv · doi:10.48550/arxiv.2101.06804 · Cited by 148
AssistGPT: A General Multi-modal Assistant that can Plan, Execute, Inspect, and LearnPreprint
Gao, D., Ji, L., Zhou, L., Lin, K. Q., Chen, J., Fan, Z., & Shou, M. Z. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2306.08640 · Cited by 147
Recommendation as Instruction Following: A Large Language Model Empowered Recommendation Approach
Zhang, J., Xie, R., Hou, Y., Zhao, W. X., Lin, L., & Wen, J.-R. (2023) · arXiv · doi:10.48550/arxiv.2305.07001 · Cited by 146
Sawarkar, K., Mangal, A., & Solanki, S. R. (2024) · 2024 IEEE 7th International Conference on Multimedia Information Processing and Retrieval (MIPR) · doi:10.1109/mipr62202.2024.00031 · Cited by 145
Beyond Chain-of-Thought, Effective Graph-of-Thought Reasoning in Language ModelsPreprint
Yao, Y., Li, Z., & Zhao, H. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.16582 · Cited by 142
Enhancing Noise Robustness of Retrieval-Augmented Language Models with Adaptive Adversarial Training
Fang, F.-T., Bai, Y., Ni, S.-W., Yang, M., Chen, X., & Xu, R.-F. (2024) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2405.20978 · Cited by 137
RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Horizon GenerationPreprint
Wang, Z., Liu, A., Lin, H., Li, J., Ma, X., & Liang, Y. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2403.05313 · Cited by 136
Self-citationLarge Language Models Can Be Easily Distracted by Irrelevant Context
Shi, F., Chen, X., Misra, K., Scales, N., Dohan, D., Chi, E., Schärli, N., & Zhou, D. (2023) · arXiv · doi:10.48550/arxiv.2302.00093 · Cited by 134
RLPrompt: Optimizing Discrete Text Prompts with Reinforcement Learning
Deng, M., Wang, J., Hsieh, C.-P., Wang, Y., Guo, H., Shu, T., Song, M., Xing, E., & Hu, Z. (2022) · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2022.emnlp-main.222 · Cited by 132
Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey
Han, Z., Gao, C., Liu, J., Zhang, J., & Zhang, S. Q. (2024) · arXiv · doi:10.48550/arxiv.2403.14608 · Cited by 129
TILDE: Term Independent Likelihood moDEl for Passage Re-ranking
Zhuang, S., & Zuccon, G. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3462922 · Cited by 121
Retrieval-Generation Synergy Augmented Large Language Models
Feng, Z., Feng, X., Zhao, D., Yang, M., & Qin, B. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448015 · Cited by 117
Back to the Future: Towards Explainable Temporal Reasoning with Large Language Models
Yuan, C., Xie, Q., Huang, J., & Ananiadou, S. (2024) · International World Wide Web Conference (WWW) · doi:10.1145/3589334.3645376 · Cited by 115
Conditional Adapters: Parameter-efficient Transfer Learning with Fast Inference
Lei, T., Bai, J., Brahma, S., Ainslie, J., Lee, K., Zhou, Y., Du, N., Zhao, V. Y., Wu, Y., Li, B., et al. (2023) · neural information processing systems · doi:10.52202/075280-0357 · Cited by 109
AdapterSoup: Weight Averaging to Improve Generalization of Pretrained Language Models
Chronopoulou, A., Peters, M. E., Fraser, A. M., et al. (2023) · Findings · doi:10.48550/arxiv.2302.07027 · Cited by 108
Fast Passage Re-ranking with Contextualized Exact Term Matching and Efficient Passage ExpansionPreprint
Zhuang, S., & Zuccon, G. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.08513 · Cited by 105
MLCopilot: Unleashing the Power of Large Language Models in Solving Machine Learning Tasks
Zhang, L., Zhang, Y., Ren, K., Li, D., & Yang, Y. (2024) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2024.eacl-long.179 · Cited by 105
Self-citationAsai, A., Wu, Z., Wang, Y., Sil, A., & Hajishirzi, H. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.11511 · Cited by 101
Tan, H., Sun, F., Yang, W., Wang, Y., Cao, Q., & Cheng, X. (2024) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2024.acl-long.337 · Cited by 99
HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answering
Yang, Z., Qi, P., Zhang, S., Bengio, Y., Cohen, W. W., Salakhutdinov, R., & Manning, C. D. (2018) · arXiv · doi:10.48550/arxiv.1809.09600 · Cited by 97
Unifying Large Language Models and Knowledge Graphs: A RoadmapPreprint
Pan, S., Luo, L., Wang, Y., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2306.08302 · Cited by 97
LeanDojo: Theorem Proving with Retrieval-Augmented Language Models
Yang, K., Swope, A., Gu, A., Chalamala, R., Song, P., Yu, S., Godil, S., Prenger, R. J., & Anandkumar, A. (2023) · Advances in Neural Information Processing Systems 36 · doi:10.52202/075280-0944 · Cited by 97
Generate-then-Ground in Retrieval-Augmented Generation for Multi-hop Question Answering
Shi, Z., Zhang, S., Sun, W., et al. (2024) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2406.14891 · Cited by 96
Text2SQL is Not Enough: Unifying AI and Databases with TAGPreprint
Biswal, A., Patel, L., Jha, S., Kamsetty, A., Liu, S., Gonzalez, J. E., Guestrin, C., & Zaharia, M. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2408.14717 · Cited by 95
TEMPERA: Test-Time Prompting via Reinforcement LearningPreprint
Zhang, T., Wang, X., Zhou, D., Schuurmans, D., & Gonzalez, J. E. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2211.11890 · Cited by 94
Rowen: Adaptive Retrieval-Augmented Generation for Hallucination Mitigation in LLMs
Ding, H., Pang, L., Wei, Z., Shen, H., & Cheng, X. (2025) · Annual International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region (SIGIR-AP) · doi:10.1145/3767695.3769500 · Cited by 89
Zhong, Q., Wang, K., Xu, Z., Ding, L., Liu, J., & Du, B. (2025) · Frontiers of Computer Science · doi:10.1007/s11704-025-41102-z · Cited by 87
Does Fine-Tuning LLMs on New Knowledge Encourage Hallucinations?
Gekhman, Z., Yona, G., Aharoni, R., Eyal, M., Feder, A., Reichart, R., & Herzig, J. (2024) · Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2024.emnlp-main.444 · Cited by 86
OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of Generalization
Iyer, S., Lin, X. V., Pasunuru, R., Mihaylov, T., Simig, D., Yu, P., Shuster, K., Wang, T., Liu, Q., Koura, P. S., et al. (2022) · arXiv · doi:10.48550/arxiv.2212.12017 · Cited by 81
Tan, J., Dou, Z., Zhu, Y., Guo, P., Fang, K., & Wen, J.-R. (2024) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2024.acl-long.242 · Cited by 79
GrIPS: Gradient-free, Edit-based Instruction Search for Prompting Large Language Models
Prasad, A., Hase, P., Zhou, X., & Bansal, M. (2023) · Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2023.eacl-main.277 · Cited by 78
Generative Multi-Modal Knowledge Retrieval with Large Language Models
Long, X., Zeng, J., Meng, F., Ma, Z., Zhang, K., Zhou, B., & Zhou, J. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i17.29837 · Cited by 78
Solving Math Word Problems concerning Systems of Equations with GPT-3
Zong, M., & Krishnamachari, B. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i13.26896 · Cited by 75
DoRA: Weight-Decomposed Low-Rank Adaptation
Liu, S.-Y., Wang, C.-Y., Yin, H., Molchanov, P., Wang, Y.-C. F., Cheng, K.-T., & Chen, M.-H. (2024) · arXiv · doi:10.48550/arxiv.2402.09353 · Cited by 74
Dense X Retrieval: What Retrieval Granularity Should We Use?
Chen, T., Wang, H., Chen, S., Yu, W., Ma, K., Zhao, X., Zhang, H., & Yu, D. (2024) · Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2024.emnlp-main.845 · Cited by 74
Dense X Retrieval: What Retrieval Granularity Should We Use?
Chen, T., Wang, H., Chen, S., Yu, W., Ma, K., Zhao, X., Zhang, H., & Yu, D. (2023) · arXiv · doi:10.48550/arxiv.2312.06648 · Cited by 74
Synchromesh: Reliable code generation from pre-trained language models
Poesia, G., Polozov, O., Le, V., Tiwari, A., Soares, G., Meek, C., & Gulwani, S. (2022) · arXiv · doi:10.48550/arxiv.2201.11227 · Cited by 72 · cited 1×
“In the era of large language models, there has been significant progress in the area of text-to-SQL[105, 106, 107, 108], which allows us to utilize these tools to retrieve information from structured databases.”
MethodGenerate-then-Ground in Retrieval-Augmented Generation for Multi-hop Question Answering
Shi, Z., Zhang, S., Sun, W., Gao, S., Ren, P., Chen, Z., & Ren, Z. (2024) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2024.acl-long.397 · Cited by 72
Selective annotation makes language models better few-shot learners
Su, H., Kasai, J., Wu, C. H., Shi, W., Wang, T., Xin, J., Zhang, R., Ostendorf, M., Zettlemoyer, L., Smith, N. A., et al. (2022) · arXiv · doi:10.48550/arxiv.2209.01975 · Cited by 70
InstructRetro: Instruction Tuning post Retrieval-Augmented PretrainingPreprint
Wang, B., Ping, W., McAfee, L., Xu, P., Li, B., Shoeybi, M., & Catanzaro, B. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.07713 · Cited by 70
Tan, J., Dou, Z.-C., Zhu, Y., Guo, P., Fang, K., & Wen, J.-R. (2024) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2402.12052 · Cited by 67
Chen, J., Xiao, S., Zhang, P., et al. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.03216 · Cited by 65
ASQA: Factoid Questions Meet Long-Form Answers
Stelmakh, I., Luan, Y., Dhingra, B., & Chang, M.-W. (2022) · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2022.emnlp-main.566 · Cited by 63
Tree of Clarifications: Answering Ambiguous Questions with Retrieval-Augmented Large Language ModelsPreprint
Kim, G., Kim, S., Jeon, B., et al. (2023) · Conference on Empirical Methods in Natural Language Processing · doi:10.48550/arxiv.2310.14696 · Cited by 63
Shi, P., Zhang, R., Bai, R. H., & Lin, J. (2022) · Conference on Empirical Methods in Natural Language Processing · doi:10.48550/arxiv.2210.13693 · Cited by 61
In-Context Principle Learning from MistakesPreprint
Zhang, T., Madaan, A., Gao, L., Zheng, S., Mishra, S. R., Yang, Y., Tandon, N., & Alon, U. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.05403 · Cited by 57
Self-citationYang, X., Wang, Z., Wang, Q., Wei, K., Zhang, K., & Shi, J. (2024) · International Journal of Web Information Systems · doi:10.1108/ijwis-12-2023-0256 · Cited by 55
Self-citationKnowledgenavigator: Leveraging large language models for enhanced reasoning over knowledge graph
Guo, T., Yang, Q., Wang, C., Liu, Y., Li, P., Tang, J., Li, D., & Wen, Y. (2024) · Complex & Intelligent Systems · doi:10.1007/s40747-024-01527-8 · Cited by 54
A Survey on RAG Meets LLMs: Towards Retrieval-Augmented Large Language ModelsPreprint
Ding, Y., Fan, W.-Q., Ning, L.-B., Wang, S., Li, H., Yin, D.-W., Chua, T.-S., & Li, Q. (2024) · arXiv.org · doi:10.48550/arxiv.2405.06211 · Cited by 54
Conversational health agents: a personalized large language model-powered agent framework
Abbasian, M., Azimi, I., Rahmani, A. M., & Jain, R. (2025) · JAMIA Open · doi:10.1093/jamiaopen/ooaf067 · Cited by 52
QuALITY: Question Answering with Long Input Texts, Yes!
Pang, R. Y., Parrish, A., Joshi, N., Nangia, N., Phang, J., Chen, A., Padmakumar, V., Ma, J., Thompson, J., He, H., et al. (2022) · Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2022.naacl-main.391 · Cited by 51
FiD-Light: Efficient and Effective Retrieval-Augmented Text Generation
Hofstätter, S., Chen, J., Raman, K., & Zamani, H. (2023) · Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3539618.3591687 · Cited by 51
Off the Beaten Path: Let's Replace Term-Based Retrieval with k-NN Search
Boytsov, L., Novak, D., Malkov, Y., & Nyberg, E. (2016) · Proceedings of the 25th ACM International on Conference on Information and Knowledge Management · doi:10.1145/2983323.2983815 · Cited by 50
Toroghi, A., Guo, W., Pour, M. M. A., & Sanner, S. (2024) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2024.emnlp-main.378 · Cited by 50
When Do Prompting and Prefix-Tuning Work? A Theory of Capabilities and Limitations
Petrov, A., Torr, P. H. S., & Bibi, A. (2023) · Oxford University Research Archive (ORA) (University of Oxford) · doi:10.48550/arxiv.2310.19698 · Cited by 49
Mix-of-Granularity: Optimize the Chunking Granularity for Retrieval-Augmented GenerationPreprint
Zhong, Z., Liu, H., Cui, X., Zhang, X., & Qin, Z. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2406.00456 · Cited by 48
APrompt: Attention Prompt Tuning for Efficient Adaptation of Pre-trained Language Models
Wang, Q., Mao, Y., Wang, J., Yu, H., Nie, S., Wang, S., Feng, F., Huang, L., Quan, X., Xu, Z., et al. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.567 · Cited by 48
AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning
Zhang, Q., Chen, M., Bukharin, A., Karampatziakis, N., He, P., Cheng, Y., Chen, W., & Zhao, T. (2023) · arXiv · doi:10.48550/arxiv.2303.10512 · Cited by 47
Self-Retrieval: End-to-End Information Retrieval with One Large Language Model
Tang, Q., Chen, J., Li, Z., Yu, B., Lu, Y., Fu, C., Yu, H., Lin, H., Huang, F., He, B., et al. (2024) · neural information processing systems · doi:10.52202/079017-2028 · Cited by 47
Agent Hospital: A Simulacrum of Hospital with Evolvable Medical Agents
Li, J., Lai, Y., Li, W., Ren, J., Zhang, M., Kang, X., Wang, S., Li, P., Zhang, Y.-Q., Ma, W., et al. (2024) · arXiv · doi:10.48550/arxiv.2405.02957 · Cited by 46
Question-Based Retrieval using Atomic Units for Enterprise RAG
Raina, V., & Gales, M. (2024) · Fact Extraction and VERification Workshop (FEVER) · doi:10.18653/v1/2024.fever-1.25 · Cited by 41
Knowledge Graph-augmented Language Models for Complex Question Answering
Sen, P., Mavadia, S., & Saffari, A. (2023) · Proceedings of the 1st Workshop on Natural Language Reasoning and Structured Explanations (NLRSE) · doi:10.18653/v1/2023.nlrse-1.1 · Cited by 38
Knowledge Card: Filling LLMs' Knowledge Gaps with Plug-in Specialized Language ModelsPreprint
Feng, S., Shi, W., Bai, Y., Balachandran, V., He, T., & Tsvetkov, Y. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.09955 · Cited by 37
SMoP: Towards Efficient and Effective Prompt Tuning with Sparse Mixture-of-Prompts
Choi, J., Kim, J., Park, J.-H., Mok, W.-L., & Lee, S. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.884 · Cited by 37
The Reversal Curse: LLMs trained on "A is B" fail to learn "B is A"
Berglund, L., Tong, M., Kaufmann, M., Balesni, M., Stickland, A. C., Korbak, T., & Evans, O. (2023) · arXiv · doi:10.48550/arxiv.2309.12288 · Cited by 36
RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval
Sarthi, P., Abdullah, S., Tuli, A., Khanna, S., Goldie, A., & Manning, C. D. (2024) · arXiv · doi:10.48550/arxiv.2401.18059 · Cited by 36 · cited 2×
“Certain methods are designed to ascertain the level of detail a query demands and, based on this identification, select text chunks of appropriate granularity for retrieval[43, 44].”
MethodSimCSE: Simple Contrastive Learning of Sentence EmbeddingsPreprint
Gao, T., Yao, X., & Chen, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.08821 · Cited by 36
Agarwal, R., Singh, A., Zhang, L. M., Bohnet, B., Rosias, L., Chan, S., Zhang, B., Anand, A., Abbas, Z., Nova, A., et al. (2024) · arXiv · doi:10.48550/arxiv.2404.11018 · Cited by 35
ALERT: Adapt Language Models to Reasoning Tasks
Yu, P., Wang, T., Golovneva, O., AlKhamissi, B., Verma, S. S., Jin, Z., Ghosh, G., Diab, M., & Çelikyılmaz, A. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.60 · Cited by 34
ReFT: Reasoning with Reinforced Fine-Tuning
Trung, L., Zhang, X., Jie, Z., Sun, P., Jin, X., & Li, H. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2024.acl-long.410 · Cited by 31
OpenICL: An Open-Source Framework for In-context LearningPreprint
Wu, Z., Wang, Y., Ye, J., Feng, J., Xu, J., Qiao, Y., & Wu, Z. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2303.02913 · Cited by 30
AdapterSoup: Weight Averaging to Improve Generalization of Pretrained Language Models
Chronopoulou, A., Peters, M., Fraser, A., & Dodge, J. (2023) · Findings of the Association for Computational Linguistics: EACL 2023 · doi:10.18653/v1/2023.findings-eacl.153 · Cited by 30
SPT: Learning to Selectively Insert Prompts for Better Prompt Tuning
Zhu, W., & Tan, M. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.727 · Cited by 30
Wu, Z., Hasan, A., Wu, J., Kim, Y., Cheung, J. P. Y., Zhang, T. G., & Wu, H. (2024) · Clinical Natural Language Processing Workshop (ClinicalNLP) · doi:10.18653/v1/2024.clinicalnlp-1.33 · Cited by 29
Generative Retrieval with Semantic Tree-Structured Item Identifiers via Contrastive LearningPreprint
Si, Z., Sun, Z., Chen, J., Chen, G., Zang, X., Zheng, K., Song, Y., Zhang, X., Xu, J., & Gai, K. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2309.13375 · Cited by 28
Guideline Learning for In-Context Information Extraction
Pang, C., Cao, Y., Ding, Q., & Luo, P. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.950 · Cited by 28
Question-Based Retrieval using Atomic Units for Enterprise RAG
Raina, V., & Gales, M. J. F. (2024) · FEVER · doi:10.48550/arxiv.2405.12363 · Cited by 27
RA-DIT: Retrieval-Augmented Dual Instruction Tuning
Lin, X. V., Chen, X., Chen, M., Shi, W., Lomeli, M., James, R., Rodriguez, P., Kahn, J., Szilvasy, G., Lewis, M., et al. (2023) · arXiv · doi:10.48550/arxiv.2310.01352 · Cited by 26
Making Retrieval-Augmented Language Models Robust to Irrelevant Context
Yoran, O., Wolfson, T., Ram, O., & Berant, J. (2023) · arXiv · doi:10.48550/arxiv.2310.01558 · Cited by 26 · cited 1×
“Many studies have shown that by subtly designing training data for RAG systems, fine-tuning or pretraining can effectively mitigate this issue [87, 88, 89].”
BackgroundTan, H.-X., Sun, F., Yang, W.-L., Wang, Y.-Z., Cao, Q., & Cheng, X. (2024) · arXiv.org · doi:10.48550/arxiv.2401.11911 · Cited by 24
MedDM:LLM-executable clinical guidance tree for clinical decision-makingPreprint
Li, B., Meng, T., Shi, X., Zhai, J., & Ruan, T. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2312.02441 · Cited by 23
Yang, H., Li, Z., Zhang, Y., Wang, J., Cheng, N., Li, M., & Xiao, J. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.326 · Cited by 23
Mintaka: A Complex, Natural, and Multilingual Dataset for End-to-End Question AnsweringPreprint
Sen, P., Aji, A. F., & Saffari, A. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2210.01613 · Cited by 21
Shi, P., Zhang, R., Bai, H., & Lin, J. (2022) · Findings of the Association for Computational Linguistics: EMNLP 2022 · doi:10.18653/v1/2022.findings-emnlp.384 · Cited by 21
MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuning
Yue, X., Qu, X., Zhang, G., Fu, Y., Huang, W., Sun, H., Su, Y., & Chen, W. (2023) · arXiv · doi:10.48550/arxiv.2309.05653 · Cited by 21
Clinical assessment of chest pain and guidelines for imaging
Gruettner, J., Henzler, T., Sueselbeck, T., Fink, C., Borggrefe, M. M., & Walter, T. (2011) · European Journal of Radiology · doi:10.1016/j.ejrad.2011.01.063 · Cited by 21
ALERT: Adapt Language Models to Reasoning TasksPreprint
Yu, P., Wang, T.-L., Golovneva, O. Y., AlKhamissi, B., Ghosh, G., Diab, M. T., & Celikyilmaz, A. (2022) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2212.08286 · Cited by 20
Yang, H., Li, Z., Zhang, Y., Wang, J., Cheng, N., Li, M., & Xiao, J. (2023) · arXiv · doi:10.48550/arxiv.2310.18347 · Cited by 18 · cited 1×
“Other efforts involve using LLMs to evaluate the credibility and utility of retrieved text blocks, training a pluggable reward-driven contextual adapter to refine the output of retriever[80].”
MethodA Multi-Task Embedder For Retrieval Augmented LLMsPreprint
Zhang, P., Xiao, S., Liu, Z., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.07554 · Cited by 18
Active Retrieval Augmented Generation
Jiang, Z., Xu, F. F., Gao, L., Sun, Z., Liu, Q., Dwivedi-Yu, J., Yang, Y., Callan, J., & Neubig, G. (2023) · arXiv · doi:10.48550/arxiv.2305.06983 · Cited by 18
Self-citationDou, C., Jin, Z. Q., Jiao, W., Zhao, H., Zhao, Y., & Tao, Z. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.336 · Cited by 17
Text2MDT: Extracting Medical Decision Trees from Medical TextsPreprint
Zhu, W., Li, W., Tian, X., Wang, P., Wang, X., Chen, J., Wu, Y., Ni, Y., & Xie, G. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2401.02034 · Cited by 17
Retrieved In-Context Principles from Previous Mistakes
Sun, H., Jiang, Y., Wang, B., Hou, Y., Zhang, Y., Xie, P., & Huang, F. (2024) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2024.emnlp-main.465 · Cited by 17
Buffer of Thoughts: Thought-Augmented Reasoning with Large Language Models
Yang, L., Yu, Z., Zhang, T., Cao, S., Xu, M., Zhang, W., Gonzalez, J., & Cui, B. (2024) · Advances in Neural Information Processing Systems 37 · doi:10.52202/079017-3607 · Cited by 17
Sun, K., & Dredze, M. H. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2408.06663 · Cited by 16
Min, D., Hu, N., Jin, R., Lin, N., Chen, J., Chen, Y., Li, Y., Qi, G., Li, Y., Li, N., et al. (2024) · Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 6: Industry Track) · doi:10.18653/v1/2024.naacl-industry.41 · Cited by 16
Research works printed but not linked: 14
- Jonathan Berant, Andrew Chou, Roy Frostig, and Percy Liang. Semantic parsing on freebase from question- answer pairs. In Proceedings of the 2013 conference on empirical methods in natural language processing, pages 1533-1544, 2013.
- Ziniu Hu, Ahmet Iscen, Chen Sun, Zirui Wang, Kai-Wei Chang, Yizhou Sun, Cordelia Schmid, David A Ross, and Alireza Fathi. Reveal: Retrieval-augmented visual-language pre-training with multi-source multimodal knowledge memory. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 23369-23379, 2023.
- Junnan Li, Dongxu Li, Caiming Xiong, and Steven Hoi. Blip: Bootstrapping language-image pre-training for unified vision-language understanding and generation. In International conference on machine learning, pages 12888-12900. PMLR, 2022.
- Karen Sparck Jones. A statistical interpretation of term specificity and its application in retrieval. Journal of documentation, 28(1):11-21, 1972.
- Fangyuan Xu, Weijia Shi, and Eunsol Choi. Recomp: Improving retrieval-augmented lms with context com- pression and selective augmentation. In The Twelfth International Conference on Learning Representations, 2024.
- Chaofan Li, Zheng Liu, Shitao Xiao, Yingxia Shao, and Defu Lian. Llama2vec: Unsupervised adaptation of large language models for dense retrieval. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 3490-3500, 2024.
- Xin Cheng, Di Luo, Xiuying Chen, Lemao Liu, Dongyan Zhao, and Rui Yan. Lift yourself up: Retrieval- augmented text generation with self-memory. Advances in Neural Information Processing Systems, 36, 2024.
- Darren Edge, Ha Trinh, Newman Cheng, Joshua Bradley, Alex Chao, Apurva Mody, Steven Truitt, and Jonathan Larson. From local to global: A graph rag approach to query-focused summarization. arXiv.org.
- Haoyang Li, Jing Zhang, Cuiping Li, and Hong Chen. Resdsql: Decoupling schema linking and skeleton parsing for text-to-sql. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 37, pages 13067-13075, 2023.
- Ziwei Ji, Tiezheng Yu, Yan Xu, Nayeon Lee, Etsuko Ishii, and Pascale Fung. Towards mitigating llm hallucination via self reflection. In Findings of the Association for Computational Linguistics: EMNLP 2023, pages 1827-1843, 2023.
- Hangfeng He, Hongming Zhang, and Dan Roth. Socreval: Large language models with the socratic method for reference-free reasoning evaluation. In Findings of the Association for Computational Linguistics: NAACL 2024, pages 2736-2764, 2024.
- Jiacheng Ye, Zhiyong Wu, Jiangtao Feng, Tao Yu, and Lingpeng Kong. Compositional exemplars for in-context learning. In International Conference on Machine Learning, pages 39818-39833. PMLR, 2023.
- Yinheng Li, Shaofei Wang, Han Ding, and Hang Chen. Large language models in finance: A survey. In Proceedings of the fourth ACM international conference on AI in finance, pages 374-382, 2023.
- Yunxiang Li, Zihan Li, Kai Zhang, Ruilong Dan, Steve Jiang, and You Zhang. Chatdoctor: A medical chat model fine-tuned on a large language model meta-ai (llama) using medical domain knowledge. Cureus, 15(6), 2023.
Cited by
Security and Privacy Challenges of Large Language Models: A Survey
Das, B. C., Amini, M. H., & Wu, Y. (2025) · ACM Computing Surveys · doi:10.1145/3712001 · Cited by 445
“This is a sheer violation of the user instructions to be executed, which is the primary goal of prompt injection.”
Abinit 2025: New capabilities for the predictive modeling of solids and nanomaterials
Verstraete, M. J., Abreu, J., Allemand, G. E., Amadon, B., Antonius, G., Azizi, M., Baguet, L., Barat, C., Bastogne, L., Béjaud, R., et al. (2025) · The Journal of Chemical Physics · doi:10.1063/5.0288278 · Cited by 55
Graph-Based Approaches and Functionalities in Retrieval-Augmented Generation: A Comprehensive Survey
Zhu, Z., Huang, T., Wang, K., Ye, J., Chen, X., & Luo, S. (2026) · ACM Computing Surveys · doi:10.1145/3795880 · Cited by 59
Generative AI: driving productivity and scientific breakthroughs in pharmaceutical R&D
Doron, G., Genway, S., Roberts, M., & Jasti, S. (2024) · Drug Discovery Today · doi:10.1016/j.drudis.2024.104272 · Cited by 49
AI agent in healthcare: applications, evaluations, and future directions
Zhao, L., Liu, S., Xin, T., Tan, J., Wang, X., Li, Y., Bian, Z., Chen, Y., Kong, F., Bian, J., et al. (2026) · npj Artificial Intelligence · doi:10.1038/s44387-026-00076-4 · Cited by 50
Metadata
- Authors
- Zhao, S., Yang, Y., Wang, Z., He, Z., Qiu, L. K., & Qiu, L.
- Affiliations
- Microsoft Research Asia (China) (CN)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2024
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2409.14924
- OpenAlex
- W4403796472
- Cited by
- 180
- References
- 118
- Citations by year
- 2026: 73 · 2025: 103 · 2024: 4
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- retrieval-augmented generation, large language models, external data integration, query categorization, contextual integration, fine-tuning, user intent understanding, task decomposition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-14, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-14 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.