Mindful-RAG: A Study of Points of Failure in Retrieval Augmented Generation
Open accessAbstract
Large Language Models (LLMs) are proficient at generating coherent and contextually relevant text but face challenges when addressing knowledge-intensive queries in domain-specific and factual question-answering tasks. Retrieval-augmented generation (RAG) systems mitigate this by incorporating external knowledge sources, such as structured knowledge graphs (KGs). However, LLMs often struggle to produce accurate answers despite access to KG-extracted information containing necessary facts. Our study investigates this dilemma by analyzing error patterns in existing KG-based RAG methods and identifying eight critical failure points. We observed that these errors predominantly occur due to insufficient focus on discerning the question's intent and adequately gathering relevant context from the knowledge graph facts. Drawing on this analysis, we propose the Mindful-RAG approach, a framework designed for intent-based and contextually aligned knowledge retrieval. This method explicitly targets the identified failures and offers improvements in the correctness and relevance of responses provided by LLMs, representing a significant step forward from existing methods.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Existing works still suffer from serious hallucination issues.
“Furthermore, existing works still suffer from serious hallucination issues (Agrawal et al., 2024).”
From Graph-constrained Reasoning: Faithful Reasoning on Knowledge Graphs with Large Language Models (2024) · cites this paper as Agrawal et al., 2024
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
No references could be resolved yet.
Research works printed but not linked: 26
- Z. Ji, N. Lee, R. Frieske, T. Yu, D. Su, Y. Xu, E. Ishii, Y. J. Bang, A. Madotto, and P. Fung, "Survey of hallucination in natural language generation," ACM Computing Surveys, vol. 55, no. 12, pp. 1-38, 2023.
- J. Li, Y. Yuan, and Z. Zhang, "Enhancing llm factual accuracy with rag to counter hallucinations: A case study on domain-specific queries in private knowledge-bases," arXiv preprint arXiv:2403.10446, 2024. · arXiv
- Y. Ding, W. Fan, L. Ning, S. Wang, H. Li, D. Yin, T.-S. Chua, and Q. Li, "A survey on rag meets llms: Towards retrieval-augmented large language models," arXiv preprint arXiv:2405.06211, 2024. · arXiv
- Y. Gao, Y. Xiong, X. Gao, K. Jia, J. Pan, Y. Bi, Y. Dai, J. Sun, and H. Wang, "Retrieval-augmented generation for large language models: A survey," arXiv preprint arXiv:2312.10997, 2023. · arXiv
- G. Agrawal, T. Kumarage, Z. Alghami, and H. Liu, "Can knowl- edge graphs reduce hallucinations in llms?: A survey," arXiv preprint arXiv:2311.07914, 2023. · arXiv
- S. Jeong, J. Baek, S. Cho, S. J. Hwang, and J. C. Park, "Adaptive-rag: Learning to adapt retrieval-augmented large language models through question complexity," arXiv preprint arXiv:2403.14403, 2024. · arXiv
- W.-t. Yih, M. Richardson, C. Meek, M.-W. Chang, and J. Suh, "The value of semantic parse labeling for knowledge base question answer- ing," in Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), 2016, pp. 201-206.
- Y. Tan, D. Min, Y. Li, W. Li, N. Hu, Y. Chen, and G. Qi, "Can chatgpt replace traditional kbqa models? an in-depth analysis of the question answering performance of the gpt llm family," in International Semantic Web Conference. Springer, 2023, pp. 348-367.
- K. Bollacker, C. Evans, P. Paritosh, T. Sturge, and J. Taylor, "Free- base: a collaboratively created graph database for structuring human knowledge," in Proceedings of the 2008 ACM SIGMOD international conference on Management of data, 2008, pp. 1247-1250.
- J. Jiang, K. Zhou, Z. Dong, K. Ye, W. X. Zhao, and J.-R. Wen, "Structgpt: A general framework for large language model to reason over structured data," arXiv preprint arXiv:2305.09645, 2023. · arXiv
- Y. Zhang, H. Dai, Z. Kozareva, A. Smola, and L. Song, "Variational reasoning for question answering with knowledge graph," in Proceedings of the AAAI conference on artificial intelligence, vol. 32, no. 1, 2018.
- J. Baek, A. F. Aji, and A. Saffari, "Knowledge-augmented language model prompting for zero-shot knowledge graph question answering," arXiv preprint arXiv:2306.04136, 2023. · arXiv
- Y. Wu, N. Hu, G. Qi, S. Bi, J. Ren, A. Xie, and W. Song, "Retrieve- rewrite-answer: A kg-to-text enhanced llms framework for knowledge graph question answering," arXiv preprint arXiv:2309.11206, 2023. · arXiv
- L. Luo, Y.-F. Li, G. Haffari, and S. Pan, "Reasoning on graphs: Faith- ful and interpretable large language model reasoning," arXiv preprint arXiv:2310.01061, 2023. · arXiv
- S. Siriwardhana, R. Weerasekera, E. Wen, T. Kaluarachchi, R. Rana, and S. Nanayakkara, "Improving the domain adaptation of retrieval aug- mented generation (rag) models for open domain question answering," Transactions of the Association for Computational Linguistics, vol. 11, pp. 1-17, 2023.
- T. Zhang, S. G. Patil, N. Jain, S. Shen, M. Zaharia, I. Stoica, and J. E. Gonzalez, "Raft: Adapting language model to domain specific rag," arXiv preprint arXiv:2403.10131, 2024. · arXiv
- A. Asai, Z. Wu, Y. Wang, A. Sil, and H. Hajishirzi, "Self-rag: Learning to retrieve, generate, and critique through self-reflection," arXiv preprint arXiv:2310.11511, 2023. · arXiv
- Y. Mao, X. Dong, W. Xu, Y. Gao, B. Wei, and Y. Zhang, "Fit-rag: Black- box rag with factual information and token reduction," arXiv preprint arXiv:2403.14374, 2024. · arXiv
- B. Abu-Salih, "Domain-specific knowledge graphs: A survey," Journal of Network and Computer Applications, vol. 185, p. 103076, 2021.
- G. Agrawal, Y. Deng, J. Park, H. Liu, and Y.-C. Chen, "Building knowledge graphs from unstructured texts: Applications and impact analyses in cybersecurity education," Information, vol. 13, no. 11, p. 526, 2022.
- X. Tang, Z. Feng, Y. Xiao, M. Wang, T. Ye, Y. Zhou, J. Meng, B. Zhang, and D. Zhang, "Construction and application of an ontology- based domain-specific knowledge graph for petroleum exploration and development," Geoscience Frontiers, vol. 14, no. 5, p. 101426, 2023.
- G. Agrawal, K. Pal, Y. Deng, H. Liu, and C. Baral, "Aiseckg: Knowledge graph dataset for cybersecurity education," AAAI-MAKE 2023: Chal- lenges Requiring the Combination of Machine Learning 2023, 2023.
- J. Delile, S. Mukherjee, A. Van Pamel, and L. Zhukov, "Graph-based retriever captures the long tail of biomedical knowledge," arXiv preprint arXiv:2402.12352, 2024. · arXiv
- G. Agrawal, K. Pal, Y. Deng, H. Liu, and Y.-C. Chen, "Cyberq: Generat- ing questions and answers for cybersecurity education using knowledge graph-augmented llms," in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 38, no. 21, 2024, pp. 23 164-23 172.
- Y. Zhao, Z. Li, and J. Wang, "Lb-kbqa: Large-language-model and bert based knowledge-based question and answering system," arXiv preprint arXiv:2402.05130, 2024. · arXiv
- G. Agrawal, D. Bertsekas, and H. Liu, "Auction-based learning for question answering over knowledge graphs," Information, vol. 14, no. 6, p. 336, 2023.
Cited by
Sorted by citations
Busch, F., Kaibel, L., Nguyen, H., Lemke, T., Ziegelmayer, S., Graf, M., Marka, A. W., Endrös, L., Prucker, P., Spitzl, D., et al. (2025) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-025-01483-w · Cited by 10 · see citing works
Graph-constrained Reasoning: Faithful Reasoning on Knowledge Graphs with Large Language Models
Luo, L., Zhao, Z., Haffari, G., Li, Y.-F., Gong, C., & Pan, S. (2024) · arXiv · doi:10.48550/arxiv.2410.13080 · Cited by 8 · see citing works
- Authors
- Agrawal, G., Kumarage, T., Alghamdi, Z., & Liu, H.
- Affiliations
- Arizona State University (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2024
- Pages
- 607-611
- arXiv
- 2407.12216
- OpenAlex
- W4406892656
- Cited by
- 23
- References
- 0
- Citations by year
- 2026: 9 · 2025: 14
- FWCI
- 6.64
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- International Conference on Foundation and Large Language Models (FLLM) (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Funders
- National Science Foundation (2335666)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- retrieval-augmented generation, knowledge graphs, failure points, ambiguity resolution, user intent understanding, factual question answering, large language models, knowledge retrieval
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
