The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
MultiRAG: A Knowledge-Guided Framework for Mitigating Hallucination in Multi-Source Retrieval Augmented Generation
Abstract
Retrieval Augmented Generation (RAG) has emerged as a promising solution to address hallucination issues in Large Language Models (LLMs). However, the integration of multiple retrieval sources, while potentially more informative, introduces new challenges that can paradoxically exacerbate hallucination problems. These challenges manifest primarily in two aspects: the sparse distribution of multi-source data that hinders the capture of logical relationships and the inherent inconsistencies among different sources that lead to information conflicts. To address these challenges, we propose MultiRAG, a novel framework designed to mitigate hallucination in multi-source retrieval-augmented generation through knowledge-guided approaches. Our framework introduces two key innovations: (1) a knowledge construction module that employs multi-source line graphs to efficiently aggregate logical relationships across different knowledge sources, effectively addressing the sparse data distribution issue; and (2) a sophisticated retrieval module that implements a multi-level confidence calculation mechanism, performing both graph-level and node-level assessments to identify and eliminate unreliable information nodes, thereby reducing hallucinations caused by inter-source inconsistencies. Extensive experiments on four multi-domain query datasets and two multi-hop QA datasets demonstrate that MultiRAG significantly enhances the reliability and efficiency of knowledge retrieval in complex multi-source scenarios. Our code is available in https://github.com/wuwenlong123/MultiRAG.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answering
Yang, Z., Qi, P., Zhang, S., Bengio, Y., Cohen, W., Salakhutdinov, R., & Manning, C. D. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1259 · Cited by 1,804
Unifying Large Language Models and Knowledge Graphs: A Roadmap
Pan, S., Luo, L., Wang, Y., Chen, C., Wang, J., & Wu, X. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3352100 · Cited by 1,376
HaluEval: A Large-Scale Hallucination Evaluation Benchmark for Large Language Models
Li, J., Cheng, X., Zhao, X., Nie, J.-Y., & Wen, J.-R. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.397 · Cited by 343
Self-citationHaluEval: A Large-Scale Hallucination Evaluation Benchmark for Large Language Models
Li, J., Cheng, X., Zhao, W. X., Nie, J.-Y., & Wen, J.-R. (2023) · arXiv · doi:10.48550/arxiv.2305.11747 · Cited by 340
Integrating conflicting data: the role of source dependence
Dong, X. L., Berti-Equille, L., & Srivastava, D. (2009) · Proceedings of the VLDB Endowment · doi:10.14778/1687627.1687690 · Cited by 312
Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Steps
Ho, X., Duong Nguyen, A.-K., Sugawara, S., & Aizawa, A. (2020) · Proceedings of the 28th International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.580 · Cited by 287
A Bayesian approach to discovering truth from conflicting sources for data integration
Zhao, B., Rubinstein, B. I. P., Gemmell, J., & Han, J. (2012) · Proceedings of the VLDB Endowment · doi:10.14778/2168651.2168656 · Cited by 264
Li, X., Xin, D., Lyons, K. B., Meng, W., & Srivastava, D. (2012) · Proceedings of the VLDB Endowment · doi:10.14778/2535568.2448943 · Cited by 247
Knowledge Graph Prompting for Multi-Document Question Answering
Wang, Y., Lipka, N., Rossi, R. A., Siu, A. F., Zhang, R., & Derr, T. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i17.29889 · Cited by 244
Truth discovery with multiple conflicting information providers on the web
Yin, X., Han, J., & Yu, P. S. (2007) · ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1281192.1281309 · Cited by 185
From local to global: a graph rag approach to query-focused summarization
Edge, D., Trinh, H., Cheng, N., Bradley, J., Chao, A., Mody, A., Truitt, S., Metropolitansky, D., Ness, R. O., & Larson, J. (2024) · arXiv · doi:10.48550/arxiv.2404.16130 · Cited by 159
Wang, F., Wan, X., Sun, R., Chen, J., & Arık, S. Ö. (2025) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2025.acl-long.1476 · Cited by 142
RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models
Niu, C., Wu, Y., Zhu, J., Xu, S., Shum, K., Zhong, R., Song, J., & Zhang, T. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2024.acl-long.585 · Cited by 117
Luo, H., E, H., Tang, Z., Peng, S., Guo, Y., Zhang, W., Ma, C., Dong, G., Song, M., Lin, W., et al. (2024) · Findings of the Association for Computational Linguistics ACL 2024 · doi:10.18653/v1/2024.findings-acl.122 · Cited by 88
KAG: Boosting LLMs in Professional Domains via Knowledge Augmented Generation
Liang, L., Bo, Z., Gui, Z., Zhu, Z., Zhong, L., Zhao, P., Sun, M., Zhang, Z., Zhou, J., Chen, W., et al. (2025) · International World Wide Web Conference (WWW) · doi:10.1145/3701716.3715240 · Cited by 72
Self-citationGraph Chain-of-Thought: Augmenting Large Language Models by Reasoning on Graphs
Jin, B., Xie, C., Zhang, J., Roy, K. K., Zhang, Y., Zheng, L., Li, R., Tang, X., Wang, S., Yu, M., et al. (2024) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2024.findings-acl.11 · Cited by 70
Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoning
Luo, L., Li, Y.-F., Haffari, G., & Pan, S. (2023) · arXiv · doi:10.48550/arxiv.2310.01061 · Cited by 56
Metacognitive Retrieval-Augmented Large Language Models
Zhou, Y., Liu, Z., Jin, J., Nie, J., & Dou, Z. (2024) · International World Wide Web Conference (WWW) · doi:10.1145/3589334.3645481 · Cited by 55
HJE: Joint Convolutional Representation Learning for Knowledge Hypergraph Completion
Li, Z., Wang, C., Wang, X., Chen, Z., & Li, J. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3365727 · Cited by 43
Sun, Q., Huang, K., Yang, X., Tong, R., Zhang, K., & Poria, S. (2024) · International World Wide Web Conference (WWW) · doi:10.1145/3589334.3645678 · Cited by 42
Domain-aware multi-truth discovery from conflicting sources
Lin, X., & Chen, L. (2018) · Proceedings of the VLDB Endowment · doi:10.1145/3187009.3177739 · Cited by 40
Retrieval as Attention: End-to-end Learning of Retrieval and Reading within a Single Transformer
Jiang, Z., Gao, L., Wang, Z., Araki, J., Ding, H., Callan, J., & Neubig, G. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.149 · Cited by 37
Large Language Model Enhanced Knowledge Representation Learning: A Survey
Wang, X., Chen, Z., Wang, H., Leong Hou, U., Li, Z., & Guo, W. (2025) · Data Science and Engineering · doi:10.1007/s41019-025-00285-y · Cited by 37
Self-citationScalable and Effective Generative Information Retrieval
Zeng, H., Luo, C., Jin, B., Sarwar, S. M., Wei, T., & Zamani, H. (2024) · Proceedings of the ACM Web Conference 2024 · doi:10.1145/3589334.3645477 · Cited by 32
HyCubE: Efficient Knowledge Hypergraph 3D Circular Convolutional Embedding
Li, Z., Wang, X., Zhao, J., Guo, W., & Li, J. (2025) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2025.3531372 · Cited by 27
Enhancing Complex Question Answering over Knowledge Graphs through Evidence Pattern Retrieval
Ding, W., Li, J., Luo, L., & Qu, Y. (2024) · International World Wide Web Conference (WWW) · doi:10.1145/3589334.3645563 · Cited by 25
Learning Triple Embeddings from Knowledge Graphs
Fionda, V., & Pirrò, G. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5800 · Cited by 19
Ma, S., Xu, C., Jiang, X., Li, M., Qu, H., Yang, C., Mao, J., & Guo, J. (2024) · arXiv · doi:10.48550/arxiv.2407.10805 · Cited by 12
Leveraging Semantic Information for Enhanced Community Search in Heterogeneous Graphs
Li, Y., Zang, G., Song, C., Yuan, X., & Ge, T. (2024) · Data Science and Engineering · doi:10.1007/s41019-024-00244-z · Cited by 11
Hu, Y., Chen, C., Deng, B., Lai, Y., Lin, H., Zheng, Z., & Bian, J. (2024) · Data Science and Engineering · doi:10.1007/s41019-024-00249-8 · Cited by 8
Benchmark and Neural Architecture for Conversational Entity Retrieval from a Knowledge Graph
Zamiri, M., Qiang, Y., Nikolaev, F., Zhu, D., & Kotov, A. (2024) · International World Wide Web Conference (WWW) · doi:10.1145/3589334.3645676 · Cited by 8
FusionQuery: On-demand Fusion Queries over Multi-source Heterogeneous Data
Zhu, J., Mao, Y., Chen, L., Ge, C., Wei, Z., & Gao, Y. (2024) · Proceedings of the VLDB Endowment · doi:10.14778/3648160.3648174 · Cited by 7
KGFabric: A Scalable Knowledge Graph Warehouse for Enterprise Data Interconnection
Peng, Y., Liang, L., Zhang, D., Chen, Y., Zhu, J., Liu, X., Tang, K., Chen, J., Lin, H., Qiu, L., et al. (2024) · Proceedings of the VLDB Endowment · doi:10.14778/3685800.3685810 · Cited by 6
Self-citation
Research works printed but not linked: 19
- Ouyang, 2022, Training language models to follow instructions with human feedback, Advances in neural information processing systems, 35, 27730
- Lewis, 2020, Retrieval-augmented generation for knowledge-intensive nlp tasks, Advances in Neural Information Processing Systems, 33, 9459
- Guu, 2020, Retrieval augmented language model pre-training, 3929
- Gao, 2023, Retrieval-augmented generation for large language models: A survey, arXiv preprint, 2
- Izacard, 2020, Leveraging passage retrieval with generative models for open domain question answering, arXiv preprint
- Izacard, 2022, Few-shot learning with retrieval augmented language models, arXiv preprint, 2
- Lewis, 2020, Retrieval-augmented generation for knowledge-intensive nlp tasks, Advances in Neural Information Processing Systems, 33, 9459
- Wu, 2025, A cross-domain heterogeneous data query framework via collaboration of large language models and knowledge graphs, Journal of Computer Research and Development, 62, 605
- Wang, 2024, Large language models-guided dynamic adaptation for temporal knowledge graph reasoning, arXiv preprint
- Luo, 2023, Reasoning on graphs: Faithful and interpretable large language model reasoning, arXiv preprint
- Gutiérrez, 2024, Hipporag: Neurobiologically inspired long-term memory for large language models, arXiv preprint
- Mavromatis, 2024, Gnn-rag: Graph neural retrieval for large language model reasoning, arXiv preprint
- Gao, 2025, U-niah: Unified rag and llm evaluation for long context needle-in-a-haystack, arXiv preprint
- Zhang, 2021, Evaluation of knowledge credibility based on knowledge representation learning, Computer Engineering, 47, 44
- Wei, 2022, Chain-of-thought prompting elicits reasoning in large language models, Advances in neural information processing systems, 35, 24824
- Trivedi, 2022, Interleaving retrieval with chain-of-thought reasoning for knowledge-intensive multi-step questions, ArXiv, abs/2212.10509 · arXiv
- 10.1609/aaai.v38i17.29889 · DOI
- Chan, 2024, Rq-rag: Learning to refine queries for retrieval augmented generation, arXiv preprint
- Hu, 2024, Refchecker: Reference-based fine-grained hallucination checker and benchmark for large language models, arXiv preprint
Metadata
- Authors
- Wu, W., Wang, H., Li, B., Huang, P., Zhao, X., & Liang, L.
- Venue
- 2025 IEEE 41st International Conference on Data Engineering (ICDE)
- Publisher
- IEEE
- Published
- 2025-05-19
- Pages
- 3070-3083
- Cited by
- 18
- References
- 33
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.