♫ MuSiQue: Multihop Questions via Single-hop Question Composition
Open accessThe DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Abstract
Multihop reasoning remains an elusive goal as existing multihop benchmarks are known to be largely solvable via shortcuts. Can we create a question answering (QA) dataset that, by construction, requires proper multihop reasoning? To this end, we introduce a bottom–up approach that systematically selects composable pairs of single-hop questions that are connected, that is, where one reasoning step critically relies on information from another. This bottom–up methodology lets us explore a vast space of questions and add stringent filters as well as other mechanisms targeting connected reasoning. It provides fine-grained control over the construction process and the properties of the resulting k-hop questions. We use this methodology to create MuSiQue-Ans, a new multihop QA dataset with 25K 2–4 hop questions. Relative to existing datasets, MuSiQue-Ans is more difficult overall (3× increase in human–machine gap), and harder to cheat via disconnected reasoning (e.g., a single-hop model has a 30-point drop in F1). We further add unanswerable contrast questions to produce a more stringent dataset, MuSiQue-Full. We hope our datasets will help the NLP community develop models that perform genuine multihop reasoning.1
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The majority of existing QA datasets (Rajpurkar et al., 2018; Yang et al., 2018; Trivedi et al., 2022) are designed to answer questions based on short passages.”
From RULER: What's the Real Context Size of Your Long-Context Language Models? (2024) · cites this paper as Trivedi et al., 2022
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Multi-hop QA benchmarks (HotpotQA [52], 2WikiMultiHopQA [16], MuSiQue [42]) and long-document QA such as QuALITY [33] test compositional retrieval and reasoning over a fixed corpus.”
From MemGym: a Long-Horizon Memory Environment for LLM Agents (2026) · cites this paper as [42]
The cited source says what the claim attributes to it.
In the citing paper
“Text and multi-hop QA emphasize evidence tracking and state bookkeeping over intermediate facts (Ho et al., 2020; Trivedi et al., 2022).”
From A Survey of Agent Memory in the Second Half: Towards Self-Evolving and Long-Horizon Agents (2026) · cites this paper as Trivedi et al., 2022
In the citing paper
“RAG is predominantly applied to augment LLMs with large, externally sourced context for individual inference tasks, exemplified by classical multi-hop and knowledge-intensive benchmarks such as HotpotQA (Yang et al., 2018), 2WikiMQA (Ho et al., 2020), and MuSiQue (Trivedi et al., 2022).”
From Memory in the Age of AI Agents (2025) · cites this paper as Trivedi et al., 2022
In the citing paper
“Consequently, a more practical (though not perfectly separable) distinction lies in the task domain . RAG is predominantly applied to augment LLMs with large, externally sourced context for individual inference tasks, exemplified by classical multi-hop and knowledge-intensive benchmarks such as HotpotQA (Yang et al., 2018), 2WikiMQA (Ho et al., 2020), and MuSiQue (Trivedi et al., 2022). By contra”
From Memory in the Age of AI Agents (2025) · cites this paper as Trivedi et al., 2022
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
PyTorch: An Imperative Style, High-Performance Deep Learning Library
Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., et al. (2019) · arXiv · doi:10.48550/arxiv.1912.01703 · Cited by 31,473
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2019) · arXiv · doi:10.48550/arxiv.1910.13461 · Cited by 8,816
Transformers: State-of-the-Art Natural Language Processing
Wolf, T., Debut, L., Sanh, V., Chaumond, J., Delangue, C., Moi, A., Cistac, P., Rault, T., Louf, R., Funtowicz, M., et al. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations · doi:10.18653/v1/2020.emnlp-demos.6 · Cited by 8,741
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1264 · Cited by 6,208 · cited 1×
“We start with 2017K single-hop questions from 5 datasets (SQuAD (Rajpurkar et al., 2016), Natural Questions (Kwiatkowski et al.”
MethodLongformer: The Long-Document Transformer
Beltagy, I., Peters, M. E., & Cohan, A. (2020) · arXiv · doi:10.48550/arxiv.2004.05150 · Cited by 2,281
Know What You Don't Know: Unanswerable Questions for SQuAD
Rajpurkar, P., Jia, R., & Liang, P. (2018) · arXiv · doi:10.48550/arxiv.1806.03822 · Cited by 2,242
Research works printed but not linked: 2
- ElSahar, 2018, T-REx: A large scale alignment of natural language with knowledge base triples
- Talmor, 2021, MultiModalQA: Complex question answering over text, tables and images, 10.18653/v1/N18-1059 · DOI · Paper page
Cited by
Items 301–381 of 381
Yazidi, Y., Garmani, H., & Baslam, M. (2026) · IEEE Access · doi:10.1109/access.2026.3716001
Less is more: a PMA framework for zero-shot multi-hop question answering
Dong, R., Wang, X., Li, S. X., & Li, F. (2026) · Journal of Intelligent Information Systems · doi:10.1007/s10844-026-01081-4
Chansanam, W., Detthamrong, U., & Li, C. (2026) · Iberoamerican Journal of Science Measurement and Communication · doi:10.47909/ijsmc.382
Zhang, T., Wu, J., & Kang, Y. (2026) · Journal of Intelligent Information Systems · doi:10.1007/s10844-026-01077-0
Layered Evidence-Centric Graph Construction for Explainable Multi-hop Question Answering
Zeng, W., Xie, H., Chao, Z., Wu, Q., Liu, H., Li, S., Qu, J., & Li, Z. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-34374-1_10
Budgeted Multi-Hop Retrieval Agents with Evidence-Chain Reliability and Cost-Aware Abstention
Kong, C. (2026) · Journal of Knowledge Learning and Science Technology · doi:10.60087/jklst.vol5.n2.006
Cortex: A Hybrid KG-LLM Approach for Multidocument Question Answering
Zawad, N., & Khan, L. R. (2026) · Communications in computer and information science · doi:10.1007/978-981-92-1546-1_40
NaviRAG: Learning to Navigate Knowledge Graphs for Retrieval-Augmented Generation
Lei, J., Kun, W., Chen, Z., & Xin, Z. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3817935 · Cited by 1
Structure Shapes the Future of DataxLLM Systems: Retrieval, Structuring, and Reasoning
Jiang, P., Sun, J., Kweon, W., & Han, J. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3816461
MCoRe: Multi-Entry Complementary Retrieval with Reflection-Guided Iteration for Multi-Hop QA
Zeng, J., Gao, Z., Hou, Z., Wang, P., Yang, G., Lei, Z., Duan, T., & Tao, J. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818043
Structure Is All You Need to Reuse: Accelerating GraphRAG via Meta-Structure-Aware KV Caching
Luo, R.-K., Gu, C., Yang, J., Liang, H.-M., Gao, Y., Wang, X.-F., He, Q., Wu, S., Yang, L. T., & Jin, H. (2026) · Knowledge Discovery and Data Mining · doi:10.1145/3770855.3817942
Think Less, Act Warranted: Efficient Tool-Integrated Reasoning via Dual-Efficiency Regularization
Xiao, Y., Gong, S., & Yue, L. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3817650 · Cited by 1
Minimal AIF-inspired response control for evidence-aware and dependable LLM behavior
Feng, C., Guo, Y., & Wang, G. (2026) · Computing · doi:10.1007/s00607-026-01723-z
ScholarRAG: Path-Aware Knowledge Graph-Augmented Retrieval for Scholarly QA
Ji, S., Chen, G., Liang, Y., Yuan, C., Lin, R., & Tang, Y. (2026) · Communications in computer and information science · doi:10.1007/978-981-92-0291-1_29
Chen, L., Cheng, L., & Qin, J. (2026) · International Conference on Electronic Information Technology and Computer Engineering (EITCE) · doi:10.1109/eitce70137.2026.11634374
GalaxyRAG: Graph Retrieval-Augmented Generation for Enterprise Knowledge Systems
Tong, B., Zhou, Y., Zhang, C., Yin, Z., & Li, J. (2026) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde65706.2026.00302
Clue-RAG: Towards Accurate and Cost-Efficient Graph-Based RAG Via Multi-Partite Graph-Based Index
Su, Y., Fang, Y., Zhou, Y., & Yang, C. (2026) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde65706.2026.00179
MedHopper: an agentic RAG-LLM system for multi-hop biomedical QA
Taktashov, R., Biziukova, N. Y., Dmitriev, A. V., & Tarasova, O. A. (2026) · Database · doi:10.1093/database/baag047
Sheng, Z., Sun, R., Xu, J., Luo, H., Chen, P., Zhang, W., & Cui, B. (2026) · Proceedings of the VLDB Endowment · doi:10.14778/3819518.3819546
CoverageRAG: Transparent Multi-Entity Comparative Reasoning via Knowledge Graph-Enhanced RAG
Joo, C. (2026) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac69091.2026.00264
JSQKV: Joint Sparsification and Quantization for KV-Cache Compression and Decode Acceleration
Zhang, H., Gong, X., Li, H., Su, H., Chen, Q., & Zhang, J. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-4805-6_5
Yu, Q., Shuang, K., & Li, R. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7346353
Pegasus: Accelerating Large Language Model Inference with Stateful Prefix Caching
Chen, F., Li, P., Yu, D., & Guo, S. (2026) · IEEE International Conference on Joint Cloud Computing (JCC) · doi:10.1109/jcc72984.2026.00017
AdaRAG: Budget-Aware Adaptive Retrieval-Augmented Generation via Hierarchical Reinforcement Learning
Sun, J., Zhang, M., Chen, C., Wei, H., Yin, L., Ai, C., & Yin, B. (2026) · IEEE International Conference on Joint Cloud Computing (JCC) · doi:10.1109/jcc72984.2026.00024
Coverage-Aware Evidence Packing for Budgeted Multi-Hop RAG on Small Language Models
Hamidi, C., Gaou, S., Mohamed, B., Mohamed, B., Boutahir, M. K., & Tribak, H. (2026) · International Conference on Circuit, Systems and Communication (ICCSC) · doi:10.1109/iccsc71566.2026.11650301
HKGC: A Hierarchical Knowledge Graph Construction Framework for Structure-Aware RAG
Guan, Y., Xing, J., Zheng, Z., Zeng, Z., Bai, L., Meng, F., & Guo, H. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-36023-6_30
GS-Chaff: Multi-Agent Prompt-Level Semantic Chaffing for Privacy-Preserving LLM Inference
Zhou, Q., Wang, Z., Yue, Z., Cai, L., Liu, K., & Qin, C. (2026) · Sensors · doi:10.3390/s26175385
Edge-AdaptiveKG: Resource-Efficient Knowledge Graph Construction for RAG on Edge Devices
Du, Y., Niu, J., Xue, C. J., & Guan, N. (2026) · IEEE International Conference on Embedded and Real-Time Computing Systems and Applications (RTCSA) · doi:10.1109/rtcsa71153.2026.00031
Reinforcement learning-guided archival question answering with adaptive curriculum learning
Wu, J., Jiang, R., & Li, Z. (2026) · Scientific Reports · doi:10.1038/s41598-026-67621-8
Enhancing LLMs for Expert Question Answering by Synergizing With Knowledge Graphs
Liu, S., Wu, H., Yi, K., Yang, P., Chen, L., Chen, K., & Yang, Q. (2026) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2026.3731277
Islamaj, R., Leaman, R., Chan, J., Wan, N., Jin, Q., Xie, N., Wilbur, J., Tian, S., Yeganova, L. E., Lai, P.-T., et al. (2026) · Database · doi:10.1093/database/baag057 · Cited by 3
Lin, P., Xu, H., & Yang, J. (2026) · Research Square · doi:10.21203/rs.3.rs-11009751/v1
Enhancing Multi-hop Question Answering with Hierarchical Knowledge Graphs
Zhong, S., Tang, M., Wang, F., Xu, Z., & Xu, H. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38410-2_28
A hybrid quantitative–qualitative RAG approach for territorial well-being decision support
Comiti, G., Bisgambiglia, P.-A., & Lameta, N. (2026) · Machine Learning with Applications · doi:10.1016/j.mlwa.2026.101005
Chaulagain, A., Acharya, D., Shrestha, L., Sherpa, N., & Mansur, J. (2026) · International Conference Computational Vision and Bio Inspired Computing · doi:10.1109/iccvbic71195.2026.11688311
Enabling Retriever-LLM Connection across the Semantic Gap in Retrieval-Augmented Generation
Ye, F., Li, S., Zhang, Y., Chen, L., & Qu, S. (2026) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3847108
AORS: Atomic Operator Driven Structured Reasoning Framework with Dual-Level Retrieval
Zhang, J., Li, W., Zhu, Z., Xie, L., & Zhang, Q. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-5693-8_23
Adaptive Retrieval Over Dual-Layer Graph Memory for Multi-hop Question Answering
Zhao, Y., Chen, Z., Zhang, X., & Li, B. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-5699-0_21
Yan, H., Ma, X., Chen, Y., Yao, S., & Xiang, P. (2026) · Information Processing & Management · doi:10.1016/j.ipm.2026.105212
Unifying Graph-Based Retrieval: A Higher-Order Topological Framework for RAG
Franco, J. L., do Nascimento, E. J. F., Verri, F. A. N., Mesquita, D. P. P., Ponti, M. A., & Júnior, A. H. D. S. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-39882-6_28
CatKV: Accelerating Position-Independent Caching with Context-Adaptive KV Cache Compression
Xu, J., Liu, R., Li, Y., & Tang, B. (2026) · Proceedings of the ACM on Management of Data · doi:10.1145/3837104
Xiao, J.-H., Huang, H.-Y., Yang, Y.-Z., & Guo, C.-H. (2026) · Expert systems with applications · doi:10.1016/j.eswa.2026.134572
Noise-Gated Retrieval: Embedding-Based Context Compression for Cost-Aware RAG
Lavado, A. M., Alcoforado, A., & Costa, A. H. R. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-39892-5_30
Deng, W., Deng, Z., Cheng, C., Mayer, W., Cheng, D., & Feng, Z. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.134639
A critical assessment of the rise of agentic AI, its capabilities, task domains and open challenges
Khan, R. U., Aljuaid, H., & Ning, Z. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-02342-5 · Cited by 3
Lin, P., Xu, H., & Yang, J. (2026) · Research Square · doi:10.21203/rs.3.rs-11009751/v2
Li, Z. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.134640
Ensemble multi-retrieval methodologies with reasoning model decision in multi-step biomedical QA
Jung, J., Hwang, H., Park, Y., Minju, S., Yun, J., Hwang, H., Lee, S., Sohn, J., & Kang, J. (2026) · Database · doi:10.1093/database/baag061
PARM: Passage-Anchored Relation-Aware Multi-Hop Retrieval for Evidence-Grounded Question Answering
Wang, M., Wu, F., Jia, G., Han, L., Shi, R., Zhu, H., Qi, Z., & Xu, F. (2026) · Applied Sciences · doi:10.3390/app16209995
From Digital Library Records to Trust-Grounded Virtual Experts for Knowledge Retention
Ecker, J., Wu, J. F., Allen, B. D., & Nelson, M. L. (2026) · ACM/IEEE Joint Conference on Digital Libraries · doi:10.1145/3805696.3846036
Answer-oriented collaborative distillation for multi-stage evidence-augmented question answering
Wu, Y., Wang, T., Qian, Y., Wu, J., & Wang, K. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.117186
Atawulla, A., Yang, F., Bi, R., Han, B., Han, Y., Liu, X., Yang, Y., & Zhou, X. (2026) · Information Processing & Management · doi:10.1016/j.ipm.2026.105220
TRACE-RLM: Provenance-Aware Recursive Language Models for Conflict-Robust Question AnsweringPreprint
Khan, A., Naseer, F., Afaq, A., & Taj, R. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7615082
Shishir, H. R., Nahar, N., Azad, R. U., Mahmud, T., Hossain, M. S., & Andersson, K. (2026) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2026.088937
Li, Z., Gao, C., Wang, Z., Wang, X., Lu, Y., & You, D. (2026) · Expert Systems · doi:10.1111/exsy.70455
Liu, J., Lee, Z., Cao, S., Zhang, J., Liu, W., Che, X., Hou, L., & Li, J. (2026) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn69854.2026.11728497
Ma, Z., 金效嘉, Zhao, D., Wang, B., & Wang, Y. (2026) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn69854.2026.11728968
Information Geometric Uncertainty Modeling for Agentic Reinforcement Learning
Zhao, W., Hua, J., Wang, X., Wang, H., & Kang, M. (2026) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn69854.2026.11728583
DMG-RAG: Dynamic Multi-Grained Retrieval Augmented Generation for Multi-Hop QA
Pei, Y., Maimaiti, M., Chen, Y., Le, W., Xie, Z., & Chen, J. (2026) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn69854.2026.11729924
Context Selection as a Partial Order: A Blackwell Framework and Verified LLM Evidence
Bilous, A., Lytvyn, V., Pukach, P. Y., & Rybchak, Z. (2026) · Machine Learning and Knowledge Extraction · doi:10.3390/make8100336
StratGraph: A Cost-Efficient Graph-RAG Framework via Structural Stratified Sampling
Yang, C., Liu, C., Yang, Z., & Zhu, W. (2026) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn69854.2026.11729600
Yu, X., Huo, Y., Qin, Y., Feng, F., Liu, G., & Xia, D. (2026) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn69854.2026.11729751
AdaCache: Efficient and Robust Noise-Resistant Semantic Caching for RAG
Chen, S., Zhang, L., & Lee, S.-W. (2026) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn69854.2026.11728681
Connection-Aware Graph Pruning in RAG for Multi-Hop Question Answering
Wu, J., Fan, M., Zhou, W., Ma, C., Liu, X., & Xiong, H. (2026) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn69854.2026.11728489
Conflict-Aware RAG Routing: Balancing Cost and Accuracy via Context Contradiction
Nam, D. P., Tuan, T. H., Long, D. D., & Van, C. (2026) · IEEE International Conference on Intelligent Systems · doi:10.1109/is71416.2026.11727222
SPARE-RAG: Evidence Repair and Verification-Guided Sequential Neural Pruning for Multi-Hop RAG
Guo, Z.-Y., Zhang, Y.-X., Huang, Y.-H., Liu, J.-Y., & Zhang, K. (2026) · Information · doi:10.3390/info17101052
VRR: Verification-Guided Retrieval Revision for Multi-Step QA
Li, Z., Wang, L., Li, T., Han, B., Ahmat, A., Dong, R., & Wang, Z. (2026) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/2026.findings-emnlp.143
A Reinforcement Learning Approach for Mathematical Answer Generation with LLM
Asmani, A., Anggraini, R. N. E., & Purwitasari, D. (2026) · Electrical Power, Electronics, Communications, Controls and Informatics Seminar (EECCIS) · doi:10.1109/eeccis68982.2026.11750895
Hu, Z. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.117231
Benchmark-Defined Adaptive Candidate Reranking for Indonesian Multi-Hop Question Answering
Rahman, I. A., & Wibowo, A. (2026) · Journal of Computing Theories and Applications · doi:10.62411/jcta.18163
Retrieval-Grounded Multi-Agent Planning for Long-Horizon Question Answering
Mohanam, B. N. (2026) · IEEE International Conference on Control System, Computing and Engineering · doi:10.1109/iccsce69880.2026.11750896
RankGap-RAG: Rank-Discrepancy Contrastive Feedback for Multi-Paraphrase Retrieval
Lee, J.-E., Yoon, S., & Lim, H. (2026) · Proceedings of the 35th ACM International Conference on Information and Knowledge Management · doi:10.1145/3799682.3839890
Measuring What RAG Reranking Hides: A Behavioral Framework and the Fragility of Correctness Metrics
Amran, G. A., Sun, S., Qu, J., Yitao, W., & Li, X. (2026) · Communications in computer and information science · doi:10.1007/978-981-92-7652-3_14
Wang, Y. (2026) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3799682.3841081
The Small-Model Graph-RAG Gap Is a Faithfulness Gap
Thomo, J., Srinivasan, V., & Thomo, A. (2026) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3799682.3839910
State-Conditioned Evidence Coalition Selection for Multi-Hop Retrieval-Augmented Question Answering
Jin, X., Du, Y., Li, M., & Wang, B. (2026) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3799682.3840801
Support Selection Survives under Official-Context RAG: A Same-Backbone Boundary Study
Ma, C., Wang, Y., & Li, S. (2026) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3799682.3839932
Forward-Looking Guidance for Iterative RAG in Multi-Hop Question Answering
Cho, J., Park, C., Na, S.-H., & Song, H.-J. (2026) · Proceedings of the 35th ACM International Conference on Information and Knowledge Management · doi:10.1145/3799682.3840073
Eliciting In-context Retrieval and Reasoning for Long-context Large Language Models
Qiu, Y., Embar, V. R., Zhang, Y., Jaitly, N., Cohen, S. B., & Han, B. (2025) · Findings of the Association for Computational Linguistics: ACL 2025 · doi:10.18653/v1/2025.findings-acl.165
Deep Research with Open-Domain Evaluation and Multi-Stage Guardrails for Safety
Huang, W.-C., Zou, H. P., Wu, Y., Li, D., Chen, Y., Zhang, W., Li, Y., Zangari, A., Guo, J., Miao, C., et al. (2025) · arXiv · doi:10.48550/arxiv.2510.10994
Metadata
- Authors
- Trivedi, H., Balasubramanian, N., Khot, T., & Sabharwal, A.
- Affiliations
- Stony Brook University (US)
- Allen Institute for Artificial Intelligence (US)
- Corresponding author
- Trivedi, Harsh
- Balasubramanian, Niranjan
- Khot, Tushar
- Sabharwal, Ashish
- Venue
- Transactions of the Association for Computational Linguistics
- Publisher
- MIT Press
- Published
- 2022
- Volume
- 10
- Pages
- 539-554
- ISSN
- 2307-387X (ISSN-L)
- OpenAlex
- W3190126809
- Cited by
- 283
- References
- 53
- Citations by year
- 2026: 156 · 2025: 75 · 2024: 21 · 2023: 28 · 2022: 3
- FWCI
- 10.45
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Locations
- Transactions of the Association for Computational Linguistics (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (1815358)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- shortcut learning, unanswerable questions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.