The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehension
Open accessAbstract
We present TriviaQA, a challenging reading comprehension dataset containing over 650K question-answer-evidence triples.TriviaQA includes 95K questionanswer pairs authored by trivia enthusiasts and independently gathered evidence documents, six per question on average, that provide high quality distant supervision for answering the questions.We show that, in comparison to other recently introduced large-scale datasets, TriviaQA (1) has relatively complex, compositional questions, (2) has considerable syntactic and lexical variability between questions and corresponding answer-evidence sentences, and (3) requires more cross sentence reasoning to find answers.We also present two baseline algorithms: a featurebased classifier and a state-of-the-art neural network, that performs well on SQuAD reading comprehension.Neither approach comes close to human performance (23% and 40% vs. 80%), suggesting that Trivi-aQA is a challenging testbed that is worth significant future study. 1
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While past benchmarks have measured the ability to retrieve information (Joshi et al., 2017;Yang et al., 2018;Thorne et al., 2018;Dinan et al., 2019;Fan et al., 2019;Mialon et al., 2023), most of these benchmarks focus on retrieving information that can be found easily, and hence have become saturated by recent language models.”
From BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agents (2025) · cites this paper as Joshi et al., 2017
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, these benchmarks primarily feature single-hop questions, which typically do not require multi-step reasoning or iterative retrieval.”
From BrowseComp-Plus: A Fair and Disentangled Evaluation Benchmark for Deep Search Agents (2026) · cites this paper as Joshi et al., 2017
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“On TriviaQA (Joshi et al., 2017) we show results for both the filtered (previously used in retrieval and open-book work) and unfiltered set (previously used in large language model evaluations). In both cases, Chinchilla substantially out performs Gopher .”
From Training Compute-Optimal Large Language Models (2022) · cites this paper as Joshi et al., 2017
The cited source says what the claim attributes to it.
In the citing paper
“strongly outperform recent approaches that use specialised pre-training objectives on TriviaQA [24].”
From Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks (2020) · cites this paper as [24]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“One reason to focus on imitative falsehoods is that they are less likely to be covered by existing question-answering benchmarks (Clark et al., 2018; Kwiatkowski et al., 2019; Joshi et al., 2017; Hendrycks et al., 2020).”
From TruthfulQA: Measuring How Models Mimic Human Falsehoods (2022) · cites this paper as Joshi et al., 2017
Experimental — accuracy not yet measured
In the citing paper
“LLMs perform better on nearly all datasets, such as on NaturalQuestions [62], WebQuestions [10], and TriviaQA [56].”
From Harnessing the power of llms in practice: a survey on chatGPT and beyond (2024) · cites this paper as [56]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhutdinov, R., Zemel, R., & Bengio, Y. (2015) · arXiv · doi:10.48550/arxiv.1502.03044 · Cited by 8,248
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1264 · Cited by 6,208
Hierarchical Attention Networks for Document Classification
Yang, Z., Yang, D., Dyer, C., He, X., Smola, A. J., & Hovy, E. H. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1174 · Cited by 5,022
Teaching Machines to Read and ComprehendPreprint
Hermann, K. M., Kočiský, T., Grefenstette, E., Espeholt, L., Kay, W., Suleyman, M., & Blunsom, P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.03340 · Cited by 2,855
MS MARCO: A Human Generated MAchine Reading COmprehension Dataset
Bajaj, P., Campos, D., Craswell, N., Deng, L., Gao, J., Liu, X., Majumder, R., McNamara, A., Mitra, B., Nguyen, T., et al. (2016) · arXiv · doi:10.48550/arxiv.1611.09268 · Cited by 2,473
Bidirectional Attention Flow for Machine ComprehensionPreprint
Seo, M. J., Kembhavi, A., Farhadi, A., & Hajishirzi, H. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01603 · Cited by 1,698
Semantic Parsing on Freebase from Question-Answer Pairs
Berant, J., Chou, A., Frostig, R., & Liang, P. (2013) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d13-1160 · Cited by 1,593
Building Watson: An Overview of the DeepQA Project
Ferrucci, D. A., Brown, E. W., Chu‐Carroll, J., Fan, J., Gondek, D. C., Kalyanpur, A. A., Lally, A., Murdock, J. W., Nyberg, E., Prager, J. M., et al. (2010) · AI Magazine · doi:10.1609/aimag.v31i3.2303 · Cited by 1,523
Modeling Relations and Their Mentions without Labeled Text
Riedel, S., Yao, L., & McCallum, A. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15939-8_10 · Cited by 1,333
Knowledge-Based Weak Supervision for Information Extraction of Overlapping Relations
Hoffmann, R., Zhang, C., Ling, X., Zettlemoyer, L., & Weld, D. S. (2011) · Cited by 878
Self-citation
Research works printed but not linked: 7
- Jordan Boyd-Graber, Brianna Satinoff, He He, and Hal Daumé III. 2012. Besting the quiz master: Crowdsourcing incremental classification games. In Proceedings of the 2012 Joint Con- ference on Empirical Methods in Natural Lan- guage Processing and Computational Natural Lan- guage Learning. Association for Computational Linguistics, Jeju Island, Korea, pages 1290-1301. http://www.aclweb.org/anthology/D12-1118.
- Danqi Chen, Jason Bolton, and Christopher D. Man- ning. 2016. A thorough examination of the cnn/daily mail reading comprehension task. In Pro- ceedings of the 54th Annual Meeting of the As- sociation for Computational Linguistics (Volume 1: Long Papers). Association for Computational Linguistics, Berlin, Germany, pages 2358-2367. http://www.aclweb.org/anthology/P16-1223.
- Takeshi Onishi, Hai Wang, Mohit Bansal, Kevin Gim- pel, and David McAllester. 2016. Who did what: A large-scale person-centered cloze dataset. In Pro- ceedings of the 2016 Conference on Empirical Meth- ods in Natural Language Processing. Association for Computational Linguistics, Austin, Texas, pages 2230-2235. https://aclweb.org/anthology/D16- 1241.
- Denis Paperno, Germán Kruszewski, Angeliki Lazari- dou, Ngoc Quan Pham, Raffaella Bernardi, San- dro Pezzelle, Marco Baroni, Gemma Boleda, and Raquel Fernandez. 2016. The lambada dataset: Word prediction requiring a broad discourse con- text. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Vol- ume 1: Long Papers). Association for Computa- tional Linguistics, Berlin, Germany, pages 1525- 1534. http://www.aclweb.org/anthology/P16-1144.
- Panupong Pasupat and Percy Liang. 2015. Com- positional semantic parsing on semi-structured ta- bles. In Proceedings of the 53rd Annual Meet- ing of the Association for Computational Lin- guistics and the 7th International Joint Confer- ence on Natural Language Processing of the Asian Federation of Natural Language Process- ing, ACL 2015, July 26-31, 2015, Beijing, China, Volume 1: Long Papers. pages 1470-1480. http://aclweb.org/anthology/P/P15/P15-1142.pdf.
- Hai Wang, Mohit Bansal, Kevin Gimpel, and David McAllester. 2015. Machine comprehension with syntax, frames, and semantics. In Proceedings of the 53rd Annual Meeting of the Association for Compu- tational Linguistics and the 7th International Joint Conference on Natural Language Processing (Vol- ume 2: Short Papers). Association for Computa- tional Linguistics, Beijing, China, pages 700-706. http://www.aclweb.org/anthology/P15-2115.
- Zichao Yang, Diyi Yang, Chris Dyer, Xiaodong He, Alex Smola, and Eduard Hovy. 2016. Hierar- chical attention networks for document classifica- tion. In Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Lin- guistics, San Diego, California, pages 1480-1489. http://www.aclweb.org/anthology/N16-1174.
Cited by
Sorted by citations
Items 701–800 of 1,088
CAiRE in DialDoc21: Data Augmentation for Information Seeking Dialogue System
Xu, Y., Ishii, E., Winata, G. I., Lin, Z., Madotto, A., Liu, Z., Xu, P., & Fung, P. (2021) · doi:10.18653/v1/2021.dialdoc-1.6 · Cited by 11
Mahbub, M., Begoli, E., Martins, S. B., Peluso, A., Tamang, S. R., & Peterson, G. D. (2023) · IEEE Access · doi:10.1109/access.2023.3235265 · Cited by 9
BERT-CNN based evidence retrieval and aggregation for Chinese legal multi-choice question answering
Li, Y., Wu, J., & Luo, X. (2024) · Neural Computing and Applications · doi:10.1007/s00521-023-09380-5 · Cited by 10
Retrieve What You Need: A Mutual Learning Framework for Open-domain Question Answering
Wang, D., Huang, Q., Jackson, M., & Gao, J. (2024) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00646 · Cited by 13
Unleashing Potential of Evidence in Knowledge-Intensive Dialogue Generation
Wu, X., Yang, J., Li, T., Zhang, S., Du, Y., Chai, L., Liang, D., & Li, Z. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890206 · Cited by 10
HeterRAG: Heterogeneous Processing-in-Memory Acceleration for Retrieval-augmented Generation
Liu, C., Liu, H., Chen, D., Huang, Y., Zhang, Y., Xiao, W., Liao, X., & Jin, H. (2025) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1145/3695053.3731089 · Cited by 16
“Datasets and Knowledge Base: We choose four question answering datasets commonly used in knowledge-intensive open domains: Wiki-QA (WIKI) [86], Web Questions (WEB) [6], Natural Questions (NQ) [42], and Trivia-QA (TQ) [37].”
SAGE: A Framework of Precise Retrieval for RAG
Zhang, J., Li, G., & Su, J. (2025) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde65448.2025.00108 · Cited by 10
Aligning Open IE Relations and KB Relations using a Siamese Network Based on Word Embedding
Putri, R. A., Hong, G., & Myaeng, S.-H. (2019) · International Conference on Computational Semantics (IWCS) · doi:10.18653/v1/w19-0412 · Cited by 10
Constructing Arabic Reading Comprehension Datasets: Arabic WikiReading and KaifLematha
Albilali, E., Al-Twairesh, N., & Hosny, M. (2022) · Language Resources and Evaluation · doi:10.1007/s10579-022-09577-5 · Cited by 14
Re-Examining Calibration: The Case of Question Answering
Si, C., Zhao, C., Min, S., & Boyd-Graber, J. L. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.204 · Cited by 31
Drilling Down into the Discourse Structure with LLMs for Long Document Question Answering
Nair, I., Somasundaram, S., Saxena, A., & Goswami, K. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.972 · Cited by 18
ReadTwice: Reading Very Large Documents with Memories
Zemlyanskiy, Y., Ainslie, J., de Jong, M., Pham, P., Eckstein, I., & Sha, F. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.408 · Cited by 15
Multi-Task Dense Retrieval via Model Uncertainty Fusion for Open-Domain Question Answering
Li, M., Li, M., Xiong, K., & Lin, J. (2021) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2021.findings-emnlp.26 · Cited by 13
Open-Domain Why-Question Answering with Adversarial Learning to Encode Answer Texts
Oh, J., Kadowaki, K., Kloetzer, J., Iida, R., & Torisawa, K. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1414 · Cited by 10
Learning a Cost-Effective Annotation Policy for Question Answering
Kratzwald, B., Feuerriegel, S., & Sun, H. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.246 · Cited by 13
Multi-Passage Machine Reading Comprehension with Cross-Passage Answer VerificationPreprint
Wang, Y., Liu, K., Liu, J., He, W. P., Lyu, Y., Wu, H. R., Li, S., & Wang, H. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.02220 · Cited by 10
Multi-style Generative Reading ComprehensionPreprint
Nishida, K., Saito, I., Nishida, K., Shinoda, K., Otsuka, A., Asano, H., & Tomita, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.02262 · Cited by 10
Conversations with Search Engines.Preprint
Ren, P., Chen, Z., Ren, Z., Kanoulas, E., Monz, C., & de Rijke, M. (2020) · arXiv (Cornell University) · Cited by 10
Knowledge-Aided Open-Domain Question AnsweringPreprint
Zhou, M., Shi, Z., Huang, M., & Zhu, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.05244 · Cited by 15
Qin, Y., Lin, Y., Takanobu, R., Liu, Z., Li, P., Ji, H., Huang, M., Sun, M., & Zhou, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.15022 · Cited by 10
A Survey On Neural Word EmbeddingsPreprint
Sezerer, E., & Tekır, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.01804 · Cited by 23
More Than Reading Comprehension: A Survey on Datasets and Metrics of Textual Question AnsweringPreprint
Bai, Y., & Wang, D. Z. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.12264 · Cited by 19
Conformity in large language models
Zhu, X., Zhang, C., Stafford, T., Collier, N., & Vlachos, A. (2025) · Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2025.acl-long.195 · Cited by 10
Foreseeing the Benefits of Incidental Supervision
He, H., Zhang, M., Ning, Q., & Roth, D. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.134 · Cited by 12
A Unified Encoder-Decoder Framework with Entity Memory
Zhang, Z., Yu, W., Zhu, C., & Jiang, M. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.43 · Cited by 13
Efficient Transformer Knowledge Distillation: A Performance Review
Brown, N., Williamson, A., Anderson, T., & Lawrence, L. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-industry.6 · Cited by 12
Castells, P., & Jannach, D. (2024) · ACM eBooks · doi:10.1145/3674127.3674131 · Cited by 10
DAOP: Data-Aware Offloading and Predictive Pre-Calculation for Efficient MoE Inference
Zhang, Y., Aggarwal, S., & Mitra, T. (2025) · Design, Automation, and Test in Europe · doi:10.23919/date64628.2025.10992741 · Cited by 9
Yu, Q., Xiao, Z., Li, B., Wang, Z., Chen, C., & Zhang, W. (2025) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3726302.3730288 · Cited by 29
“Trivi-aQA [17] consists of trivia questions that require evidence-based answers.”
MASTER: A Multi-modal Foundation Model for Human Activity Recognition
Zhu, G., Zhao, D. Y., Li, C., Zhao, M., Zhang, Z., Quan, H., & Ma, H. (2025) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3749511 · Cited by 12
“Pre-training datasets for LLMs typically consist of over 950,000 samples [21], whereas the MMFi dataset contains only approximately 13,700 samples.”
Mucciaccia, S. S., Paixão, T. M., Mutz, F. W., Souza, A. F. D., Badue, C. S., & Oliveira-Santos, T. (2025) · Journal of the Brazilian Computer Society · doi:10.5753/jbcs.2025.5801 · Cited by 10
XCMRC: Evaluating Cross-Lingual Machine Reading Comprehension
Liu, P., Deng, Y., Zhu, C., & Hu, H. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-32233-5_43 · Cited by 9
Open-Domain Question-Answering for COVID-19 and Other Emergent Domains
Levy, S., Mo, K., Xiong, W., & Wang, W. Y. (2021) · Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP) · doi:10.18653/v1/2021.emnlp-demo.30 · Cited by 12
Improving Pre-trained Language Models
Paaß, G., & Giesselbach, S. (2023) · Artificial intelligence: foundations, theory, and algorithms/Artificial intelligence: Foundations, theory, and algorithms · doi:10.1007/978-3-031-23190-2_3 · Cited by 9
Explicit Knowledge Integration for Knowledge-Aware Visual Question Answering about Named Entities
Adjali, O., Grimal, P., Ferret, O., Ghannay, S., & Borgne, H. L. (2023) · International Conference on Multimedia Retrieval · doi:10.1145/3591106.3592227 · Cited by 10
Combo of Thinking and Observing for Outside-Knowledge VQA
Si, Q., Mo, Y., Lin, Z., Ji, H., & Wang, W. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.614 · Cited by 17
Event-Centric Question Answering via Contrastive Learning and Invertible Event Transformation
Lu, J., Tan, X., Pergola, G., Gui, L., & He, Y. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.176 · Cited by 9
A Comprehensive Survey On Efficient Transformers
Elouargui, Y., Zyate, M., Sassioui, A., Chergui, M., Kamili, M. E., & Ouzzif, M. (2023) · International Conference on Wireless Networks and Mobile Communications (WINCOM) · doi:10.1109/wincom59760.2023.10322921 · Cited by 9
Give Me the Facts! A Survey on Factual Knowledge Probing in Pre-trained Language Models
Youssef, P., Koraş, O. A., Li, M., Schlötterer, J., & Seifert, C. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.1043 · Cited by 18
Getting MoRE out of Mixture of Language Model Reasoning Experts
Si, C., Shi, W., Zhao, C., Zettlemoyer, L., & Boyd-Graber, J. L. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.552 · Cited by 32
Self-citationDirectional attention weaving for text-grounded conversational question answering
Li, R., Jiang, Z., Wang, L., Lu, X., & Zhao, M. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.01.056 · Cited by 9
Read and Reason with MuSeRC and RuCoS: Datasets for Machine Reading Comprehension for Russian
Fenogenova, A., Mikhailov, V., & Shevelev, D. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.570 · Cited by 9
Shinoda, K., Sugawara, S., & Aizawa, A. (2021) · doi:10.18653/v1/2021.acl-srw.21 · Cited by 10
On Synthetic Data for Back Translation
Xu, J., Ruan, Y., Bi, W., Huang, G., Shi, S., Chen, L., & Liu, L. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.32 · Cited by 10
Context Generation Improves Open Domain Question Answering
Su, D., Patwary, M. A., Prabhumoye, S., Xu, P., Prenger, R., Shoeybi, M., Fung, P., Anandkumar, A., & Catanzaro, B. (2023) · Findings of the Association for Computational Linguistics: EACL · doi:10.18653/v1/2023.findings-eacl.60 · Cited by 12
A General FOFE-net Framework for Simple and Effective Question Answering over Knowledge BasesPreprint
Wu, D., Nosirova, N., Jiang, H., & Xu, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.12356 · Cited by 9
Query Focused Multi-Document Summarization with Distant SupervisionPreprint
Xu, Y., & Lapata, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.03027 · Cited by 13
Liu, Y., Chowdhury, S., Zhang, C., Caragea, C., & Yu, P. S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.02434 · Cited by 19
Qi, P., Lee, H., Sido, O. T., & Manning, C. D. (2020) · arXiv (Cornell University) · Cited by 11
Biomedical Question Answering: A Comprehensive Review.Preprint
Jin, Q., Yuan, Z. P., Xiong, G., Yu, Q., Tan, C., Chen, M., Huang, S., Liu, X., & Yu, S. (2021) · arXiv (Cornell University) · Cited by 9
Rethinking Search: Making Experts out of DilettantesPreprint
Metzler, D., Tay, Y., Bahri, D., & Najork, M. (2021) · arXiv (Cornell University) · Cited by 9
Self-prompted Chain-of-Thought on Large Language Models for Open-domain Multi-hop Reasoning
Wang, J., Li, J., & Zhao, H. (2023) · Findings of the Association for Computational Linguistics: EMNLP 2023 · doi:10.18653/v1/2023.findings-emnlp.179 · Cited by 9
Distilling Knowledge from Reader to Retriever for Question Answering
Izacard, G., & Grave, É. (2021) · HAL · Cited by 10
Hyperbolic Pre-Trained Language Model
Chen, W., Han, X., Lin, Y., He, K., Xie, R., Zhou, J., Liu, Z., & Sun, M. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3407575 · Cited by 8
GenAIPABench: A Benchmark for Generative AI-based Privacy Assistants
Hamid, A., Samidi, H. R., Pappachan, P., Finin, T., & Yus, R. (2024) · Proceedings on Privacy Enhancing Technologies · doi:10.56553/popets-2024-0081 · Cited by 21
Zhang, C., Wang, B., & Song, D. (2024) · ACM Transactions on Information Systems · doi:10.1145/3677375 · Cited by 8
Building efficient and effective OpenQA systems for low-resource languages
Budur, E., Özçelik, R., Soylu, D., Khattab, O., Güngör, T., & Potts, C. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112243 · Cited by 12
Performance and sustainability of BERT derivatives in dyadic data
Escarda-Fernández, M., Eiras‐Franco, C., Cancela, B., Guijarro‐Berdiñas, B., & Alonso‐Betanzos, A. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.125647 · Cited by 11
A Survey on LLMs: Evolution, Applications, and Future Frontiers
Harsha, K., Kumar, K. T., Sumathi, D., & Jubilson, E. A. (2024) · Studies in computational intelligence · doi:10.1007/978-981-97-8460-8_14 · Cited by 11
A Survey on the Recent Advancements in Human-Centered Dialog Systems
Oruche, R., Goruganthu, S. K., Akula, R., Cheng, X., Goni, M. A., Shibo, B. W., Kee, K. F., Zampieri, M., & Calyam, P. P. (2025) · ACM Computing Surveys · doi:10.1145/3729220 · Cited by 11
A Retrieval-Augmented Generation Method for Question Answering on Airworthiness Regulations
Zheng, T., Shen, S., & Zeng, C. (2025) · Electronics · doi:10.3390/electronics14163314 · Cited by 10
Performance Evaluation of Modern GPU Accelerator-Based Edge Systems: A Holistic Approach
Lee, H., & Kang, P. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3616166 · Cited by 8
“0 [52], natural questions (NQs) [53], and TriviaQA [54].”
Human-Computer Question Answering: The Case for Quizbowl
Boyd-Graber, J. L., Feng, S., & Rodríguez, P. (2018) · The Springer series on challenges in machine learning · doi:10.1007/978-3-319-94042-7_9 · Cited by 8
Evaluation Paradigms in Question Answering
Rodríguez, P., & Boyd-Graber, J. L. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.758 · Cited by 12
Learning as Conversation: Dialogue Systems Reinforced for Information Acquisition
Cai, P., Wan, H., Liu, F., Yu, M., Yu, H. Q., & Joshi, S. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.352 · Cited by 8
Seq2EG: a novel and effective event graph parsing approach for event extraction
Sun, H., Zhou, J., Kong, L., Gu, Y., & Qu, W. (2023) · Knowledge and Information Systems · doi:10.1007/s10115-023-01898-3 · Cited by 9
Leveraging QA Datasets to Improve Generative Data Augmentation
Mekala, D., Vu, T., Schick, T., & Shang, J. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.660 · Cited by 10
Calibrated Interpretation: Confidence Estimation in Semantic Parsing
Stengel-Eskin, E., & Durme, B. V. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00598 · Cited by 18
RoMQA: A Benchmark for Robust, Multi-evidence, Multi-answer Question Answering
Zhong, V., Shi, W., Yih, W.-T., & Zettlemoyer, L. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.470 · Cited by 15
Self-citationTriSampler: A Better Negative Sampling Principle for Dense Retrieval
Zhen, Y., Shao, Z., Dong, Y., & Tang, J. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i8.28779 · Cited by 15
Controlling Risk of Web Question Answering
Su, L., Guo, J., Fan, Y., Lan, Y., & Cheng, X. (2019) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3331184.3331261 · Cited by 10
Enhancing Machine Reading Comprehension With Position Information
Xu, Y., Liu, W., Chen, G., Ren, B., Zhang, S., Gao, S., & Guo, J. H. (2019) · IEEE Access · doi:10.1109/access.2019.2930407 · Cited by 8
Relation Module for Non-Answerable Predictions on Reading Comprehension
Huang, K., Tang, Y., Huang, J., He, X., & Zhou, B. (2019) · Conference on Computational Natural Language Learning · doi:10.18653/v1/k19-1070 · Cited by 11
Commonsense Inference in Natural Language Processing (COIN) - Shared Task Report
Ostermann, S., Zhang, S., Roth, M., & Clark, P. E. (2019) · doi:10.18653/v1/d19-6007 · Cited by 7
Common Sense-Based Reasoning Using External Knowledge for Question Answering
Yang, Y., & Kang, S. (2020) · IEEE Access · doi:10.1109/access.2020.3045762 · Cited by 9
On the Influence of Masking Policies in Intermediate Pre-training
Ye, Q., Li, B. Z., Wang, S., Bolte, B., Ma, H., Yih, W.-T., Ren, X., & Khabsa, M. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.573 · Cited by 10
Yadav, V., Bethard, S. J., & Surdeanu, M. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.363 · Cited by 9
Answer-Aware Question Generation from Tabular and Textual Data using T5
Pandraju, S., & Mahalingam, S. G. (2021) · International Journal of Emerging Technologies in Learning (iJET) · doi:10.3991/ijet.v16i18.25121 · Cited by 10
Instance-adaptive training with noise-robust losses against noisy labels
Jin, L., Song, L., Xu, K., & Yu, D. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.457 · Cited by 11
WDRASS: A Web-scale Dataset for Document Retrieval and Answer Sentence Selection
Zhang, Z., Vu, T., Gandhi, S., Chadha, A., & Moschitti, A. (2022) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3511808.3557678 · Cited by 8
A Survey of Machine Reading Comprehension Methods
Xu, X., Tohti, T., & Hamdulla, A. (2022) · International Conference on Asian Language Processing · doi:10.1109/ialp57159.2022.9961260 · Cited by 8
Diffuser: Efficient Transformers with Multi-Hop Attention Diffusion for Long Sequences
Feng, A., Li, I., Jiang, Y., & Ying, R. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i11.26502 · Cited by 12
The Web Can Be Your Oyster for Improving Language Models
Li, J., Tang, T., Zhao, W. X., Wang, J., Nie, J., & Wen, J.-R. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.46 · Cited by 11
Bai, J., Guo, H., Liu, J., Yang, J., Liang, X., Yan, Z., & Li, Z. (2023) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3583780.3614901 · Cited by 9
IfQA: A Dataset for Open-domain Question Answering under Counterfactual Presuppositions
Yu, W., Jiang, M., Clark, P., & Sabharwal, A. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.515 · Cited by 22
CLER: Cross-task Learning with Expert Representation to Generalize Reading and Understanding
Takahashi, T., Taniguchi, M., Taniguchi, T., & Ohkuma, T. (2019) · Workshop on Machine Reading for Question Answering (MRQA) · doi:10.18653/v1/d19-5824 · Cited by 9
Conclusion-Supplement Answer Generation for Non-Factoid Questions
Nakatsuji, M., & Okui, S. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6373 · Cited by 8
A Few More Examples May Be Worth Billions of Parameters
Kirstain, Y., Lewis, P., Riedel, S., & Levy, O. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.72 · Cited by 21
Learning to Search in Long Documents Using Document StructurePreprint
Geva, M., & Berant, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.03529 · Cited by 11
Understanding Dataset Design Choices for Multi-hop ReasoningPreprint
Chen, J., & Durrett, G. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.12106 · Cited by 17
Addressing Semantic Drift in Question Generation for Semi-Supervised Question AnsweringPreprint
Zhang, S., & Bansal, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.06356 · Cited by 19
Is Your Language Model Ready for Dense Representation Fine-tuning?Preprint
Gao, L., & Callan, J. (2021) · arXiv (Cornell University) · Cited by 9
Beamaggr: Beam aggregation reasoning over multi-source knowledge for multi-hop question answering
Chu, Z., Chen, J., Chen, Q., Wang, H., Zhu, K., Du, X., Yu, W., Liu, M., & Qin, B. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2024.acl-long.67 · Cited by 11
CrossCodeBench: Benchmarking Cross-Task Generalization of Source Code Models
Niu, C., Li, C., Ng, V., & Luo, B. (2023) · 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE) · doi:10.1109/icse48619.2023.00055 · Cited by 11
Wang, S., Zhang, Y., & Nguyen, C.-T. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i17.29885 · Cited by 11
Maximizing discrimination masking for faithful question answering with machine reading
Dong, L., Tang, J., Wang, P., Li, S., & Wang, T. (2024) · Information Processing & Management · doi:10.1016/j.ipm.2024.103915 · Cited by 7
Time-Sensitve Retrieval-Augmented Generation for Question Answering
Wu, F., Liu, L., He, W., Liu, Z., Zhang, Z., Wang, H., & Wang, M. (2024) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3627673.3679800 · Cited by 15
Understanding the Fundamental Design Decisions of Retrieval-Augmented Generation Systems
Zhao, S., Shao, Y., Huang, Y., Song, J., Wan, C., Wan, C., & Ма, Л. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3802824 · Cited by 46
Ju, X., Zhang, D., Li, J., Li, S., & Zhou, G. (2025) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2025.3543080 · Cited by 7
Aligning large language models with human preferences using historical text edits
Majkutewicz, J., & Szymański, J. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113566 · Cited by 9
Metadata
- Authors
- Joshi, M., Choi, E., Weld, D., & Zettlemoyer, L.
- Affiliations
- University of Washington (US)
- Allen Institute for Artificial Intelligence (US)
- Venue
- Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Published
- 2017
- Pages
- 1601-1611
- ISSN
- 0736-587X (ISSN-L)
- OpenAlex
- W2612431505
- Cited by
- 1,690
- References
- 21
- Citations by year
- 2026: 141 · 2025: 205 · 2024: 157 · 2023: 220 · 2022: 204 · 2021: 259 · 2020: 198 · 2019: 190 · 2018: 97 · 2017: 19
- FWCI
- 61.63
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Proceedings of the conference - Association for Computational Linguistics. Meeting (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- IEEE DataPort (cc-by)
- Funders
- Tencent
- Defense Advanced Research Projects Agency (FA8750-13-2-0019, FA8750)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Keywords
- TriviaQA, reading comprehension, distant supervision, trivia questions, SQuAD
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
