The DOI matches its DataCite record; 27 of the 27 references it cites were found in a registry or an index.
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Open accessAbstract
We present the Stanford Question Answering Dataset (SQuAD), a new reading comprehension dataset consisting of 100,000+ questions posed by crowdworkers on a set of Wikipedia articles, where the answer to each question is a segment of text from the corresponding reading passage. We analyze the dataset to understand the types of reasoning required to answer the questions, leaning heavily on dependency and constituency trees. We build a strong logistic regression model, which achieves an F1 score of 51.0%, a significant improvement over a simple baseline (20%). However, human performance (86.8%) is much higher, indicating that the dataset presents a good challenge problem for future research. The dataset is freely available at https://stanford-qa.com
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Many benchmarks use multiple-choice questions for the sake of simplicity (Koto et al. 2024;Rajpurkar et al. 2016).”
From Sacred or Synthetic? Evaluating LLM Reliability and Abstention for Religious Questions (2025) · cites this paper as Rajpurkar et al. 2016
In the citing paper
“We previously pre-registered two studies 5 that made similar hypotheses using a popular Wikipedia Question Answering Task [79].”
From Explanations Can Reduce Overreliance on AI Systems During Decision-Making (2023) · cites this paper as [79]
In the citing paper
“It matches the performance of RoBERTa on GLUE and SQuAD”
From BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension (2020) · cites this paper as Rajpurkar et al., 2016
In the citing paper
“Other metrics such as token-level F 1 score (Rajpurkar et al., 2016), sentence or passage-level AUC (Manakul et al., 2023), and similarity to ground-truth (Wieting et al., 2022) can account for recall as well as precision but require human responses or judgements that serve as a ground-truth.”
From Long-form factuality in large language models (2024) · cites this paper as Rajpurkar et al., 2016
Citations
Cites
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Building a Large Annotated Corpus of English: The Penn Treebank
Marcus, M. (1993) · doi:10.21236/ada273556 · Cited by 7,405
Teaching Machines to Read and ComprehendPreprint
Hermann, K. M., Kočiský, T., Grefenstette, E., Espeholt, L., Kay, W., Suleyman, M., & Blunsom, P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.03340 · Cited by 2,855
Building Watson: An Overview of the DeepQA Project
Ferrucci, D. A., Brown, E. W., Chu‐Carroll, J., Fan, J., Gondek, D. C., Kalyanpur, A. A., Lally, A., Murdock, J. W., Nyberg, E., Prager, J. M., et al. (2010) · AI Magazine · doi:10.1609/aimag.v31i3.2303 · Cited by 1,523
WikiQA: A Challenge Dataset for Open-Domain Question Answering
Yang, Y., Yih, W.-T., & Meek, C. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1237 · Cited by 829
Learning surface text patterns for a Question Answering system
Ravichandran, D., & Hovy, E. H. (2001) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/1073083.1073092 · Cited by 815
MCTest: A Challenge Dataset for the Open-Domain Machine Comprehension of Text
Richardson, M., Burges, C., & Renshaw, E. (2013) · Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1020 · Cited by 778
Building a question answering test collection
Voorhees, E., & Tice, D. M. (2000) · Annual International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/345508.345577 · Cited by 670
Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks
Weston, J., Bordes, A., Chopra, S., Rush, A. M., van Merriënboer, B., Joulin, A., & Mikolov, T. (2015) · arXiv · doi:10.48550/arxiv.1502.05698 · Cited by 670
A Thorough Examination of the CNN/Daily Mail Reading Comprehension Task
Chen, D., Bolton, J., & Manning, C. D. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-1223 · Cited by 494
Cited by
Sorted by citations
Items 101–200 of 710
Multiway Attention Networks for Modeling Sentence Pairs
Tan, C., Wei, F., Wang, W., Lv, W., & Zhou, M. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/613 · Cited by 114
Learning Intrinsic Sparse Structures within Long Short-Term MemoryPreprint
Wen, W., He, Y., Rajbhandari, S., Zhang, M., Wang, W., Liu, F., Hu, B., Chen, Y., & Li, H. H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.05027 · Cited by 126
Neural Domain Adaptation for Biomedical Question Answering
Wiese, G. K., Weissenborn, D., & Neves, M. (2017) · Conference on Computational Natural Language Learning · doi:10.18653/v1/k17-1029 · Cited by 121
Lan, W., & Xu, W. H. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.04330 · Cited by 120
DuoRC: Towards Complex Language Understanding with Paraphrased Reading Comprehension
Saha, A., Aralikatte, R., Khapra, M. M., & Sankaranarayanan, K. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-1156 · Cited by 125
A Survey on Text Classification: From Shallow to Deep LearningPreprint
Li, Q., Peng, H. M., Li, J., Xia, C., Yang, R., Sun, L., Yu, P. S., & He, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.00364 · Cited by 110
TyDi QA: A Benchmark for Information-Seeking Question Answering in Typologically Diverse LanguagesPreprint
Clark, J. H., Choi, E., Collins, M., Garrette, D., Kwiatkowski, T., Nikolaev, V., & Palomaki, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.05002 · Cited by 109
The Effect of Different Writing Tasks on Linguistic Style: A Case Study of the ROC Story Cloze Task
Schwartz, R., Sap, M., Konstas, I., Zilles, L., Choi, Y., & Smith, N. A. (2017) · Conference on Computational Natural Language Learning · doi:10.18653/v1/k17-1004 · Cited by 108
Zero-Shot Cross-Lingual Transfer with Meta Learning
Nooralahzadeh, F., Bekoulis, G., Bjerva, J., & Augenstein, I. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.368 · Cited by 110
Neural Models for Information RetrievalPreprint
Mitra, B., & Craswell, N. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.01509 · Cited by 194
FAQ Retrieval using Query-Question Similarity and BERT-Based Query-Answer Relevance
Sakata, W., Shibata, T., Tanaka, R., & Kurohashi, S. (2019) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3331184.3331326 · Cited by 111
CPM: A large-scale generative Chinese Pre-trained language model
Zhang, Z., Han, X., Zhou, H., Ke, P., Gu, Y., Ye, D., Qin, Y., Su, Y., Ji, H., Guan, J., et al. (2021) · AI Open · doi:10.1016/j.aiopen.2021.07.001 · Cited by 119
Learning to Generate Questions by LearningWhat not to Generate
Liu, B., Zhao, M. M., Niu, D., Lai, K., He, Y., Wei, H., & Xu, Y. (2019) · International World Wide Web Conference (WWW) · doi:10.1145/3308558.3313737 · Cited by 105
Entailment as Few-Shot LearnerPreprint
Wang, S., Fang, H., Khabsa, M., Mao, H., & Ma, H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.14690 · Cited by 194
Warstadt, A., Zhang, Y., Li, H.-S., Liu, H., & Bowman, S. R. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.16 · Cited by 115
A Survey on Machine Reading Comprehension—Tasks, Evaluation Metrics and Benchmark Datasets
Zeng, C., Li, S., Li, Q., Hu, J., & Hu, J. (2020) · Applied Sciences · doi:10.3390/app10217640 · Cited by 117
Backdoor Attacks on Pre-trained Models by Layerwise Weight Poisoning
Li, L., Song, D., Li, X., Zeng, J., Ma, R., & Qiu, X. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.241 · Cited by 145
Learning to Few-Shot Learn Across Diverse Natural Language Classification Tasks
Bansal, T., Jha, R., & McCallum, A. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.448 · Cited by 125
Pretrained Transformers for Text Ranking: BERT and BeyondPreprint
Lin, J., Nogueira, R. F., & Yates, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.06467 · Cited by 101
Accelerating Sparse Deep Neural Networks
Mishra, A., Latorre, J. A., Pool, J., Stosic, D., Stosic, D., Venkatesh, G., Yu, C., & Micikevicius, P. (2021) · arXiv · doi:10.48550/arxiv.2104.08378 · Cited by 97
Multi-Perspective Context Matching for Machine ComprehensionPreprint
Wang, Z., Mi, H., Hamza, W., & Florian, R. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.04211 · Cited by 109
HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answering
Yang, Z., Qi, P., Zhang, S., Bengio, Y., Cohen, W. W., Salakhutdinov, R., & Manning, C. D. (2018) · arXiv · doi:10.48550/arxiv.1809.09600 · Cited by 97
Masked graph modeling for molecule generation
Mahmood, O., Mansimov, E., Bonneau, R., & Cho, K. (2021) · Nature Communications · doi:10.1038/s41467-021-23415-2 · Cited by 98
Learning to Encode Position for Transformer with Continuous Dynamical ModelPreprint
Liu, X., Yu, H., Dhillon, I. S., & Hsieh, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.09229 · Cited by 104
Yang, L., Zhang, M., Li, C., Bendersky, M., & Najork, M. (2020) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3340531.3411908 · Cited by 97
AraELECTRA: Pre-Training Text Discriminators for Arabic Language UnderstandingPreprint
Antoun, W., Baly, F., & Hajj, H. M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.15516 · Cited by 129
S-Net: From Answer Extraction to Answer Generation for Machine Reading ComprehensionPreprint
Tan, C., Wei, F., Yang, N., Du, B., Lv, W., & Zhou, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.04815 · Cited by 91
DCN+: Mixed Objective and Deep Residual Coattention for Question AnsweringPreprint
Xiong, C., Zhong, V., & Socher, R. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.00106 · Cited by 104
Larger-Scale Transformers for Multilingual Masked Language Modeling
Goyal, N., Du, J., Ott, M., Anantharaman, G., & Conneau, A. (2021) · Workshop on Representation Learning for NLP (RepL4NLP) · doi:10.18653/v1/2021.repl4nlp-1.4 · Cited by 121
A Joint Model for Question Answering and Question GenerationPreprint
Wang, T., Yuan, X., & Trischler, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.01450 · Cited by 103
Themis: Fair and Efficient GPU Cluster SchedulingPreprint
Mahajan, K., Balasubramanian, A., Singhvi, A., Venkataraman, S., Akella, A., Phanishayee, A., & Chawla, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.01484 · Cited by 91
Pollux: Co-adaptive Cluster Scheduling for Goodput-Optimized Deep LearningPreprint
Qiao, A., Choe, S. K., Subramanya, S. J., Neiswanger, W., Ho, Q., Zhang, H., Ganger, G. R., & Xing, E. P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.12260 · Cited by 90
Product-Aware Answer Generation in E-Commerce Question-Answering
Gao, S., Ren, Z., Zhao, Y., Zhao, D., Yin, D., & Yan, R. (2019) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3289600.3290992 · Cited by 84
Information fusion in visual question answering: A Survey
Zhang, D., Cao, R., & Wu, S. (2019) · Information Fusion · doi:10.1016/j.inffus.2019.03.005 · Cited by 82
How to Train BERT with an Academic Budget
Izsak, P., Berchansky, M., & Levy, O. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.831 · Cited by 120
Query-Reduction Networks for Question AnsweringPreprint
Seo, M., Min, S., Farhadi, A., & Hajishirzi, H. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.04582 · Cited by 91
Improving Post Training Neural Quantization: Layer-wise Calibration and Integer ProgrammingPreprint
Hubara, I., Nahshan, Y., Hanani, Y., Banner, R., & Soudry, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.10518 · Cited by 166
R$^3$: Reinforced Reader-Ranker for Open-Domain Question AnsweringPreprint
Wang, S., Yu, M., Guo, X., Wang, Z., Klinger, T., Zhang, W., Chang, S., Tesauro, G. J., Zhou, B., & Jiang, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.00023 · Cited by 75
Agentic Large Language Models, a Survey
Plaat, A., Van Duijn, M., Van Stein, N., Preuss, M., Van der Putten, P., & Batenburg, K. J. (2025) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.18675 · Cited by 75
Contrastive Out-of-Distribution Detection for Pretrained Transformers
Zhou, W., Liu, F., & Chen, M. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.84 · Cited by 99
Hamrani, A., Agarwal, A. K., Allouhi, A., & McDaniel, D. (2023) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-023-02171-8 · Cited by 80
MURA Dataset: Towards Radiologist-Level Abnormality Detection in Musculoskeletal RadiographsPreprint
Rajpurkar, P., Irvin, J., Bagul, A., Ding, D. Y., Duan, T., Mehta, H., Yang, B., Zhu, K., Laird, D., Ball, R. L., et al. (2017) · arXiv (Cornell University) · Cited by 83
Self-citationOuyang, X., Wang, S., Pang, C., Sun, Y., Tian, H., Wu, H. R., & Wang, H. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.3 · Cited by 92
Geographic Question Answering: Challenges, Uniqueness, Classification, and Future Directions
Mai, G., Janowicz, K., Zhu, R., Cai, L., & Lao, N. (2021) · AGILE GIScience Series · doi:10.5194/agile-giss-2-8-2021 · Cited by 86
Question Answering as Global Reasoning Over Semantic Abstractions
Khashabi, D., Khot, T., Sabharwal, A., & Roth, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11574 · Cited by 70
Wang, Z., Lan, A., Nie, W., Waters, A. E., Grimaldi, P. J., & Baraniuk, R. G. (2018) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/3231644.3231654 · Cited by 77
InfoBERT: Improving Robustness of Language Models from An Information Theoretic PerspectivePreprint
Wang, B., Wang, S., Cheng, Y., Gan, Z., Jia, R., Li, B., & Liu, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.02329 · Cited by 93
Crowdsourcing Question-Answer Meaning Representations
Michael, J., Stanovsky, G., He, L., Dagan, I., & Zettlemoyer, L. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-2089 · Cited by 69
BERT Learns to Teach: Knowledge Distillation with Meta Learning
Zhou, W., Xu, C., & McAuley, J. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.485 · Cited by 97
Structured Pruning of a BERT-based Question Answering ModelPreprint
McCarley, J. S., Chakravarti, R., & Sil, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.06360 · Cited by 139
ANTIQUE: A Non-factoid Question Answering Benchmark
Hashemi, H., Aliannejadi, M., Zamani, H., & Croft, W. B. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-45442-5_21 · Cited by 77
NewsQA: A Machine Comprehension DatasetPreprint
Trischler, A., Wang, T., Yuan, X., Harris, J., Sordoni, A., Bachman, P., & Suleman, K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.09830 · Cited by 207
DLBench: a comprehensive experimental evaluation of deep learning frameworks
Elshawi, R., Wahab, A., Barnawi, A., & Sakr, S. (2021) · Cluster Computing · doi:10.1007/s10586-021-03240-4 · Cited by 64
Words or Characters? Fine-grained Gating for Reading ComprehensionPreprint
Yang, Z., Dhingra, B., Yuan, Y., Hu, J., Cohen, W. W., & Salakhutdinov, R. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01724 · Cited by 66
Interpreting Attention Models with Human Visual Attention in Machine Reading Comprehension
Sood, E., Tannert, S., Frassinelli, D., Bulling, A., & Vu, N. T. (2020) · Conference on Computational Natural Language Learning · doi:10.18653/v1/2020.conll-1.2 · Cited by 66
To err is human, not algorithmic – Robust reactions to erring algorithms
Renier, L. A., Mast, M. S., & Bekbergenova, A. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2021.106879 · Cited by 74
FLEX: Unifying Evaluation for Few-Shot NLPPreprint
Bragg, J., Cohan, A., Lo, K., & Beltagy, I. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.07170 · Cited by 69
Evaluation and Benchmarking of LLM Agents: A Survey
Mohammadi, M., Li, Y., Lo, J., & Yip, W. (2025) · Proceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2 · doi:10.1145/3711896.3736570 · Cited by 74
SituatedQA: Incorporating Extra-Linguistic Contexts into QA
Zhang, M. J. Q., & Choi, E. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.586 · Cited by 108
GO FIGURE: A Meta Evaluation of Factuality in Summarization
Gabriel, S., Celikyilmaz, A., Jha, R., Choi, Y., & Gao, J. (2021) · Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021 · doi:10.18653/v1/2021.findings-acl.42 · Cited by 75
KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answering
Yu, D., Zhu, C., Fang, Y., Yu, W., Wang, S., Xu, Y., Ren, X., Yang, Y., & Zeng, M. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.340 · Cited by 72
FELIX: Flexible Text Editing Through Tagging and Insertion
Mallinson, J., Severyn, A., Malmi, E., & Garrido, G. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.111 · Cited by 76
PAIR: Leveraging Passage-Centric Similarity Relation for Improving Dense Passage Retrieval
Ren, R., Lv, S., Qu, Y., Liu, J., Zhao, W. X., She, Q., Wu, H., Wang, H., & Wen, J.-R. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.191 · Cited by 76
Simple and Effective Semi-Supervised Question Answering
Dhingra, B., Danish, D., & Rajagopal, D. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-2092 · Cited by 58
Learning from Task Descriptions
Weller, O., Lourie, N., Gardner, M., & Peters, M. E. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.105 · Cited by 67
MEMEN: Multi-layer Embedding with Memory Networks for Machine ComprehensionPreprint
Pan, B., Li, H., Zhao, Z., Cao, B., Cai, D., & He, X. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.09098 · Cited by 58
XLDA: Cross-Lingual Data Augmentation for Natural Language Inference and Question AnsweringPreprint
Singh, J., McCann, B., Keskar, N. S., Xiong, C., & Socher, R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.11471 · Cited by 81
QuAC : Question Answering in ContextPreprint
Choi, E., He, H., Iyyer, M., Yatskar, M., Yih, W.-T., Choi, Y., Liang, P., & Zettlemoyer, L. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.07036 · Cited by 209
Self-citationOnly Train Once: A One-Shot Neural Network Training And Pruning FrameworkPreprint
Chen, T., Ji, B., Ding, T., Fang, B., Wang, G., Zhu, Z., Liang, L., Shi, Y., Yi, S., & Tu, X. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.07467 · Cited by 63
KERMIT: Generative Insertion-Based Modeling for SequencesPreprint
Chan, W., Kitaev, N., Guu, K., Stern, M., & Uszkoreit, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.01604 · Cited by 64
An Annotated Corpus for Machine Reading of Instructions in Wet Lab Protocols
Kulkarni, C., Xu, W. H., Ritter, A., & Machiraju, R. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-2016 · Cited by 65
Adaptive Document Retrieval for Deep Question Answering
Kratzwald, B., & Feuerriegel, S. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1055 · Cited by 56
Cao, Y. H., Fang, M., & Tao, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.04969 · Cited by 56
Multilingual Extractive Reading Comprehension by Runtime Machine TranslationPreprint
Asai, A., Eriguchi, A., Hashimoto, K., & Tsuruoka, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.03275 · Cited by 59
Learning from others' mistakes: Avoiding dataset biases without modeling themPreprint
Sanh, V., Wolf, T., Belinkov, Y., & Rush, A. M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.01300 · Cited by 69
Tang, N., Fan, J., Li, F., Tu, J., Du, X., Li, G., Madden, S. R., & Ouzzani, M. (2021) · Proceedings of the VLDB Endowment · doi:10.14778/3457390.3457391 · Cited by 80
The Spotlight: A General Method for Discovering Systematic Errors in Deep Learning Models
d'Eon, G., d’Eon, J., Wright, J. R., & Leyton‐Brown, K. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533240 · Cited by 62
A Hierarchical Attention Retrieval Model for Healthcare Question Answering
Zhu, M., Ahuja, A., Wei, W., & Reddy, C. K. A. (2019) · International World Wide Web Conference (WWW) · doi:10.1145/3308558.3313699 · Cited by 56
Embracing data abundance: BookTest Dataset for Reading ComprehensionPreprint
Bajgar, O., Kadlec, R., & Kleindienst, J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.00956 · Cited by 52
InterBERT: Vision-and-Language Interaction for Multi-modal PretrainingPreprint
Lin, J., An, Y., Zhang, Y., Liu, J., Zhou, J., & Yang, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.13198 · Cited by 86
Evaluation of Neural Architectures Trained with Square Loss vs Cross-Entropy in Classification TasksPreprint
Hui, L., & Belkin, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.07322 · Cited by 120
DoQA - Accessing Domain-Specific FAQs via Conversational QA
Campos, J. A., Otegi, A., Soroa, A., Deriu, J., Cieliebak, M., & Agirre, E. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.652 · Cited by 59
Deep learning based question answering system in Bengali
Mayeesha, T. T., Sarwar, A. M., & Rahman, R. M. (2020) · Journal of Information and Telecommunication · doi:10.1080/24751839.2020.1833136 · Cited by 54
Can Neural Networks Understand Logical Entailment?Preprint
Evans, R., Saxton, D., Amos, D., Kohli, P., & Grefenstette, E. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.08535 · Cited by 77
Syn-QG: Syntactic and Shallow Semantic Rules for Question Generation
Dhole, K., & Manning, C. D. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.69 · Cited by 48
Esteva, A., Kale, A., Paulus, R., Hashimoto, K., Yin, W., Radev, D., & Socher, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.09595 · Cited by 48
Dehghani, M., Tay, Y., Gritsenko, A. A., Zhao, Z., Houlsby, N., Diaz, F., Metzler, D., & Vinyals, O. (2021) · arXiv · doi:10.48550/arxiv.2107.07002 · Cited by 48
A pragmatic and intelligent model for sarcasm detection in social media text
Shrivastava, M., & Kumar, S. (2020) · Technology in Society · doi:10.1016/j.techsoc.2020.101489 · Cited by 53
ToD-BERT: Pre-trained Natural Language Understanding for Task-Oriented DialoguesPreprint
Wu, C.-S., Hoi, S. C. H., Socher, R., & Xiong, C. (2020) · arXiv (Cornell University) · Cited by 47
Meta-evaluation of Conversational Search Evaluation Metrics
Liu, Z., Zhou, K., & Wilson, M. L. (2021) · ACM Transactions on Information Systems · doi:10.1145/3445029 · Cited by 50
Cohen, D., Yang, L., & Croft, W. B. (2018) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3209978.3210118 · Cited by 58
Structured pruning of recurrent neural networks through neuron selection
Wen, L., Zhang, X., Bai, H., & Xu, Z. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.11.018 · Cited by 49
Event prediction based on evolutionary event ontology knowledge
Mao, Q., Li, X., Peng, H. M., Li, J., He, D., Guo, S., He, M., & Wang, L. (2020) · Future Generation Computer Systems · doi:10.1016/j.future.2020.07.041 · Cited by 45
Aspect Sentiment Triplet Extraction Using Reinforcement Learning
Yu, S., Nayak, T. K., Majumder, N., & Poria, S. (2021) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3459637.3482058 · Cited by 48
DuReader: a Chinese Machine Reading Comprehension Dataset from Real-world ApplicationsPreprint
He, W. P., Liu, K., Liu, J., Lyu, Y., Zhao, S., Xiao, X., Liu, Y., Wang, Y., Wu, H. R., She, Q., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.05073 · Cited by 85
Reweighted Proximal Pruning for Large-Scale Language RepresentationPreprint
Guo, F.-M., Liu, S., Mungall, F. S., Lin, X., & Wang, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.12486 · Cited by 66
CoCo: Controllable Counterfactuals for Evaluating Dialogue State TrackersPreprint
Li, S., Yavuz, S., Hashimoto, K., Li, J., Niu, T., Rajani, N. F., Yan, X., Zhou, Y., & Xiong, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.12850 · Cited by 57
Survey of Neural Text Representation Models
Babić, K., Martinčić-Ipšić, S., & Meštrović, A. (2020) · Information · doi:10.3390/info11110511 · Cited by 48
Deep scaled dot-product attention based domain adaptation model for biomedical question answering
Du, Y., Pei, B., Zhao, X., & Ji, J. (2019) · Methods · doi:10.1016/j.ymeth.2019.06.024 · Cited by 44
Metadata
- Authors
- Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P.
- Affiliations
- Stanford University (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2016
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1606.05250
- OpenAlex
- W2427527485
- Cited by
- 678
- References
- 27
- Citations by year
- 2026: 6 · 2025: 12 · 2024: 25 · 2023: 28 · 2022: 21 · 2021: 162 · 2020: 164 · 2019: 107 · 2018: 94 · 2017: 46 · 2016: 13
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Keywords
- question answering, reading comprehension, SQuAD, Wikipedia, text segmentation, dependency trees, constituency trees, logistic regression, human performance comparison
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
