Know What You Don’t Know: Unanswerable Questions for SQuAD
Open accessThe DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
Extractive reading comprehension systems can often locate the correct answer to a question in a context document, but they also tend to make unreliable guesses on questions for which the correct answer is not stated in the context.Existing datasets either focus exclusively on answerable questions, or use automatically generated unanswerable questions that are easy to identify.To address these weaknesses, we present SQUADRUN, a new dataset that combines the existing Stanford Question Answering Dataset (SQuAD) with over 50,000 unanswerable questions written adversarially by crowdworkers to look similar to answerable ones.To do well on SQUADRUN, systems must not only answer questions when possible, but also determine when no answer is supported by the paragraph and abstain from answering.SQUADRUN is a challenging natural language understanding task for existing models: a strong neural system that gets 86% F1 on SQuAD achieves only 66% F1 on SQUADRUN.We release SQUADRUN to the community as the successor to SQuAD.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing LoCoMo-style benchmarks evaluate longterm conversational memory by extending question answering paradigms to long dialogue contexts. (Maharana et al., 2024) In practice, queries are augmented with explicit task-type instructions (e.g., indicating that a query tests memory), and model outputs are evaluated using generation-based metrics such as exact match, token-level F1, or ngram overlap”
From Locomo-Plus: Beyond-Factual Cognitive Memory Evaluation Framework for LLM Agents (2026) · cites this paper as Rajpurkar et al., 2018
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“current research works [21, 113, 174, 212, 298] highlight a discrepancy between surface realization and inherent knowledge of the model in NLG tasks.”
From Survey of Hallucination in Natural Language Generation (2023) · cites this paper as [212]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The majority of existing QA datasets (Rajpurkar et al., 2018; Yang et al., 2018; Trivedi et al., 2022) are designed to answer questions based on short passages.”
From RULER: What's the Real Context Size of Your Long-Context Language Models? (2024) · cites this paper as Rajpurkar et al., 2018
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“We found that existing NLP datasets do not cover the wide breadth of possible conversational failure cases due to their emphasis on correct data for training.”
From A Mixed-Methods Approach to Understanding User Trust after Voice Assistant Failures (2023) · cites this paper as [48]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Classic general question answering benchmarks, including SQuAD (Rajpurkar et al., 2018), HotpotQA (Yang et al., 2018), and KILT (Petroni et al., 2021), operate over frozen Wikipedia snapshots, while MS MARCO (Craswell et al., 2021), Natural Questions (Kwiatkowski et al., 2019), SearchQA (Dunn et al., 2017), and TriviaQA (Joshi et al., 2017) replace live information access with pre-collected”
From A Survey of Agent Memory in the Second Half: Towards Self-Evolving and Long-Horizon Agents (2026) · cites this paper as Rajpurkar et al., 2018
Experimental — accuracy not yet measured
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983 · cited 3×
“(2017), and two versions of the DocumentQA No-Answer (DocQA) model from Clark and Gardner (2017), namely versions with and without ELMo (Peters et al., 2018).”
MethodSQuAD: 100,000+ Questions for Machine Comprehension of Text
Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1264 · Cited by 6,208 · cited 5×
“We note that for SQuAD 1.1, Rajpurkar et al. (2016) evaluated a single human’s performance; therefore, they likely underestimate human accuracy.”
BackgroundMethodInfluentialSelf-citationA large annotated corpus for learning natural language inference
Bowman, S. R., Angeli, G., Potts, C., & Manning, C. D. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1075 · Cited by 3,377 · cited 1×
“Similarly, recognizing textual entailment (RTE) requires systems to decide whether a hypothesis is entailed by, contradicted by, or neutral with respect to a premise (Marelli et al., 2014; Bowman et al., 2015).”
BackgroundTeaching Machines to Read and Comprehend
Hermann, K. M., Kočiský, T., Grefenstette, E., Espeholt, L., Kay, W., Suleyman, M., & Blunsom, P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.03340 · Cited by 2,521 · cited 2×
“Machine reading comprehension has become a central task in natural language understanding, fueled by the creation of many large-scale datasets (Hermann et al., 2015; Hewlett et al., 2016; Rajpurkar et al., 2016; Nguyen et al., 2016; Trischler et al., 2017; Joshi et al., 2017).”
BackgroundMS MARCO: A Human Generated MAchine Reading COmprehension Dataset
Bajaj, P., Campos, D., Craswell, N., Deng, L., Gao, J., Liu, X., Majumder, R., McNamara, A., Mitra, B., Nguyen, T., et al. (2016) · arXiv · doi:10.48550/arxiv.1611.09268 · Cited by 2,473 · cited 2×
“Machine reading comprehension has become a central task in natural language understanding, fueled by the creation of many large-scale datasets (Hermann et al., 2015; Hewlett et al., 2016; Rajpurkar et al., 2016; Nguyen et al., 2016; Trischler et al., 2017; Joshi et al., 2017).”
BackgroundMS MARCO: A Human Generated MAchine Reading COmprehension Dataset.
Nguyen, T. G., Rosenberg, M., Xia, S., Gao, J., Tiwary, S., Majumder, R., & Deng, L. (2016) · neural information processing systems · Cited by 1,961
TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehension
Joshi, M., Choi, E., Weld, D., & Zettlemoyer, L. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1147 · Cited by 1,690 · cited 3×
“Machine reading comprehension has become a central task in natural language understanding, fueled by the creation of many large-scale datasets (Hermann et al., 2015; Hewlett et al., 2016; Rajpurkar et al., 2016; Nguyen et al., 2016; Trischler et al., 2017; Joshi et al., 2017).”
BackgroundTriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehension
Joshi, M., Choi, E., Weld, D. S., & Zettlemoyer, L. (2017) · arXiv · doi:10.48550/arxiv.1705.03551 · Cited by 1,650 · cited 3×
“Machine reading comprehension has become a central task in natural language understanding, fueled by the creation of many large-scale datasets (Hermann et al., 2015; Hewlett et al., 2016; Rajpurkar et al., 2016; Nguyen et al., 2016; Trischler et al., 2017; Joshi et al., 2017).”
BackgroundBidirectional Attention Flow for Machine Comprehension
Seo, M. J., Kembhavi, A., Farhadi, A., & Hajishirzi, H. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01603 · Cited by 1,445 · cited 2×
“In turn, these datasets have spurred a diverse array of model architecture improvements (Seo et al., 2016; Hu et al., 2017; Wang et al., 2017; Clark and Gardner, 2017; Huang et al., 2018).”
BackgroundInfluentialAdversarial Examples for Evaluating Reading Comprehension Systems
Jia, R., & Liang, P. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1215 · Cited by 1,410 · cited 6×
“Jia and Liang (2017) created adversarial test examples that fool models trained on SQuAD 1.1.”
BackgroundMethodInfluentialSelf-citation
Research works printed but not linked: 1
- M. Hu, Y. Peng, and X. Qiu. 2017. Rein- forced mnemonic reader for machine comprehen- sion. arXiv .
Cited by
Items 301–400 of 1,049
Linking artificial and human neural representations of language
Gauthier, J., & Levy, R. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1050 · Cited by 70
CJRC: A Reliable Human-Annotated Benchmark DataSet for Chinese Judicial Reading Comprehension
Duan, X., Wang, B., Wang, Z., Ma, W., Cui, Y., Wu, D., Wang, S., Liu, T., Huo, T., Hu, Z., et al. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-32381-3_36 · Cited by 109
“eam datasets is designed to cater for demands of requiring specific scenes or domains corpus, or to solve one or more certain problems. CNN/Daliy mail [7] and NewsQA [21] refer to news field, SQuAD 2.0 [16] focuses on wikipedia, and RACE [12] concentrates on Chinese middle school students’ English 4 Authors Suppressed D…”
BackgroundInfluentialLin, S.-C., Yang, J.-H., Nogueira, R. F., Tsai, M.-F., Wang, C., & Lin, J. (2021) · ACM Transactions on Information Systems · doi:10.1145/3446426 · Cited by 98
Types of Out-of-Distribution Texts and How to Detect Them
Arora, U., Huang, W., & He, H. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.835 · Cited by 127
“10689 question-answering system handling unanswerable questions (Rajpurkar et al., 2018).”
BackgroundImproving Factual Consistency of Abstractive Summarization via Question Answering
Nan, F., Nogueira dos Santos, C., Zhu, H., Ng, P., McKeown, K., Nallapati, R., Zhang, D., Wang, Z., Arnold, A. O., & Xiang, B. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.536 · Cited by 78
“For the question answering model, we use the ALBERT-xxlarge (Lan et al., 2019) model trained on SQ UAD 2.0 (Rajpurkar et al., 2018) as it achieves even better accuracy than BERT-large.”
MethodInfluentialData Movement Is All You Need: A Case Study on Optimizing Transformers
Ivanov, A., Dryden, N., Ben-Nun, T., Li, S., & Hoefler, T. (2020) · arXiv · doi:10.48550/arxiv.2007.00072 · Cited by 78
“, 2018; 2019), question-answering (Rajpurkar et al., 2018), translation (Vaswani et al.”
Look at the First Sentence: Position Bias in Question Answering
Ko, M., Lee, J., Kim, H., Kim, G., & Kang, J. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.84 · Cited by 50
Accelerating Sparse DNN Models without Hardware-Support via Tile-Wise Sparsity
Guo, C., Hsueh, B. Y., Leng, J., Qiu, Y., Guan, Y., Wang, Z., Jia, X., Li, X., Guo, M., & Zhu, Y. (2020) · SC20: International Conference for High Performance Computing, Networking, Storage and Analysis · doi:10.1109/sc41405.2020.00020 · Cited by 69
“The two evaluated downstream tasks are the sentence-level classification on the widely used GLUE (general language understanding evaluation) dataset [58] and the more challenging question answering task on the SQuAD dataset [48], [49].”
MethodFoundation Models for Natural Language Processing: Pre-trained Language Models Integrating Media
Paaß, G., & Giesselbach, S. (2023) · Artificial intelligence: foundations, theory, and algorithms/Artificial intelligence: Foundations, theory, and algorithms · doi:10.1007/978-3-031-23190-2 · Cited by 103
A Vietnamese Dataset for Evaluating Machine Reading Comprehension
Nguyen, K. V., Nguyen, D.-V., Nguyen, T. H. A., & Nguyen, N. L.-T. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.233 · Cited by 78
On Position Embeddings in BERT
Wang, B., Shang, L., Lioma, C., Jiang, X., Yang, H., Liu, Q., & Simonsen, J. G. (2021) · Research at the University of Copenhagen (University of Copenhagen) · Cited by 133
Natural language processing in clinical neuroscience and psychiatry: A review
Crema, C., Attardi, G., Sartiano, D., & Redolfi, A. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.946387 · Cited by 90
“Most advanced QA systems can also understand if the question has no answer (119); Topic modeling: also called topic analysis , its goal is extracting the main topics that occur in a text (120); Text similarity: also called semantic similarity , its goal is to produce a score that expresses how…”
BackgroundClover: Toward Sustainable AI with Carbon-Aware Machine Learning Inference Service
Li, B., Samsi, S., Gadepally, V. N., & Tiwari, D. (2023) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1145/3581784.3607034 · Cited by 104
“Language Modeling SQuADv2 [52] (Stanford) ALBERT [21] (Google) V2-base, V2-large, V2-xlarge, V2-xxlarge”
Knollmeyer, S., Caymazer, O., & Großmann, D. (2025) · Electronics · doi:10.3390/electronics14112102 · Cited by 97
“The selected open-domain datasets were manually created by their respective publishers or developed using crowdsourcing platforms [78,79].”
LoRA dropout as a sparsity regularizer for overfitting reduction
Lin, Y., Ma, X., Chu, X., Jin, Y., Yang, Z., & Wang, Y. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.114241 · Cited by 87
Do Large Language Models Know What They Don’t Know?
Yin, Z., Sun, Q., Guo, Q., Wu, J., Qiu, X., & Huang, X. (2023) · Findings of the Association for Computational Linguistics: ACL 2023 · doi:10.18653/v1/2023.findings-acl.551 · Cited by 75
Towards Question-Answering as an Automatic Metric for Evaluating the Content Quality of a Summary
Deutsch, D., Bedrax-Weiss, T., & Roth, D. (2021) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00397 · Cited by 75
“0 dataset (Rajpurkar et al., 2018) which contains unanswerable questions.”
Do Large Language Models Know What They Don't Know?
Yin, Z., Sun, Q., Guo, Q., Wu, J., Qiu, X., & Huang, X. (2023) · arXiv · doi:10.48550/arxiv.2305.18153 · Cited by 75
“0 (Rajpurkar et al., 2018) and NewsQA (Trischler et al., 2017), widely used in question answering (QA), have been utilized to test the self-knowledge of models with unanswerable questions.”
BackgroundEvaluation and Benchmarking of LLM Agents: A Survey
Mohammadi, M., Li, Y., Lo, J., & Yip, W. (2025) · Proceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2 · doi:10.1145/3711896.3736570 · Cited by 74
“Factual Accuracy Recall, Consistency Scores LongEval [43], SocialBench [9], LoCoMo [65], Optimus-1 [50] Multi-Agent Collaboration Information Sharing Effectiveness, Adaptive Role Switching, Reasoning Rating AgentSims [52], WebArena [126], MATSA [66], GAMEBENCH [15], BALROG [72], TheAgentCompany [ CASA [77], R-Judge [1…”
InfluentialHEAD-QA: A Healthcare Dataset for Complex Reasoning
Vilares, D., & Gómez-Rodríguez, C. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1092 · Cited by 46
SberQuAD – Russian Reading Comprehension Dataset: Description and Analysis
Efimov, P., Chertok, A., Boytsov, L., & Braslavski, P. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58219-7_1 · Cited by 106
Rethinking Generalization of Neural Models: A Named Entity Recognition Case Study
Fu, J., Liu, P., & Zhang, Q. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6276 · Cited by 69
Sajja, R., Sermet, Y., & Demir, İ. (2025) · IEEE Access · doi:10.1109/access.2025.3554222 · Cited by 87
“0 [25] dev dataset, which comprises 11,862 questions and 1,213 documents (contexts).”
Conversational AI for Natural Language Processing: An Review of ChatGPT
Goar, V. K., Yadav, N. S., & Yadav, P. S. (2023) · International Journal on Recent and Innovation Trends in Computing and Communication · doi:10.17762/ijritcc.v11i3s.6161 · Cited by 70
Getting Closer to AI Complete Question Answering: A Set of Prerequisite Real Tasks
Rogers, A., Kovaleva, O., Downey, M., & Rumshisky, A. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6398 · Cited by 63
“Interesting recent attempts to force more complex reasoning include unanswerable questions (Rajpurkar, Jia, and Liang 2018), reasoning over long texts (Kocisky et al. 2018), and multiple documents ((Yang et al. 2018)).”
BackgroundInfluentialGiving BERT a Calculator: Finding Operations and Arguments with Reading Comprehension
Andor, D., He, L., Lee, K., & Pitler, E. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1609 · Cited by 72
“For example, performance on the SQuAD 2.0 (Rajpurkar et al., 2018) benchmark has improved from 66.3 F1 to 89.51 in a single year.”
BackgroundMethodInfluentialSpan Selection Pre-training for Question Answering
Glass, M., Gliozzo, A., Chakravarti, R., Ferritto, A., Pan, L., Bhargav, G. P. S., Garg, D., & Sil, A. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.247 · Cited by 62
Local Interpretations for Explainable Natural Language Processing: A Survey
Luo, S., Ivison, H., Han, S. C., & Poon, J. (2024) · ACM Computing Surveys · doi:10.1145/3649450 · Cited by 104
“SQuAD v2 [136] proposed in 2018 includes around 50K additional unanswerable questions that are used to find similar answerable questions.”
BackgroundYadav, V., Bethard, S. J., & Surdeanu, M. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1260 · Cited by 111
“Recently, multiple datasets have been proposed for multi-hop QA, in which questions can only be answered when considering information from multiple sentences and/or documents (Clark et al., 2018; Khashabi et al., 2018a; Yang et al., 2018; Welbl et al., 2018; Mihaylov et al., 2018; Bauer et al., 2018; Dunn et al., 2017…”
BackgroundAutomatic Argument Quality Assessment - New Datasets and Methods
Toledo, A., Gretz, S., Cohen-Karlik, E., Friedman, R., Venezian, E., Lahav, D., Jacovi, M., Aharonov, R., & Slonim, N. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1564 · Cited by 110
“Our methods are based upon a powerful language representational model named Bidirectional Encoder Representations from Transform-ers (BERT) (Devlin et al., 2018) which achieves state-of-the-art results on a wide range of tasks in NLP (Wang et al. (2018), Rajpurkar et al. (2016, 2018)).”
MethodMMM: Multi-Stage Multi-Task Learning for Multi-Choice Reading Comprehension
Jin, D., Gao, S., Kao, J.-Y., Chung, T., & Hakkani-Tür, D. Z. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6310 · Cited by 78
Pre-Training Transformers as Energy-Based Cloze Models
Clark, K., Luong, M.-T., Le, Q. V., & Manning, C. D. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.20 · Cited by 93
“We evaluate fine-tuning the Electric model on the GLUE natural language understanding benchmark (Wang et al., 2019) and the SQuAD 2.0 question answering dataset (Rajpurkar et al., 2018).”
MethodInfluentialMAUD: An Expert-Annotated Legal NLP Dataset for Merger Agreement Understanding
Wang, S., Scardigli, A., Tang, L., Chen, W., Levkin, D., Chen, A., Ball, S., Woodside, T., Zhang, O. R., & Hendrycks, D. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.1019 · Cited by 101
What’s in the Box? An Analysis of Undesirable Content in the Common Crawl Corpus
Luccioni, A., & Viviano, J. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 2: Short Papers) · doi:10.18653/v1/2021.acl-short.24 · Cited by 69
“…years, much of the progress in Natural Language Processing (NLP) research has been largely driven by Transformer-based language models, which have pushed forward the state-of-the-art in tasks such as question answering (Rajpurkar et al., 2018) and natural language inference (Bow-man et al., 2015).”
BackgroundLee, D. B., Lee, S., Jeong, W. T., Kim, D., & Hwang, S. J. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.20 · Cited by 92
Ye, Z.-X., Chen, Q., Wang, W., & Ling, Z.-H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.06725 · Cited by 60
On the Trustworthiness of Generative Foundation Models: Guideline, Assessment, and PerspectivePreprint
Huang, Y., Gao, C., Wu, S., Wang, H., Wang, X., Zhou, Y., Wang, Y., Ye, J., Shi, J., Zhang, Q., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2502.14296 · Cited by 87
To Test Machine Comprehension, Start by Defining Comprehension
Dunietz, J., Burnham, G., Bharadwaj, A., Rambow, O., Chu-Carroll, J., & Ferrucci, D. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.701 · Cited by 58
Question Answering with Long Multiple-Span Answers
Zhu, M., Ahuja, A., Juan, D.-C., Wei, W., & Reddy, C. K. (2020) · Findings of the Association for Computational Linguistics: EMNLP 2020 · doi:10.18653/v1/2020.findings-emnlp.342 · Cited by 57
“Driven by the development of large-scale datasets such as SQuAD (Rajpurkar et al., 2016, 2018), most of the work in this domain focuses on the task of machine reading comprehension, where the objective is to find a single short answer span—typically ranging from a few What are tips for managing my bipolar disorder?”
MethodInfluentialReading the Manual: Event Extraction as Definition Comprehension
Chen, Y., Chen, T., Ebner, S., White, A. S., & Durme, B. V. (2020) · Workshop on Structured Prediction for NLP (SPNLP) · doi:10.18653/v1/2020.spnlp-1.9 · Cited by 68
TR-BERT: Dynamic Token Reduction for Accelerating BERT Inference
Ye, D., Lin, Y., Huang, Y., & Sun, M. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.463 · Cited by 47
Out-of-Scope Intent Detection with Self-Supervision and Discriminative Training
Zhan, L.-M., Liang, H., Liu, B., Fan, L., Wu, X.-M., & Lam, A. Y. S. (2021) · doi:10.18653/v1/2021.acl-long.273 · Cited by 100
“Specifi-cally, Open-bank and Open-stack stand for using (Rajpurkar et al., 2018), Yelp (Meng et al., 2018), and IMDB (Maas et al., 2011).”
MethodInfluentialXue, F., Shi, Z., Wei, F., Lou, Y., Liu, Y., & You, Y. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i8.20858 · Cited by 108
Contextual feature extraction hierarchies converge in large language models and the brain
Mischler, G., Li, Y. A., Bickel, S., Mehta, A. D., & Mesgarani, N. (2024) · Nature Machine Intelligence · doi:10.1038/s42256-024-00925-4 · Cited by 112
“Then, we fit 10 -fold cross-validated ridge regression models to predict the average word responses from each layer’s embeddings, sweeping over a range of regularization parameters for each training fold, using scikit-learn ’s RidgeCV model [85].”
AutoFreeze: Automatically Freezing Model Blocks to Accelerate Fine-tuningPreprint
Liu, Y., Agarwal, S., & Venkataraman, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.01386 · Cited by 105
“0 dataset[37], multiple choice task on SWAG dataset[53], and text summarization on CNN/DailyMail dataset [15].”
BackgroundMethodA combined rule-based and machine learning approach for automated GDPR compliance checking
Hamdani, R. E., Mustapha, M., Amariles, D. R., Troussel, A., Meeùs, S., & Krasnashchok, K. (2021) · International Conference on Artificial Intelligence and Law · doi:10.1145/3462757.3466081 · Cited by 80
“Evaluation of span extraction: We use the F1-score, as in the SQuaD dataset [34], to evaluate the extraction of spans associated with the values by comparing the ground truth target to the generated target.”
MethodAll You May Need for VQA are Image Captions
Changpinyo, S., Kukliansy, D., Szpektor, I., Chen, X., Ding, N., & Soricut, R. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.142 · Cited by 101
Human vs. Muppet: A Conservative Estimate of Human Performance on the GLUE Benchmark
Nangia, N., & Bowman, S. R. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1449 · Cited by 48
“0 (Rajpurkar et al., 2018), models built on BERT come extremely close to human performance.”
BackgroundMethodInfluentialNeurIPS 2020 EfficientQA Competition: Systems, Analyses and Lessons Learned
Min, S., Boyd-Graber, J. L., Alberti, C., Chen, D., Choi, E., Collins, M., Guu, K., Hajishirzi, H., Lee, K., Palomaki, J., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.00133 · Cited by 59
“Future work in efficient open-domain question answering should continue to explore the tradeoff between system size, accuracy, and abstaining [51, 52].”
BackgroundWhat Matters in Learning from Offline Human Demonstrations for Robot Manipulation
Mandlekar, A., Xu, D., Wong, J., Nasiriany, S., Wang, C., Kulkarni, R., Fei-Fei, L., Savarese, S., Zhu, Y., & Martín-Martín, R. (2021) · arXiv · doi:10.48550/arxiv.2108.03298 · Cited by 66
Learning from Task Descriptions
Weller, O., Lourie, N., Gardner, M., & Peters, M. E. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.105 · Cited by 58
Semantic Answer Similarity for Evaluating Question Answering Models
Risch, J., Möller, T., Gutsch, J., & Pietsch, M. (2021) · Workshop on Machine Reading for Question Answering (MRQA) · doi:10.18653/v1/2021.mrqa-1.15 · Cited by 83
DisentQA: Disentangling Parametric and Contextual Knowledge with Counterfactual Question Answering
Neeman, E., Aharoni, R., Honovich, O., Choshen, L., Szpektor, I., & Abend, O. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.559 · Cited by 135
Reweighted Proximal Pruning for Large-Scale Language Representation
Guo, F.-M., Liu, S., Mungall, F. S., Lin, X., & Wang, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.12486 · Cited by 41
“For MLM accuracy and SQuAD F1 score, the performance drops quickly as the prune ratio increases.”
InfluentialPhan, L., Gatti, A., Han, Z., Li, N., Hu, J., Zhang, H., Zhang, C. B. C., Shaaban, M., Ling, J., Shi, S., et al. (2025) · arXiv · doi:10.48550/arxiv.2501.14249 · Cited by 65
“The framing of the benchmark as "humanity's last exam" feels a bit strong to me.”
Answering Open-Domain Questions of Varying Reasoning Steps from Text
Qi, P., Lee, H., Sido, T., & Manning, C. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.292 · Cited by 38
“With the help of large-scale datasets based onWikipedia (Rajpurkar et al., 2016, 2018) and other large corpora (Trischler et al., 2016; Dunn et al., 2017; Talmor and Berant, 2018), the research community has made substantial progress on tackling this problem in recent years, including ∗These…”
BackgroundMethodInfluentialWav2KWS: Transfer Learning From Speech Representations for Keyword Spotting
Seo, D., Oh, H.-S., & Jung, Y. (2021) · IEEE Access · doi:10.1109/access.2021.3078715 · Cited by 54
Coarse-grain Fine-grain Coattention Network for Multi-evidence Question Answering
Zhong, V., Xiong, C., Keskar, N. S., & Socher, R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.00603 · Cited by 55
“QA tasks span a variety of sources such as Wikipedia (Yang et al., 2015; Rajpurkar et al., 2016; 2018; Hewlett et al., 2016; Joshi et al., 2017; Welbl et al., 2018), news articles (Hermann et al., 2015; Trischler et al., 2017), books (Richardson et al., 2013), and trivia (Iyyer et al., 2014).”
BackgroundHierarchical Learning for Generation with Long Source Sequences
Rohde, T., Wu, X., & Liu, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.07545 · Cited by 41
“We evaluate the pre-trained model on three downstream tasks: SQuAD 2.0 (Rajpurkar et al., 2018), MNLI-m (Williams et al., 2018) and RACE (Lai et al., 2017).”
MethodInfluentialPhan, L. (2025) · doi:10.21203/rs.3.rs-6615297/v1 · Cited by 65
Assessing the Benchmarking Capacity of Machine Reading Comprehension Datasets
Sugawara, S., Stenetorp, P., Inui, K., & Aizawa, A. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6422 · Cited by 63
SG-Net: Syntax Guided Transformer for Language Representation
Zhang, Z., Wu, Y., Zhou, J., Duan, S., Zhao, H. Y., & Wang, R. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3046683 · Cited by 71
“Understanding the meaning of texts is a prerequisite to solve many natural language understanding (NLU) problems, such as machine reading comprehension (MRC) based question answering [7], natural language inference (NLI) [8], and neural machine translation (NMT) [9], all of which require a rich and accurate representa…”
BackgroundMethodNAS-BERT: Task-Agnostic and Adaptive-Size BERT Compression with Neural Architecture Search
Xu, J., Tan, X., Luo, R., Song, K., Li, J., Qin, T., & Liu, T.-Y. (2021) · Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining · doi:10.1145/3447548.3467262 · Cited by 53
“WeevaluatethemodelscompressedbyNAS-BERTontheGLUE[46] and SQuAD [35, 36] benchmark datasets.”
BackgroundMethodCan NLI Models Verify QA Systems’ Predictions?
Chen, J., Choi, E., & Durrett, G. (2021) · Findings of the Association for Computational Linguistics: EMNLP 2021 · doi:10.18653/v1/2021.findings-emnlp.324 · Cited by 47
Incorporating Structured Commonsense Knowledge in Story Completion
Chen, J., Chen, J., & Zhou, Y. T. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33016244 · Cited by 77
Machine Reading Comprehension: The Role of Contextualized Language Models and BeyondPreprint
Zhang, Z., Zhao, H., & Wang, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.06249 · Cited by 80
What do Models Learn from Question Answering Datasets?
Sen, P., & Saffari, A. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.190 · Cited by 93
“0 (Rajpurkar et al., 2018) consists of 150K question-answer pairs on Wikipedia articles.”
BackgroundFrom Machine Reading Comprehension to Dialogue State Tracking: Bridging the Gap
Gao, S., Agarwal, S., Jin, D., Chung, T., & Hakkani-Tür, D. Z. (2020) · Workshop on NLP for Conversational AI (NLP4ConvAI) · doi:10.18653/v1/2020.nlp4convai-1.10 · Cited by 63
What is More Likely to Happen Next? Video-and-Language Future Event Prediction
Lei, J., Yu, L., Berg, T. L., & Bansal, M. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.706 · Cited by 88
Liu, J., Chen, Y., & Xu, J. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.214 · Cited by 91
SaySelf: Teaching LLMs to Express Confidence with Self-Reflective Rationales
Xu, T., Wu, S., Diao, S., Liu, X., Wang, X., Chen, Y., & Gao, J. (2024) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2024.emnlp-main.343 · Cited by 145
IIRC: A Dataset of Incomplete Information Reading Comprehension Questions
Ferguson, J., Gardner, M., Hajishirzi, H., Khot, T., & Dasigi, P. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.86 · Cited by 41
Yatskar, M. (2019) · Proceedings of the 2019 Conference of the North · doi:10.18653/v1/n19-1241 · Cited by 56
mt RAG: A Multi-Turn Conversational Benchmark for Evaluating Retrieval-Augmented Generation Systems
Katsis, Y., Rosenthal, S., Fadnis, K., Gunasekara, C., Lee, Y., Popa, L., Shah, V., Zhu, H., Contractor, D., & Danilevsky, M. (2025) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl.a.19 · Cited by 111
Generative Question Answering: Learning to Answer the Whole Question.
Lewis, M., & Fan, A. (2018) · International Conference on Learning Representations · Cited by 86
Mandlekar, A., Booher, J., Spero, M., Tung, A., Gupta, A., Zhu, Y., Garg, A., Savarese, S., & Fei-Fei, L. (2019) · 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8968114 · Cited by 45
DUMA: Reading Comprehension With Transposition Thinking
Zhu, P., Zhang, Z., Zhao, H., & Li, X. (2021) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2021.3138683 · Cited by 79
Self-Assembling Modular Networks for Interpretable Multi-Hop Reasoning
Jiang, Y., & Bansal, M. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1455 · Cited by 54
“Multi-hop Reading Comprehension The last few years have witnessed significant progress on large-scale QA datasets including cloze-style tasks (Hermann et al., 2015), open-domain QA (Yang et al., 2015), and more (Rajpurkar et al., 2016, 2018).”
BackgroundDoQA - Accessing Domain-Specific FAQs via Conversational QA
Campos, J. A., Otegi, A., Soroa, A., Deriu, J., Cieliebak, M., & Agirre, E. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.652 · Cited by 85
RikiNet: Reading Wikipedia Pages for Natural Question Answering
Liu, D., Gong, Y., Fu, J., Yan, Y., Chen, J., Jiang, D., Lv, J., & Duan, N. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.604 · Cited by 57
Don’t Blame the Annotator: Bias Already Starts in the Annotation Instructions
Parmar, M., Mishra, S. R., Geva, M., & Baral, C. R. (2023) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2023.eacl-main.130 · Cited by 95
Interactive Question Answering Systems: Literature Review
Biancofiore, G. M., Deldjoo, Y., Noia, T. D., Sciascio, E. D., & Narducci, F. (2024) · ACM Computing Surveys · doi:10.1145/3657631 · Cited by 78
Multi-task Learning with Sample Re-weighting for Machine Reading Comprehension
Xu, Y., Liu, X., Shen, Y., Liu, J., & Gao, J. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1271 · Cited by 70
A Comprehensive Survey of Contamination Detection Methods in Large Language Models
Ravaut, M., Ding, B., Jiao, F., Chen, H., Li, X., Zhao, R., Qin, C., Xiong, C., & Joty, S. (2025) · Transactions on machine learning research · doi:10.48550/arxiv.2404.00699 · Cited by 64
“GPT-2 (Radford et al., 2019) 8-gram words CoQA (Reddy et al., 2019), LAMBADA (Paperno et al., 2016) GPT-3 (Brown et al., 2020) 13-gram words PIQA (Bisk et al., 2020), Winograd (Levesque et al., 2012), Children’s Book Test (Hill et al., 2015), WikiText-2 (Merity et al., 2016), WikiText-103 (Merity et al., 2016), enwik8…”
InfluentialTaCL: Improving BERT Pre-training with Token-aware Contrastive Learning
Su, Y., Liu, F., Meng, Z., Lan, T., Shu, L., Shareghi, E., & Collier, N. (2022) · Findings of the Association for Computational Linguistics: NAACL · doi:10.18653/v1/2022.findings-naacl.191 · Cited by 72
What You See is What You Read? Improving Text-Image Alignment Evaluation
Yarom, M., Bitton, Y., Changpinyo, S., Aharoni, R., Herzig, J., Lang, O., Ofek, E., & Szpektor, I. (2023) · neural information processing systems · doi:10.52202/075280-0079 · Cited by 156
Recycling a Pre-trained BERT Encoder for Neural Machine Translation
Imamura, K., & Sumita, E. (2019) · Workshop on Neural Generation and Translation (WNGT) · doi:10.18653/v1/d19-5603 · Cited by 72
“BERT has achieved high accuracy on various tasks, such as the GLUE benchmark (Wang et al., 2019) and the reading comprehension benchmark using SQuAD (Rajpurkar et al., 2018).”
MethodCode to comment "translation": data, metrics, baselining & evaluation
Gros, D., Sezhiyan, H., Devanbu, P., & Yu, Z. (2020) · Proceedings of the 35th IEEE/ACM International Conference on Automated Software Engineering · doi:10.1145/3324884.3416546 · Cited by 43
“ider array of tools to enforce consistency on various NLP tasks. For example the WMT conference on translation, a competition is ran with held out data and human evaluation. Other tasks, such as SQuAD[45] for reading comprehension and GLUE[55] for multitask evaluation allow for uploading code to a server which runs th…”
BackgroundTemporal Reasoning via Audio Question Answering
Fayek, H. M., & Johnson, J. (2020) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2020.3010650 · Cited by 90
Unsupervised Alignment-based Iterative Evidence Retrieval for Multi-hop Question Answering
Yadav, V., Bethard, S. J., & Surdeanu, M. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.414 · Cited by 73
Which *BERT? A Survey Organizing Contextualized Encoders
Xia, P., Wu, S., & Durme, B. V. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.608 · Cited by 77
Zero-Shot Dialogue State Tracking via Cross-Task Transfer
Lin, Z., Liu, B., Madotto, A., Moon, S., Zhou, Z., Crook, P., Wang, Z., Zhou, Y., Cho, E., Subba, R., et al. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.622 · Cited by 86
“0 (Rajpurkar et al., 2018) 1 , NewsQA (Trischler et al., 2017), TriviaQA (Joshi et al., 2017), SearchQA (Dunn et al., 2017), HotpotQA (Yang et al., 2018), Natural Question (Kwiatkowski et al., 2019) from MRQA-2019 (Fisch et al., 2019), and two multi-choice datasets such as RACE (Lai et al., 2017)…”
BackgroundPre-trained language models in medicine: A survey
Luo, X., Deng, Z., Yang, B., & Luo, M. Y. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.102904 · Cited by 66
Neural Exec: Learning (and Learning from) Execution Triggers for Prompt Injection Attacks
Pasquini, D., Strohmeier, M., & Troncoso, C. (2024) · AISec@CCS · doi:10.1145/3689932.3694764 · Cited by 134
“} Asaresult,bothpassengerandfreighttrainsexperiencedadecreaseinenergyconsumption,withenergyintensityfallingfrom218to124kwh/10,000grosstonne-km.”
InfluentialPutting Evaluation in Context: Contextual Embeddings Improve Machine Translation Evaluation
Mathur, N., Baldwin, T., & Cohn, T. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1269 · Cited by 50
“…developing a series of new metrics based on contextual word embed-dings (Peters et al., 2018; Devlin et al., 2019), a technique which captures rich and portable representations of words in context, which have been shown to provide important signal to many other NLP tasks (Rajpurkar et al., 2018).”
BackgroundPMI-Masking: Principled masking of correlated spansPreprint
Levine, Y., Lenz, B., Lieber, O., Abend, O., Leyton‐Brown, K., Tennenholtz, M., & Shoham, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.01825 · Cited by 69
“0 (Rajpurkar et al., 2018), in which some questions are not answered in the provided context, and the task includes identifying such cases.”
PromptBench: A Unified Library for Evaluation of Large Language ModelsPreprint
Zhu, K., Zhao, Q., Chen, H., Wang, J., & Xie, X. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2312.07910 · Cited by 76
Know Your Limits: A Survey of Abstention in Large Language Models
Wen, B., Yao, J., Feng, S., Xu, C., Tsvetkov, Y., Howe, B., & Wang, L. L. (2025) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00754 · Cited by 56
“SQuAD2 (Rajpurkar et al., 2018) first includes unanswerable questions with irrelevant context passages for machine reading comprehension.”
The Summary Loop: Learning to Write Abstractive Summaries Without Examples
Laban, P., Hsi, A., Canny, J., & Hearst, M. A. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.460 · Cited by 78
“Scialom et al. (2019)’s work stays closer to a Q&A scenario, and uses a Question Generation module to generate actual questions about the document, answered by a Squad-based (Rajpurkar et al., 2018) model using the generated summary.”
MethodRobot learning in the era of foundation models: a survey
Xiao, X., Liu, J., Wang, Z., Zhou, Y., Qi, Y., Jiang, S., He, B., & Cheng, Q. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.129963 · Cited by 91
Metadata
- Authors
- Rajpurkar, P., Jia, R., & Liang, P.
- Affiliations
- Stanford University (US)
- Venue
- Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)
- Published
- 2018
- Pages
- 784-789
- ISSN
- 0736-587X (ISSN-L)
- OpenAlex
- W2963323070
- Cited by
- 2,240
- References
- 25
- Citations by year
- 2026: 113 · 2025: 206 · 2024: 197 · 2023: 406 · 2022: 321 · 2021: 414 · 2020: 358 · 2019: 201 · 2018: 24
- FWCI
- 101.80
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Proceedings of the conference - Association for Computational Linguistics. Meeting (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation ((DGE-114747, 114747)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- unanswerable questions, question answering, SQuAD, dataset construction, natural language understanding
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.