The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
UNIFIEDQA: Crossing Format Boundaries with a Single QA System
Open accessAbstract
Question answering (QA) tasks have been posed using a variety of formats, such as extractive span selection, multiple choice, etc.This has led to format-specialized models, and even to an implicit division in the QA community.We argue that such boundaries are artificial and perhaps unnecessary, given the reasoning abilities we seek to teach are not governed by the format.As evidence, we use the latest advances in language modeling to build a single pre-trained QA model, UNIFIEDQA, that performs well across 20 QA datasets spanning 4 diverse formats.UNIFIEDQA performs on par with 8 different models that were trained on individual datasets themselves.Even when faced with 12 unseen datasets of observed formats, UNIFIEDQA performs surprisingly well, showing strong generalization from its out-offormat training data.Finally, fine-tuning this pre-trained QA model into specialized models results in a new state of the art on 10 factoid and commonsense QA datasets, establishing UNIFIEDQA as a strong starting point for building QA systems. 1 1 https://github.com/allenai/unifiedqaExtractive [SQuAD] Question: At what speed did the turbine operate?Context: (Nikola_Tesla) On his 50th birthday in 1906, Tesla demonstrated his 200 horsepower (150 kilowatts) 16,000 rpm bladeless turbine.... Gold answer: 16,000 rpm Multiple-Choice [ARC-challenge] Question: What does photosynthesis produce that helps plants grow?Candidate Answers: (A) water (B) oxygen (C) protein (D) sugar Gold answer: sugar Yes/No [BoolQ]Question: Was America the first country to have a president?Context: (President) The first usage of the word president to denote the highest official in a government was during the Commonwealth of England ... Gold answer: no Abstractive [NarrativeQA]Question: What does a drink from narcissus's spring cause the drinker to do? Context: Mercury has awakened Echo, who weeps for Narcissus, and states that a drink from Narcissus's spring causes the drinkers to "Grow dotingly enamored of themselves."... Gold answer: fall in love with themselves
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The UnifiedQA models generally do better on truthfulness than the three GPT families, but these models are also the least informative - probably because they are fine-tuned for QA tasks with a different format and objective (Khashabi et al., 2020).”
From TruthfulQA: Measuring How Models Mimic Human Falsehoods (2022) · cites this paper as Khashabi et al., 2020
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Longer phrasal or sentential answers are often used in language generation tasks [105] and in other tasks such as multiple-choice question answering (where the scores of multiple phrases are compared against each-other; Khashabi et al. [55]).”
From Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing (2023) · cites this paper as [55]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821
Caruana, R. (1997) · Machine Learning · doi:10.1023/a:1007379606734 · Cited by 6,636
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1264 · Cited by 6,208
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
Lan, Z., Chen, M., Goodman, S., Gimpel, K., Sharma, P., & Soricut, R. (2019) · arXiv · doi:10.48550/arxiv.1909.11942 · Cited by 4,308
Dense passage retrieval for open-domain question answering
Karpukhin, V., Oguz, B., Min, S., Lewis, P., Wu, L., Edunov, S., Chen, D., & Yih, W.-T. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.550 · Cited by 3,575
Self-citationKnow What You Don’t Know: Unanswerable Questions for SQuAD
Rajpurkar, P., Jia, R., & Liang, P. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p18-2124 · Cited by 2,240
Natural Questions: A benchmark for question answering research
Kwiatkowski, T., Palomaki, J., Redfield, O., Collins, M., Parikh, A., Alberti, C., Epstein, D., Polosukhin, I., Devlin, J., Lee, K., et al. (2019) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00276 · Cited by 2,069
Research works printed but not linked: 3
- Dheeru Dua, Ananth Gottumukkala, Alon Talmor, Matt Gardner, and Sameer Singh. 2019a. Compre- hensive multi-dataset evaluation of reading compre- hension. In 2nd Workshop on Machine Reading for Question Answering.
- Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019b. Lan- guage models are unsupervised multitask learners. OpenAI Blog, 1(8):9.
- Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J Liu. 2020. Exploring the limits of transfer learning with a unified text-to-text trans- former. JMLR.
Cited by
Sorted by citations
Items 201–300 of 523
Towards Question Format Independent Numerical Reasoning: A Set of Prerequisite TasksPreprint
Mishra, S. R., Mitra, A., Varshney, N., Sachdeva, B., & Baral, C. R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.08516 · Cited by 12
Teaching Pre-Trained Models to Systematically Reason Over Implicit Knowledge.Preprint
Talmor, A., Tafjord, O., Clark, P. E., Goldberg, Y., & Berant, J. (2020) · arXiv (Cornell University) · Cited by 13
Self-citationTransfer Learning with Synthetic Corpora for Spatial Role Labeling and Reasoning
Mirzaee, R., & Kordjamshidi, P. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.413 · Cited by 26
MAML-en-LLM: Model Agnostic Meta-Training of LLMs for Improved In-Context Learning
Sinha, S., Yue, Y., Soto, V., Kulkarni, M., Lu, J., & Zhang, A. (2024) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3637528.3671905 · Cited by 15
Rethinking VLMs and LLMs for image classification
Cooper, A., Kato, K., Shih, C.-H., Yamane, H., Vinken, K., Takemoto, K., Sunagawa, T., Yeh, H.-W., Yamanaka, J., Mason, I., et al. (2025) · Scientific Reports · doi:10.1038/s41598-025-04384-8 · Cited by 20
FrenchMedMCQA: A French Multiple-Choice Question Answering Dataset for Medical domain
Labrak, Y., Bazoge, A., Dufour, R., Daille, B., Gourraud, P., Morin, E., & Rouvier, M. (2022) · International Workshop on Health Text Mining and Information Analysis (LOUHI) · doi:10.18653/v1/2022.louhi-1.5 · Cited by 15
Peek Across: Improving Multi-Document Modeling via Cross-Document Question-Answering
Caciularu, A., Peters, M. E., Goldberger, J., Dagan, I., & Cohan, A. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.110 · Cited by 23
Multi-Modal Latent Space Learning for Chain-of-Thought Reasoning in Language Models
He, L., Li, Z., Cai, X., & Ping, W. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i16.29776 · Cited by 11
Task Compass: Scaling Multi-task Pre-training with Task Prefix
Zhang, Z., Wang, S., Yi‐chong, X., Fang, Y., Yu, W., Liu, Y., Zhao, H. Y., Zhu, C., & Zeng, M. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.416 · Cited by 17
Preserving Commonsense Knowledge from Pre-trained Language Models via Causal Inference
Zheng, J., Ma, Q., Qiu, S., Wu, Y., Ma, P., Liu, J., Feng, H., Shang, X., & Chen, H. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.509 · Cited by 17
Bhakthavatsalam, S., Khashabi, D., Khot, T., Mishra, B. D., Richardson, K., Sabharwal, A., Schoenick, C., Tafjord, O., & Clark, P. E. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.03315 · Cited by 11
Self-citationThe tail wagging the dog: Dataset construction biases of social bias benchmarks
Selvam, N., Dev, S., Khashabi, D., Khot, T., & Chang, K.-W. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/2023.acl-short.118 · Cited by 11
Self-citationA Study of Situational Reasoning for Traffic Understanding
Zhang, J., Ilievski, F., Ma, K., Kollaa, A., Francis, J., & Oltramari, A. (2023) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3580305.3599246 · Cited by 11
Ni, M., Zhang, J., Fu, C., Wang, J., Ning, X., & Li, S. (2024) · IEEE Information Technology, Networking, Electronic and Automation Control Conference (ITNEC) · doi:10.1109/itnec60942.2024.10733337 · Cited by 10
SAGE: A Framework of Precise Retrieval for RAG
Zhang, J., Li, G., & Su, J. (2025) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde65448.2025.00108 · Cited by 10
Unsupervised multiple-choice question generation for out-of-domain Q&A fine-tuning
Berre, G. L., Cerisara, C., Langlais, P., & Lapalme, G. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-short.83 · Cited by 10
On Curriculum Learning for Commonsense Reasoning
Maharana, A., & Bansal, M. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.72 · Cited by 10
Retrieval-Augmented Few-shot Text Classification
Yu, G., Liu, L., Jiang, H., Shi, S., & Ao, X. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.447 · Cited by 13
Exploring Universal Intrinsic Task Subspace for Few-Shot Learning via Prompt Tuning
Qin, Y., Wang, X., Su, Y., Lin, Y., Ding, N., Yi, J., Chen, W., Liu, Z., Li, J., Hou, L., et al. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3430545 · Cited by 72
A Semantic-based Method for Unsupervised Commonsense Question Answering
Niu, Y., Huang, F., Liang, J., Chen, W., Zhu, X., & Huang, M. (2021) · doi:10.18653/v1/2021.acl-long.237 · Cited by 13
Rosa, G. M., Rodrigues, R. C., Lotufo, R., & Nogueira, R. F. (2021) · International Conference on Artificial Intelligence and Law · doi:10.1145/3462757.3466103 · Cited by 10
Zhu, Y., Nie, J., Su, Y., Chen, H., Zhang, X., & Dou, Z. (2022) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3511808.3557328 · Cited by 9
Data-Efficient Finetuning Using Cross-Task Nearest Neighbors
Ivison, H., Smith, N. A., Hajishirzi, H., & Dasigi, P. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.576 · Cited by 23
Self-citationInferring Implicit Relations in Complex Questions with Language Models
Katz, U., Geva, M., & Berant, J. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.188 · Cited by 13
Truthful AI: Developing and governing AI that does not lie
Evans, O., Cotton-Barratt, O., Finnveden, L., Bales, A., Balwit, A., Wills, P., Righetti, L., & Saunders, W. (2021) · arXiv · doi:10.48550/arxiv.2110.06674 · Cited by 39
Foreseeing the Benefits of Incidental Supervision
He, H., Zhang, M., Ning, Q., & Roth, D. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.134 · Cited by 12
Neural module networks: A review
Fashandi, H. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.126518 · Cited by 11
Ho, B. J., Meng, L. M., Wang, X., Butler, R., Park, J., & Ren, D. (2025) · Pediatric Emergency Care · doi:10.1097/pec.0000000000003315 · Cited by 9
Go Back in Time: Generating Flashbacks in Stories with Event Temporal Prompts
Han, R., Chen, H., Tian, Y., & Peng, N. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.104 · Cited by 14
Kongyoung, S., Macdonald, C., & Ounis, I. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.485 · Cited by 10
Ghosal, D., Majumder, N., Mihalcea, R. F., & Poria, S. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.691 · Cited by 10
Event-Centric Question Answering via Contrastive Learning and Invertible Event Transformation
Lu, J., Tan, X., Pergola, G., Gui, L., & He, Y. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.176 · Cited by 9
Getting MoRE out of Mixture of Language Model Reasoning Experts
Si, C., Shi, W., Zhao, C., Zettlemoyer, L., & Boyd-Graber, J. L. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.552 · Cited by 32
Zero-Shot Learners for Natural Language Understanding via a Unified Multiple-Choice Perspective
Wang, J., Yang, P., Gan, R., Zhang, Y., Zhang, J., & Sakai, T. (2023) · IEEE Access · doi:10.1109/access.2023.3343123 · Cited by 10
Enhancing human-like multimodal reasoning: a new challenging dataset and comprehensive framework
Wei, J., Tan, C., Gao, Z., Sun, L., Li, S., Yu, B., Guo, R., & Li, S. Z. (2024) · Neural Computing and Applications · doi:10.1007/s00521-024-10310-2 · Cited by 20
KerasBERT: Modeling the Keras Language
Shorten, C., & Khoshgoftaar, T. M. (2021) · International Conference on Machine Learning and Applications · doi:10.1109/icmla52953.2021.00041 · Cited by 9
What Makes Pre-trained Language Models Better Zero-shot Learners?
Lu, J., Zhu, D., Han, W., Zhao, R., Namee, B. M., & Tan, F. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.128 · Cited by 17
Efficient Fine-Tuning Large Language Models for Knowledge-Aware Response Planning
Nguyen, M., Kishan, K. C., Nguyen, T., Chadha, A., & Vu, T. (2023) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-43415-0_35 · Cited by 8
Parallel Learning for Legal Intelligence: A HANOI Approach Based on Unified Prompting
Song, Z., Huang, M., Miao, Q., & Wang, F. (2023) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2023.3301400 · Cited by 9
Language-based reasoning graph neural network for commonsense question answering
Yang, M., Wang, Y., & Gu, Y. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106816 · Cited by 9
FPE–Transformer: A Feature Positional Encoding-Based Transformer Model for Attack Detection
Zaim, H. Ç., & YOLAÇAN, E. (2025) · Applied Sciences · doi:10.3390/app15031252 · Cited by 11
Automated Summarization of Stack Overflow Posts
Kou, B., Chen, M., & Zhang, T. (2023) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse48619.2023.00158 · Cited by 13
Baranov, A., Kniazhevsky, V., & Braslavski, P. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.845 · Cited by 9
On the Influence of Masking Policies in Intermediate Pre-training
Ye, Q., Li, B. Z., Wang, S., Bolte, B., Ma, H., Yih, W.-T., Ren, X., & Khabsa, M. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.573 · Cited by 10
Improving Text Auto-Completion with Next Phrase Prediction
Lee, D., Hu, Z., & Lee, R. K.-W. (2021) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2021.findings-emnlp.378 · Cited by 8
Improving Unsupervised Commonsense Reasoning Using Knowledge-Enabled Natural Language Inference
Huang, C., He, W., & Liu, Y. (2021) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2021.findings-emnlp.420 · Cited by 8
Interpretable modular knowledge reasoning for machine reading comprehension
Ren, M., Huang, H., & Gao, Y. (2022) · Neural Computing and Applications · doi:10.1007/s00521-022-06975-2 · Cited by 8
Zhao, W., & Liu, J. (2022) · Mobile Information Systems · doi:10.1155/2022/4139323 · Cited by 8
RetractedCompositionality in Computational Linguistics
Donatelli, L. E., & Koller, A. (2022) · Annual Review of Linguistics · doi:10.1146/annurev-linguistics-030521-044439 · Cited by 8
Eliciting and Understanding Cross-task Skills with Task-level Mixture-of-Experts
Ye, Q., Zha, J., & Ren, X. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.189 · Cited by 19
Soto-Jiménez, F., Martínez-Velásquez, M., Chicaiza, J. A., Naranjo, P. G. V., & Nadjet Bouayad-agha, A. (2024) · Lecture notes in networks and systems · doi:10.1007/978-3-031-66329-1_37 · Cited by 8
A Few More Examples May Be Worth Billions of Parameters
Kirstain, Y., Lewis, P., Riedel, S., & Levy, O. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.72 · Cited by 21
Lee, J., & Lee, G. G. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113091 · Cited by 8
Learning with Instance Bundles for Reading Comprehension
Dua, D., Dasigi, P., Singh, S., & Gardner, M. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.584 · Cited by 9
Descriptive Prompt Paraphrasing for Target-Oriented Multimodal Sentiment Classification
Liu, D., Li, L., Tao, X., Cui, J., & Xie, Q. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.275 · Cited by 7
Commonsense Knowledge in Word Associations and ConceptNet
Liu, C., Cohn, T., & Frermann, L. (2021) · Conference on Computational Natural Language Learning · doi:10.18653/v1/2021.conll-1.38 · Cited by 8
Perhaps PTLMs Should Go to School – A Task to Assess Open Book and Closed Book QA
Ciosici, M. R., Cecil, J., Lee, D., Hedges, A., Freedman, M., & Weischedel, R. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.493 · Cited by 7
UKP-SQUARE: An Online Platform for Question Answering Research
Baumgärtner, T., Wang, K., Sachdeva, R. S., Geigle, G., Eichler, M., Poth, C., Sterz, H., Puerto, H., Ribeiro, L. F. R., Pfeiffer, J., et al. (2022) · Annual Meeting of the Association for Computational Linguistics: System Demonstrations (ACL Demo) · doi:10.18653/v1/2022.acl-demo.2 · Cited by 7
qaAskeR$$^+$$: a novel testing method for question answering software via asking recursive questions
Xie, X., Jin, S., & Chen, S. (2023) · Automated Software Engineering · doi:10.1007/s10515-023-00380-2 · Cited by 8
Yiğit, G., & Amasyalı, M. F. (2023) · Knowledge and Information Systems · doi:10.1007/s10115-023-01918-2 · Cited by 7
Elaboration-Generating Commonsense Question Answering at Scale
Wang, W., Srikumar, V., Hajishirzi, H., & Smith, N. A. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.90 · Cited by 10
Self-citationMulti-Domain Dialogue State Tracking - A Purely Transformer-Based Generative Approach.Preprint
Zeng, Y., & Nie, J. (2020) · arXiv (Cornell University) · Cited by 7
ARN: Analogical Reasoning on Narratives
Sourati, Z., Ilievski, F., Sommerauer, P., & Jiang, Y. (2024) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00688 · Cited by 14
Gogineni, V. (2025) · International Conference on Artificial Intelligence, Robotics and Control (AIRC) · doi:10.1109/airc64931.2025.11077480 · Cited by 7
Pirozelli, P., José, M. M., Silveira, I. C., Cação, F. N., Peres, S. M., Brandão, A. A. F., Costa, A. H. R., & Cozman, F. G. (2024) · Data Intelligence · doi:10.1162/dint_a_00245 · Cited by 8
Pouramini, A., & Faili, H. (2024) · Applied Intelligence · doi:10.1007/s10489-024-05660-2 · Cited by 6
LLaMA-Excitor: General Instruction Tuning via Indirect Feature Interaction
Zou, B., Yang, C., Qiao, Y., Quan, C., & Zhao, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01336 · Cited by 7
Evaluation and Comparison of Open-Source LLMs Using Natural Language Generation Quality Metrics
Hamzic, D., Wurzenberger, M., Skopik, F., Landauer, M., & Rauber, A. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825576 · Cited by 8
Contextual and Semantic Fusion Network for Multiple-Choice Reading Comprehension
Duan, Q., Huang, J., & Wu, H. (2021) · IEEE Access · doi:10.1109/access.2021.3068993 · Cited by 6
Meta-learning for compressed language model: A multiple choice question answering study
Yan, M., & Pan, Y. F. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.01.148 · Cited by 6
Retrieval Data Augmentation Informed by Downstream Question Answering Performance
Ferguson, J., Hajishirzi, H., Dasigi, P., & Khot, T. (2022) · Fact Extraction and VERification Workshop (FEVER) · doi:10.18653/v1/2022.fever-1.1 · Cited by 5
Self-citationWon’t Get Fooled Again: Answering Questions with False Premises
Hu, S., Luo, Y., Wang, H., Cheng, X., Liu, Z., & Sun, M. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.309 · Cited by 29
Joshi, B., Liu, Z., Ramnath, S., Chan, A., Tong, Z., Nie, S., Wang, Q., Choi, Y., & Ren, X. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.392 · Cited by 20
AutoConv: Automatically Generating Information-seeking Conversations with Large Language Models
Li, S., Yang, C., Yin, Y., Zhu, X., Cheng, Z., Shang, L., Jiang, X., Liu, Q., & Yang, Y. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-short.149 · Cited by 11
Knowledgeable Parameter Efficient Tuning Network for Commonsense Question Answering
Zhao, Z., Hu, L., Zhao, H., Shao, Y., & Wang, Y. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.503 · Cited by 6
Using Commonsense Knowledge to Answer Why-Questions
Lal, Y. K., Tandon, N., Aggarwal, T., Liu, H., Chambers, N., Mooney, R. J., & Balasubramanian, N. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.79 · Cited by 6
MPrompt: Exploring Multi-level Prompt Tuning for Machine Reading Comprehension
Chen, G., Qian, Y., Wang, B., & Li, L. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.343 · Cited by 7
Robust Commonsense Reasoning Against Noisy Labels Using Adaptive Correction
Yang, X., Deng, C. D., Wei, K., & Tao, D. (2023) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2023.3339629 · Cited by 6
Model Agnostic Answer Reranking System for Adversarial Question Answering
Majumder, S., Samant, C., & Durrett, G. (2021) · Conference of the European Chapter of the Association for Computational Linguistics: Student Research Workshop (EACL SRW) · doi:10.18653/v1/2021.eacl-srw.8 · Cited by 6
Break, Perturb, Build: Automatic Perturbation of Reasoning Paths Through Question Decomposition
Geva, M., Wolfson, T., & Berant, J. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00450 · Cited by 11
Less Is More: Domain Adaptation with Lottery Ticket for Reading Comprehension
Zhu, H., Wang, Z., Zhang, H., Liu, M., Zhao, S., & Qin, B. (2021) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2021.findings-emnlp.95 · Cited by 7
Towards Interpretable Reasoning over Paragraph Effects in Situation
Ren, M., Geng, X., Qin, T., Huang, H., & Jiang, D. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.548 · Cited by 6
NLPGym -- A toolkit for evaluating RL agents on Natural Language Processing TasksPreprint
Ramamurthy, R., Sifa, R., & Bauckhage, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.08272 · Cited by 7
ESTER: A Machine Reading Comprehension Dataset for Event Semantic Relation ReasoningPreprint
Han, R., Hsu, I.-H., Sun, J., Baylon, J., Ning, Q., Roth, D., & Peng, N. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.08350 · Cited by 6
Fusing Context Into Knowledge Graph for Commonsense Question AnsweringPreprint
Xu, Y., Zhu, C., Xu, R., Liu, Y., Zeng, M., & Huang, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.04808 · Cited by 6
Meta-Learning of Prompt Generation for Lightweight Prompt Engineering on Language-Model-as-a-Service
Ha, H., Lee, J., Han, W., & Chun, B.-G. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.159 · Cited by 5
Liu, W., Huang, Z., Wang, C., Peng, Y., & Xie, S. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.111411 · Cited by 5
Dai, Y. Q., Liu, J., Cao, L., Xue, Y., Wang, X., Ding, Y., Tian, J., & Feng, L. (2024) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2024.3494860 · Cited by 10
Efosa-Zuwa, E., Oladipupo, O. O., & Oyelade, J. O. (2025) · Statistics Optimization & Information Computing · doi:10.19139/soic-2310-5070-2398 · Cited by 5
Penco, R., Pintar, D., Vranić, M., & Šoštarić, M. (2025) · Applied Sciences · doi:10.3390/app15126518 · Cited by 7
Implicit Relation Inference with Deep Path Extraction for Commonsense Question Answering
Yang, P., Liu, Z., Li, B., & Zhang, P. (2022) · Neural Processing Letters · doi:10.1007/s11063-022-10831-8 · Cited by 5
GraphPrompt: Graph-Based Prompt Templates for Biomedical Synonym Prediction
Xu, H., Zhang, J., Wang, Z., Zhang, S., Bhalerao, M. M., Liu, Y., Zhu, D., & Wang, S. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i9.26256 · Cited by 10
Chen, Q., Xu, G., Yan, M., Zhang, J., Huang, F., Si, L., & Zhang, Y. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.835 · Cited by 8
KIMedQA: towards building knowledge-enhanced medical QA models
Zafar, A., Sahoo, S. K., Varshney, D., Das, A., & Ekbal, A. (2024) · Journal of Intelligent Information Systems · doi:10.1007/s10844-024-00844-1 · Cited by 6
BiRdQA: A Bilingual Dataset for Question Answering on Tricky Riddles
Zhang, Y., & Wan, X. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i10.21430 · Cited by 7
On the Robustness of Reading Comprehension Models to Entity Renaming
Yan, J., Yang, X., Mukherjee, S., Lin, B. Y., Jia, R., & Ren, X. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.37 · Cited by 8
Gallagher at SemEval-2023 Task 5: Tackling Clickbait with Seq2Seq Models
Bilgis, T., Bozdag, N. B., & Bethard, S. J. (2023) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/2023.semeval-1.229 · Cited by 5
Do Text-to-Text Multi-Task Learners Suffer from Task Conflict?
Mueller, D. M., Andrews, N., & Dredze, M. H. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.206 · Cited by 5
SBU Figures It Out: Models Explain Figurative Language
Lal, Y. K., & Bastan, M. (2022) · Workshop on Figurative Language Processing (FigLang) · doi:10.18653/v1/2022.flp-1.20 · Cited by 5
Metadata
- Authors
- Khashabi, D., Min, S., Khot, T., Sabharwal, A., Tafjord, O., Clark, P., & Hajishirzi, H.
- Affiliations
- Allen Institute for Artificial Intelligence (US)
- University of Washington (US)
- Venue
- Findings of the Association for Computational Linguistics: EMNLP 2020
- Published
- 2020
- Pages
- 1896-1907
- OpenAlex
- W3020908159
- Cited by
- 514
- References
- 51
- Citations by year
- 2026: 23 · 2025: 52 · 2024: 63 · 2023: 129 · 2022: 113 · 2021: 101 · 2020: 33
- FWCI
- 35.91
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Alfred P. Sloan Foundation
- Allen Institute for Artificial Intelligence
- Defense Advanced Research Projects Agency (N66001, N66001-19-2-403, N66001-19)
- Office of Naval Research (N00014-18, N00014-18-1-2826, ONR-N00014, N00014)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- question answering, pre-trained language models, multiple-choice question answering, yes/no question answering, fine-tuning, factoid question answering, commonsense question answering, SQuAD, ARC-Challenge
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
