The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
UNIFIEDQA: Crossing Format Boundaries with a Single QA System
Open accessAbstract
Question answering (QA) tasks have been posed using a variety of formats, such as extractive span selection, multiple choice, etc.This has led to format-specialized models, and even to an implicit division in the QA community.We argue that such boundaries are artificial and perhaps unnecessary, given the reasoning abilities we seek to teach are not governed by the format.As evidence, we use the latest advances in language modeling to build a single pre-trained QA model, UNIFIEDQA, that performs well across 20 QA datasets spanning 4 diverse formats.UNIFIEDQA performs on par with 8 different models that were trained on individual datasets themselves.Even when faced with 12 unseen datasets of observed formats, UNIFIEDQA performs surprisingly well, showing strong generalization from its out-offormat training data.Finally, fine-tuning this pre-trained QA model into specialized models results in a new state of the art on 10 factoid and commonsense QA datasets, establishing UNIFIEDQA as a strong starting point for building QA systems. 1 1 https://github.com/allenai/unifiedqaExtractive [SQuAD] Question: At what speed did the turbine operate?Context: (Nikola_Tesla) On his 50th birthday in 1906, Tesla demonstrated his 200 horsepower (150 kilowatts) 16,000 rpm bladeless turbine.... Gold answer: 16,000 rpm Multiple-Choice [ARC-challenge] Question: What does photosynthesis produce that helps plants grow?Candidate Answers: (A) water (B) oxygen (C) protein (D) sugar Gold answer: sugar Yes/No [BoolQ]Question: Was America the first country to have a president?Context: (President) The first usage of the word president to denote the highest official in a government was during the Commonwealth of England ... Gold answer: no Abstractive [NarrativeQA]Question: What does a drink from narcissus's spring cause the drinker to do? Context: Mercury has awakened Echo, who weeps for Narcissus, and states that a drink from Narcissus's spring causes the drinkers to "Grow dotingly enamored of themselves."... Gold answer: fall in love with themselves
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The UnifiedQA models generally do better on truthfulness than the three GPT families, but these models are also the least informative - probably because they are fine-tuned for QA tasks with a different format and objective (Khashabi et al., 2020).”
From TruthfulQA: Measuring How Models Mimic Human Falsehoods (2022) · cites this paper as Khashabi et al., 2020
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Longer phrasal or sentential answers are often used in language generation tasks [105] and in other tasks such as multiple-choice question answering (where the scores of multiple phrases are compared against each-other; Khashabi et al. [55]).”
From Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing (2023) · cites this paper as [55]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821
Caruana, R. (1997) · Machine Learning · doi:10.1023/a:1007379606734 · Cited by 6,636
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1264 · Cited by 6,208
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
Lan, Z., Chen, M., Goodman, S., Gimpel, K., Sharma, P., & Soricut, R. (2019) · arXiv · doi:10.48550/arxiv.1909.11942 · Cited by 4,308
Dense passage retrieval for open-domain question answering
Karpukhin, V., Oguz, B., Min, S., Lewis, P., Wu, L., Edunov, S., Chen, D., & Yih, W.-T. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.550 · Cited by 3,575
Self-citationKnow What You Don’t Know: Unanswerable Questions for SQuAD
Rajpurkar, P., Jia, R., & Liang, P. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p18-2124 · Cited by 2,240
Natural Questions: A benchmark for question answering research
Kwiatkowski, T., Palomaki, J., Redfield, O., Collins, M., Parikh, A., Alberti, C., Epstein, D., Polosukhin, I., Devlin, J., Lee, K., et al. (2019) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00276 · Cited by 2,069
Research works printed but not linked: 3
- Dheeru Dua, Ananth Gottumukkala, Alon Talmor, Matt Gardner, and Sameer Singh. 2019a. Compre- hensive multi-dataset evaluation of reading compre- hension. In 2nd Workshop on Machine Reading for Question Answering.
- Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019b. Lan- guage models are unsupervised multitask learners. OpenAI Blog, 1(8):9.
- Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J Liu. 2020. Exploring the limits of transfer learning with a unified text-to-text trans- former. JMLR.
Cited by
Sorted by citations
Items 301–400 of 523
NIR-Prompt: A Multi-task Generalized Neural Information Retrieval Training Framework
Xu, S., Pang, L., Shen, H., & Cheng, X. (2023) · ACM Transactions on Information Systems · doi:10.1145/3626092 · Cited by 6
Fan, C., Tian, J., Li, Y., Chen, W., He, H., & Jin, Y. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.913 · Cited by 8
ZARA: Improving Few-Shot Self-Rationalization for Small Language Models
Chen, W., Yen, A.-Z., Wu, C.-K., Huang, H., & Chen, H. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.310 · Cited by 9
Tokenization Consistency Matters for Generative Models on Extractive NLP Tasks
Sun, K., Qi, P., Zhang, Y., Liu, L., Wang, W. Y., & Huang, Z. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.887 · Cited by 10
Dual Head-wise Coattention Network for Machine Comprehension with Multiple-Choice Questions
Liu, Z., Huang, K., Huang, D., Liu, Z., & Zhao, J. (2020) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3340531.3412013 · Cited by 5
Answer Span Correction in Machine Reading Comprehension
Reddy, R. G., Sultan, A., Kayi, E. S., Zhang, R., Castelli, V., & Sil, A. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.226 · Cited by 6
Explainable Inference Over Grounding-Abstract Chains for Science Questions
Thayaparan, M., Valentino, M., & Freitas, A. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.1 · Cited by 5
Jansen, P. A., Smith, K. J., Moreno, D., & Ortiz, H. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.596 · Cited by 8
Enriching a Model's Notion of Belief using a Persistent MemoryPreprint
Kassner, N., Tafjord, O., Schütze, H., & Clark, P. E. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.08401 · Cited by 5
Self-citationThompson, K. N., Chandler, K. L., Morgan, C., Khashabi, D., Delinski, E. A., & Durme, B. V. (2025) · Journal of Advanced Academics · doi:10.1177/1932202x251356323 · Cited by 5
Self-citationHow Many Answers Should I Give? An Empirical Study of Multi-Answer Reading Comprehension
Zhang, C., Lin, J., Liu, X., Lai, Y., Feng, Y., & Zhao, D. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.359 · Cited by 6
Asking Questions Framework for Oral History Archives
Švec, J., Bulín, M., Frémund, A., & Polák, F. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-56063-7_11 · Cited by 4
Tackling Vision Language Tasks through Learning Inner Monologues
Yang, D., Chen, K., Rao, J., Guo, X., Zhang, Y., Yang, J., & Zhang, Y. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i17.29905 · Cited by 8
Medical short text classification via Soft Prompt-tuning
Xiao, X., Wang, H., Jiang, F. X., Qi, T., & Wang, W. (2025) · Frontiers in Medicine · doi:10.3389/fmed.2025.1519280 · Cited by 4
Semantic Categorization of Social Knowledge for Commonsense Question Answering
Wang, G., Hou, X., Yang, D., McKeown, K. R., & Huang, J. (2021) · Workshop on Simple and Efficient Natural Language Processing (SustaiNLP) · doi:10.18653/v1/2021.sustainlp-1.10 · Cited by 5
Language Models for Deep Learning Programming: A Case Study with Keras
Shorten, C., & Khoshgoftaar, T. M. (2022) · Advances in intelligent systems and computing · doi:10.1007/978-981-19-6153-3_6 · Cited by 4
Few-shot Adaptation Works with UnpredicTable Data
Chan, J. S., Pieler, M., Jao, J., Scheurer, J., & Perez, E. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.102 · Cited by 7
Privacy Aware Question-Answering System for Online Mental Health Risk Assessment
Chhikara, P., Pasupulety, U., Marshall, J., Chaurasia, D., & Kumari, S. (2023) · Workshop on Biomedical Language Processing (BioNLP) · doi:10.18653/v1/2023.bionlp-1.18 · Cited by 5
Recyclable Tuning for Continual Pre-training
Qin, Y., Qian, C., Han, X., Lin, Y., Wang, H., Xie, R., Liu, Z., Sun, M., & Zhou, J. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.723 · Cited by 13
Near-Negative Distinction: Giving a Second Life to Human Evaluation Datasets
Laban, P., Wu, C.-S., Liu, W., & Xiong, C. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.135 · Cited by 3
CALM-Bench: A Multi-task Benchmark for Evaluating Causality-Aware Language Models
Dalal, D., Buitelaar, P., & Arčan, M. (2023) · Findings of the Association for Computational Linguistics: EACL · doi:10.18653/v1/2023.findings-eacl.23 · Cited by 5
In-Context Demonstration Selection with Cross Entropy Difference
Iter, D., Pryzant, R., Xu, R., Wang, S., Liu, Y., Yi‐chong, X., & Zhu, C. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.81 · Cited by 13
Fischer, S., Gemmell, C., Tecklenburg, N., Mackie, I., Rossetto, F., & Dalton, J. (2024) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3637528.3671622 · Cited by 7
Vitiugin, F., & Purohit, H. (2024) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v18i1.31410 · Cited by 6
Context-Aware Question-Answer for Interactive Media Experiences
Jorgensen, K., Zhao, Z., Wang, H., Wang, M., & He, Z. (2021) · ACM International Conference on Interactive Media Experiences · doi:10.1145/3452918.3458795 · Cited by 5
AI Student: A Machine Reading Comprehension System for the Korean College Scholastic Ability Test
Kim, G., Lee, S., Park, C., & Jo, J. (2022) · Mathematics · doi:10.3390/math10091486 · Cited by 5
Towards Socially Intelligent Agents with Mental State Transition and Human UtilityPreprint
Qiu, L., Zhao, Y., Yuan, L., Lu, P., Shi, W., Zhou, Y., & Zhu, S. C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.07011 · Cited by 7
Learning to Solve Complex Tasks by Talking to Agents.Preprint
Khot, T., Richardson, K., Khashabi, D., & Sabharwal, A. (2021) · arXiv (Cornell University) · Cited by 4
Self-citationGraphPrompt: Biomedical Entity Normalization Using Graph-based Prompt TemplatesPreprint
Zhang, J., Wang, Z., Zhang, S., Bhalerao, M. M., Liu, Y., Zhu, D., & Wang, S. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.11.29.470486 · Cited by 3
QUERY2BERT: Combining Knowledge Graph and Language Model for Reasoning on Logical Queries
Phan, T. H. V., & Do, P. (2025) · IEEE Access · doi:10.1109/access.2025.3528097 · Cited by 5
DP2Unlearning: An efficient and guaranteed unlearning framework for LLMs
Mahmud, T. A., Jebreel, N., Domingo‐Ferrer, J., & Sánchez, D. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107879 · Cited by 4
Liang, Y., Tohti, T., Hu, W., Yan, T., Wang, S., & Hamdulla, A. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.129250 · Cited by 4
Lite Unified Modeling for Discriminative Reading Comprehension
Zhao, Y., Zhao, H., Shen, L., & Zhao, Y. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.594 · Cited by 4
Choice-Driven Contextual Reasoning for Commonsense Question Answering
Deng, W., Wang, Z., Wang, K., Zhang, X., & Feng, Z. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20865-2_25 · Cited by 3
Crystal: Introspective Reasoners Reinforced with Self-Feedback
Liu, J., Pasunuru, R., Hajishirzi, H., Choi, Y., & Çelikyılmaz, A. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.708 · Cited by 4
Self-citationNLP-Based Management of Large Multiple-Choice Test Item Repositories
Albano, V., Firmani, D., Laura, L., Mathew, J. G., Paoletti, A. L., & Torrente, I. (2023) · Journal of Learning Analytics · doi:10.18608/jla.2023.7897 · Cited by 5
A Prompt Chaining Framework for Long-Term Recall in LLM-Powered Intelligent Assistant
Seo, S., Yoo, S., & Jang, Y. (2025) · Proceedings of the 30th International Conference on Intelligent User Interfaces · doi:10.1145/3708359.3712117 · Cited by 3
Towards General Natural Language Understanding with Probabilistic Worldbuilding
Saparov, A., & Mitchell, T. M. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00463 · Cited by 6
ASCM: An Answer Space Clustered Prompting Method without Answer Engineering
Wang, Z., Yang, Y., Xi, Z., Ma, B., Wang, L., Dong, R., & Anwar, A. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.193 · Cited by 3
GraDA: Graph Generative Data Augmentation for Commonsense Reasoning
Maharana, A., & Bansal, M. (2022) · doi:10.18653/v1/2022.dlg4nlp-1.6 · Cited by 3
Can Language Models Be Specific? How?
Huang, J., Chang, K. C., Xiong, J., & Hwu, W. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.45 · Cited by 4
Kim, N., Htut, P. M., Bowman, S. R., & Petty, J. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.472 · Cited by 21
Chen, J., Zhang, Y., Liu, L., Dong, R., Chen, X., Ng, P., Wang, W. Y., & Huang, Z. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.341 · Cited by 5
Zhen, Z., Wang, L., Gu, D., Wu, H. K., Janfada, B., & Bidgoli, B. M. (2023) · International Journal of Information Technologies and Systems Approach · doi:10.4018/ijitsa.328681 · Cited by 3
Zhang, R. H., Fan, A. X., & Zhang, R. (2023) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2023.eacl-main.142 · Cited by 3
Knowledge Prompting with Contrastive Learning for Unsupervised CommonsenseQA
Zhang, L., & Li, R. (2023) · Communications in computer and information science · doi:10.1007/978-981-99-8145-8_3 · Cited by 3
Guo, K., Diefenbach, D., Gourru, A., & Gravier, C. (2023) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai59109.2023.00032 · Cited by 7
DIMN: Dual Integrated Matching Network for multi-choice reading comprehension
Wei, Q., Ma, K., Liu, X., Ji, K., Yang, B., & Abraham, A. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.107694 · Cited by 3
SemPool: Simple, Robust, and Interpretable KG Pooling for Enhancing Language Models
Mavromatis, C., Karypis, P., & Karypis, G. (2024) · Lecture notes in computer science · doi:10.1007/978-981-97-2238-9_12 · Cited by 3
Chain of Thought Prompting in Vision-Language Model for Vision Reasoning Tasks
Ou, J., Zhou, J. J., Dong, Y., & Chen, F. (2024) · Lecture notes in computer science · doi:10.1007/978-981-96-0351-0_22 · Cited by 3
EMBOSR: Embodied Spatial Reasoning for Enhanced Situated Question Answering in 3D Scenes
Yu, H., Yang, F., Fang, N., & Liu, Y.-S. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10801720 · Cited by 4
Zhu, Y., Huang, Z., Dou, Z., & Wen, J.-R. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i24.34813 · Cited by 13
Zero-Shot Clinical Questionnaire Filling From Human-Machine Interactions
Toudeshki, F. G., Jolivet, P., Durand-Salmon, A., & Liednikova, A. (2021) · Workshop on Machine Reading for Question Answering (MRQA) · doi:10.18653/v1/2021.mrqa-1.5 · Cited by 3
Hey AI, Can You Solve Complex Tasks by Talking to Agents?
Khot, T., Richardson, K., Khashabi, D., & Sabharwal, A. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.142 · Cited by 13
Self-citationDiff-Explainer: Differentiable Convex Optimization for Explainable Multi-hop Inference
Thayaparan, M., Valentino, M., Ferreira, D. M., Rozanova, J., & Freitas, A. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00508 · Cited by 3
KPT: Keyword-Guided Pre-training for Grounded Dialog Generation
Zhu, Q., Mi, F., Zhang, Z., Wang, Y., Li, Y., Jiang, X., Liu, Q., Zhu, X., & Huang, M. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i11.26646 · Cited by 4
Long-Tailed Question Answering in an Open World
Dai, Y. Q., Lang, H., Zheng, Y., Huang, F., & Li, Y. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.351 · Cited by 6
Foreshadowing the Benefits of Incidental SupervisionPreprint
He, H., Zhang, M., Qiang, N., & Roth, D. (2020) · arXiv (Cornell University) · Cited by 3
More with Less: ZeroQA and Relevant Subset Selection for AI2 Reasoning Challenge
Pătras, C. C.-B., Pîrtoacă, G.-S., Rebedea, T. E., & Ruşeţi, Ş. (2022) · Procedia Computer Science · doi:10.1016/j.procs.2022.09.334 · Cited by 2
Zan, C., Ding, L., Shen, L., Cao, Y. K., & Liu, W. (2024) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2024.109532 · Cited by 2
Cross-Domain Tibetan Named Entity Recognition via Large Language Models
Zhang, J., Gao, F., Yeshi, L., Tashi, D., Wang, X., Tashi, N., & Luosang, G. (2024) · Electronics · doi:10.3390/electronics14010111 · Cited by 2
Zero-Shot Knowledge-Based Visual Question Answering with Frozen Language Models
Liu, J., Zhang, L., Cao, C., Shi, Y., Mu, C., & Li, J. (2025) · Big Data Mining and Analytics · doi:10.26599/bdma.2025.9020032 · Cited by 2
Narrow Down Before Selection: A Dynamic Exclusion Model for Multiple-Choice QA
Liu, X., Shi, Y., Liu, R., Bai, G., & Chen, Y. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096136 · Cited by 2
Fung, Y. R., Wang, H., Wang, T., Kebarighotbi, A., Bansal, M., Ji, H., & Natarajan, P. (2023) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2023.eacl-main.221 · Cited by 3
Multi-Grained Evidence Inference for Multi-Choice Reading Comprehension
Zhao, Y., Zhao, H., & Duan, S. (2023) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2023.3313885 · Cited by 2
VLIS: Unimodal Language Models Guide Multimodal Language Generation
Chung, J., & Yu, Y. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.46 · Cited by 2
Automatic Question Generation: A Comparative Analysis of Rule-Based and Neural Network-Based Models
Velmurugan, H., Pandiarajan, N., Ravi, L., Voleti, S., Sheik, R., & Nirmala, S. J. (2024) · Lecture notes in networks and systems · doi:10.1007/978-981-97-1724-8_21 · Cited by 2
Heterogeneous-Graph Reasoning With Context Paraphrase for Commonsense Question Answering
Wang, Y., Hu, Z., Liang, J., & Li, R. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3434469 · Cited by 2
An Explainable Vision Question Answer Model via Diffusion Chain-of-Thought
Lu, C., Lü, Q., & Luo, J. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72855-6_9 · Cited by 2
Wang, B., Wang, Z., Xiang, W., & Mo, Y. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3527135 · Cited by 3
A Data-Driven Approach to Estimating the Impact of Audiovisual Art Events Through Web Presence
Giannakoulopoulos, A. P., Pergantis, M., Lamprogeorgos, A., & Lampoura, S. (2025) · Information · doi:10.3390/info16020088 · Cited by 2
GEM-RAG: Graphical Eigen Memories for Retrieval Augmented Generation
Rappazzo, B., Wang, Y., Ferber, A., & Gomes, C. P. (2024) · International Conference on Machine Learning and Applications · doi:10.1109/icmla61862.2024.00196 · Cited by 3
Cooking with context: Leveraging context for procedural question answering
Frummet, A., Elsweiler, D., & Kruschwitz, U. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2025.104212 · Cited by 2
Knowledge injection methods in question answering
Radyush, D. (2025) · Russian Technological Journal · doi:10.32362/2500-316x-2025-13-3-21-43 · Cited by 2
A machine solution for math word problems based on semantic understanding enhancement
Wang, Y., Yan, M., Jian, P., Yang, Y., & Li, Y. (2025) · Scientific Reports · doi:10.1038/s41598-025-20225-0 · Cited by 2
Designing Templates for Eliciting Commonsense Knowledge from Pretrained Sequence-to-Sequence Models
Yang, J.-H., Lin, S.-C., Nogueira, R. F., Tsai, M.-F., Wang, C., & Lin, J. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.307 · Cited by 2
Are All Steps Equally Important? Benchmarking Essentiality Detection in Event Processes
Wang, H., Zhang, H., Wang, Y., Deng, Y., Chen, M., & Roth, D. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.246 · Cited by 3
Answer Consolidation: Formulation and Benchmarking
Zhou, W., Ning, Q., Elfardy, H., Small, K., & Chen, M. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.320 · Cited by 2
Prompt and Instruction-Based Tuning for Response Generation in Conversational Question Answering
Xing, Y., & Liu, P. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-35320-8_11 · Cited by 2
Tao, Z., Jin, Z. G., Zhao, H., Dou, C., Zhao, Y., Shen, T., & Tao, C. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.391 · Cited by 2
Domain Incremental Lifelong Learning in an Open World
Dai, Y. Q., Lang, H., Zheng, Y., Yu, B., Huang, F., & Li, Y. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.361 · Cited by 2
MoQA: Benchmarking Multi-Type Open-Domain Question Answering
Yen, H., Gao, T., Lee, J., & Chen, D. (2023) · DialDoc Workshop on Document-grounded Dialogue and Conversational Question Answering (DialDoc) · doi:10.18653/v1/2023.dialdoc-1.2 · Cited by 2
A Report on the FigLang 2022 Shared Task on Understanding Figurative Language
Saakyan, A., Chakrabarty, T., Ghosh, D., & Muresan, S. (2022) · Workshop on Figurative Language Processing (FigLang) · doi:10.18653/v1/2022.flp-1.26 · Cited by 2
Open-ended Commonsense Reasoning with Unrestricted Answer Candidates
Ling, C., Zhang, X., Zhao, X., Liu, Y., Cheng, W., Oishi, M., Osaki, T., Matsuda, K., Chen, H., & Zhao, L. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.540 · Cited by 3
Chain-of-Questions Training with Latent Answers for Robust Multistep Question Answering
Wang, Z., Thomason, J., & Jia, R. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.547 · Cited by 6
A Graph-Guided Reasoning Approach for Open-ended Commonsense Question Answering
Han, Z. Y., Feng, Y., & Sun, M. (2023) · doi:10.18653/v1/2023.pandl-1.3 · Cited by 3
Watson, W., Cho, N., & Srishankar, N. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i24.34736 · Cited by 9
The Winograd Schemas from Hell
Cozman, F. G., & Munhoz, H. N. (2020) · doi:10.5753/eniac.2020.12157 · Cited by 2
Logical Reasoning for Task Oriented Dialogue Systems
Beygi, S., Fazel-Zarandi, M., Cervone, A., Krishnan, P., & Jonnalagadda, S. (2022) · Workshop on e-Commerce and NLP (ECNLP) · doi:10.18653/v1/2022.ecnlp-1.10 · Cited by 2
PaCo: Preconditions Attributed to Commonsense Knowledge
Qasemi, E., Ilievski, F., Chen, M., & Szekely, P. A. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.505 · Cited by 5
CoreQuisite: Circumstantial Preconditions of Common Sense Knowledge.Preprint
Qasemi, E., Ilievski, F., Chen, M., & Szekely, P. A. (2021) · arXiv (Cornell University) · Cited by 2
Zero-Shot Dialogue State Tracking via Cross-Task TransferPreprint
Lin, Z., Liu, B., Madotto, A., Moon, S., Crook, P., Zhou, Z., Wang, Z., Yu, Z., Cho, E., Subba, R., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.04655 · Cited by 2
KARN: Knowledge Augmented Reasoning Network for Question Answering
Li, L., Chen, H., Qin, X., Wang, Z., & Dong, J. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-44693-1_49 · Cited by 1
Inference Retrieval-Augmented Multi-Modal Chain-of-Thoughts Reasoning for Language Models
He, Q., Qian, S., Zhang, J., & Wang, C. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10888701 · Cited by 2
Exploring Oral History Archives Using State-of-the-Art Artificial Intelligence Methods
Bulín, M., Švec, J., Ircing, P., Frémund, A., & Polák, F. (2025) · Acta Informatica Pragensia · doi:10.18267/j.aip.268 · Cited by 1
Efficient Cross-Lingual Transfer for Language Models
Shah, A. F. M. S. (2025) · International Symposium on Innovative Approaches in Smart Technologies (ISAS) · doi:10.1109/isas66241.2025.11101933 · Cited by 1
Yang, W., Zhang, S., Zeng, Q., Lin, Z., Liu, Y., Luo, H., Zhong, X., Yuan, J., & Zhang, J. (2024) · International Conference on Big Data, Artificial Intelligence and Internet of Things Engineering (ICBAIE) · doi:10.1109/icbaie63306.2024.11117035 · Cited by 1
Metadata
- Authors
- Khashabi, D., Min, S., Khot, T., Sabharwal, A., Tafjord, O., Clark, P., & Hajishirzi, H.
- Affiliations
- Allen Institute for Artificial Intelligence (US)
- University of Washington (US)
- Venue
- Findings of the Association for Computational Linguistics: EMNLP 2020
- Published
- 2020
- Pages
- 1896-1907
- OpenAlex
- W3020908159
- Cited by
- 514
- References
- 51
- Citations by year
- 2026: 23 · 2025: 52 · 2024: 63 · 2023: 129 · 2022: 113 · 2021: 101 · 2020: 33
- FWCI
- 35.91
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Alfred P. Sloan Foundation
- Allen Institute for Artificial Intelligence
- Defense Advanced Research Projects Agency (N66001, N66001-19-2-403, N66001-19)
- Office of Naval Research (N00014-18, N00014-18-1-2826, ONR-N00014, N00014)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- question answering, pre-trained language models, multiple-choice question answering, yes/no question answering, fine-tuning, factoid question answering, commonsense question answering, SQuAD, ARC-Challenge
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
