Khot, Tushar

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

Srivastava, A., Rastogi, A., Rao, A., Shoeb, A. A. M., Abid, A., Fisch, A., Brown, A. R., Santoro, A., Gupta, A., Garriga-Alonso, A., et al. (2022) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 569

UNIFIEDQA: Crossing Format Boundaries with a Single QA System

Khashabi, D., Min, S., Khot, T., Sabharwal, A., Tafjord, O., Clark, P., & Hajishirzi, H. (2020) · Findings of the Association for Computational Linguistics: EMNLP 2020

Topic ModelingMultimodal Machine Learning Applications

Cited by 514

Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge

Clark, P., Cowhey, I., Etzioni, O., Khot, T., Sabharwal, A., Schoenick, C., & Tafjord, O. (2018) · arXiv

Topic ModelingMultimodal Machine Learning Applications

Cited by 462

Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions

Trivedi, H., Balasubramanian, N., Khot, T., & Sabharwal, A. (2022) · arXiv

Topic ModelingInformation Retrieval and Search Behavior

Cited by 349

Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions

Trivedi, H., Balasubramanian, N., Khot, T., & Sabharwal, A. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)

Topic ModelingInformation Retrieval and Search Behavior

Cited by 349

♫ MuSiQue: Multihop Questions via Single-hop Question Composition

Trivedi, H., Balasubramanian, N., Khot, T., & Sabharwal, A. (2022) · Transactions of the Association for Computational Linguistics

Topic ModelingMultimodal Machine Learning Applications

Cited by 283

Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategies

Geva, M., Khashabi, D., Segal, E., Khot, T., Roth, D., & Berant, J. (2021) · Transactions of the Association for Computational Linguistics

Topic ModelingMultimodal Machine Learning Applications

Cited by 242

Chain-of-Thought Hub: A Continuous Effort to Measure Large Language Models' Reasoning Performance

Fu, Y., Ou, L., Chen, M., Wan, Y., Peng, H., & Khot, T. (2023) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 109

OLMo: Accelerating the Science of Language Models

Groeneveld, D., Beltagy, I., Walsh, E., Bhagia, A., Kinney, R., Tafjord, O., Jha, A., Ivison, H., Magnusson, I., Wang, Y., et al. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)

Topic ModelingNatural Language Processing Techniques

Cited by 70

Is Multihop QA in DiRe Condition? Measuring and Reducing Disconnected Reasoning

Trivedi, H., Balasubramanian, N., Khot, T., & Sabharwal, A. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)

Topic ModelingMultimodal Machine Learning Applications

Cited by 29

QASC: A Dataset for Question Answering via Sentence Composition

Khot, T., Clark, P., Guerquin, M., Jansen, P., & Sabharwal, A. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence

Topic ModelingMultimodal Machine Learning Applications

Cited by 20

AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agents

Trivedi, H., Khot, T., Hartmann, M., Manku, R., Dong, V., Li, E., Gupta, S., Sabharwal, A., & Balasubramanian, N. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)

Software Engineering ResearchNatural Language Processing Techniques

Cited by 14

The tail wagging the dog: Dataset construction biases of social bias benchmarks

Selvam, N., Dev, S., Khashabi, D., Khot, T., & Chang, K.-W. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)

Ethics and Social Impacts of AIHate Speech and Cyberbullying Detection

Cited by 11

OLMo: Accelerating the Science of Language Models

Groeneveld, D., Beltagy, I., Walsh, P., Bhagia, A., Kinney, R., Tafjord, O., Jha, A. H., Ivison, H., Magnusson, I., Wang, Y., et al. (2024) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 10

SUPER: Evaluating Agents on Setting Up and Executing Tasks from Research Repositories

Bogin, B., Yang, K., Gupta, S., Richardson, K., Bransom, E., Clark, P., Sabharwal, A., & Khot, T. (2024) · Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing

Natural Language Processing TechniquesTopic Modeling

Cited by 9

DISCOVERYWORLD: A Virtual Environment for Developing and Evaluating Automated Scientific Discovery Agents

Jansen, P., Côté, M.-A., Khot, T., Bransom, E., Mishra, B. D., Majumder, B. P., Tafjord, O., & Clark, P. (2024) · arXiv

Multi-Agent Systems and NegotiationScientific Computing and Data Management

Cited by 9

AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agents

Trivedi, H., Khot, T., Hartmann, M., Manku, R., Dong, V., Li, E., Gupta, S., Sabharwal, A., & Balasubramanian, N. (2024) · arXiv

Software Engineering ResearchAI-based Problem Solving and Planning

Cited by 2

SUPER: Evaluating Agents on Setting Up and Executing Tasks from Research Repositories

Bogin, B., Yang, K., Gupta, S., Richardson, K., Bransom, E., Clark, P., Sabharwal, A., & Khot, T. (2024) · arXiv

Software Engineering ResearchTopic Modeling

Cited by 0