Neubig, Graham

CodeBERTScore: Evaluating Code Generation with Pretrained Models of Code

Zhou, S., Alon, U., Agarwal, S., & Neubig, G. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing

Software Engineering ResearchTopic Modeling

Cited by 100

Efficient Nearest Neighbor Language Models

He, J., Neubig, G., & Berg-Kirkpatrick, T. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing

Topic ModelingNatural Language Processing Techniques

Cited by 97

Can We Automate Scientific Reviewing?

Yuan, W., Liu, P., & Neubig, G. (2022) · Journal of Artificial Intelligence Research

Topic ModelingAcademic Writing and Publishing

Cited by 96

X-FACTR: Multilingual Factual Knowledge Retrieval from Pretrained Language Models

Jiang, Z., Anastasopoulos, A., Araki, J., Ding, H., & Neubig, G. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)

Topic ModelingNatural Language Processing Techniques

Cited by 88

ChatGPT MT: Competitive for High- (but Not Low-) Resource Languages

Robinson, N. R., Ogayo, P., Mortensen, D. R., & Neubig, G. (2023) · arXiv

Natural Language Processing TechniquesTopic Modeling

Cited by 58

VisualWebArena: evaluating multimodal agents on realistic visual web tasks

Koh, J. Y., Lo, R., Jang, L., Duvvur, V., Lim, M., Huang, P.-Y., Neubig, G., Zhou, S., Salakhutdinov, R., & Fried, D. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)

Multimodal Machine Learning ApplicationsSpeech and dialogue systems

Cited by 50

Fine-grained Hallucination Detection and Editing for Language Models

Mishra, A., Asai, A., Balachandran, V., Wang, Y., Neubig, G., Tsvetkov, Y., & Hajishirzi, H. (2024) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 49

Latent Relation Language Models

Hayashi, H., Hu, Z., Xiong, C., & Neubig, G. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence

Topic ModelingNatural Language Processing Techniques

Cited by 44

Bridging the Gap: A Survey on Integrating (Human) Feedback for Natural Language Generation

Fernandes, P., Madaan, A., Liu, E., Farinhas, A., Martins, P. H., Bertsch, A., de Souza, J. G. C., Zhou, S., Wu, T., Neubig, G., et al. (2023) · arXiv

Natural Language Processing TechniquesTopic Modeling

Cited by 44

Synthesizing scientific literature with retrieval-augmented language models

Asai, A., He, J., Shao, R., Shi, W., Singh, A., Chang, J. C., Lo, K., Soldaini, L., Feldman, S., D’Arcy, M., et al. (2026) · Nature

Topic ModelingInformation Retrieval and Search Behavior

Cited by 38

ExplainaBoard: An Explainable Leaderboard for NLP

Liu, P., Fu, J., Xiao, Y., Yuan, W., Chang, S., Dai, J., Liu, Y., Ye, Z., & Neubig, G. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing: System Demonstrations

Explainable Artificial Intelligence (XAI)Topic Modeling

Cited by 35

CodeRAG-Bench: Can Retrieval Augment Code Generation?

Wang, Z. Z., Asai, A., Yu, X. V., Xu, F. F., Xie, Y., Neubig, G., & Fried, D. (2024) · arXiv

Software Engineering ResearchTopic Modeling

Cited by 34

DocPrompting: Generating Code by Retrieving the Docs

Zhou, S., Alon, U., Xu, F. F., Wang, Z., Jiang, Z., & Neubig, G. (2022) · arXiv

Software Engineering ResearchTopic Modeling

Cited by 33

Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval

Alon, U., Xu, F. F., He, J., Sengupta, S., Roth, D., & Neubig, G. (2022) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 32

WebArena: A Realistic Web Environment for Building Autonomous Agents

Zhou, S., Xu, F. F., Zhu, H., Zhou, X., Lo, R., Sridhar, A., Cheng, X., Ou, T., Bisk, Y., Fried, D., et al. (2023) · arXiv

Software Testing and Debugging TechniquesWeb Data Mining and Analysis

Cited by 31

Unlimiformer: Long-Range Transformers with Unlimited Length Input

Bertsch, A., Alon, U., Neubig, G., & Gormley, M. R. (2023) · arXiv

Topic ModelingAdvanced Neural Network Applications

Cited by 30

FacTool: Factuality Detection in Generative AI - A Tool Augmented Framework for Multi-Task and Multi-Domain Scenarios

Chern, I.-C., Chern, S., Chen, S., Yuan, W., Feng, K., Zhou, C., He, J., Neubig, G., & Liu, P. (2023) · arXiv

Topic ModelingMisinformation and Its Impacts

Cited by 29

Effective Strategies for Asynchronous Software Engineering Agents

Geng, J., & Neubig, G. (2026) · arXiv

Software Engineering ResearchSoftware Engineering Techniques and Practices

Cited by 23

Can Large Language Models be Trusted for Evaluation? Scalable Meta-Evaluation of LLMs as Evaluators via Agent Debate

Chern, S., Chern, E., Neubig, G., & Liu, P. (2024) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 22

Learning to Model Editing Processes

Reid, M., & Neubig, G. (2022) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 21

Execution-Based Evaluation for Open-Domain Code Generation

Wang, Z., Zhou, S., Fried, D., & Neubig, G. (2022) · arXiv

Software Engineering ResearchTopic Modeling

Cited by 20

Active Retrieval Augmented Generation

Jiang, Z., Xu, F. F., Gao, L., Sun, Z., Liu, Q., Dwivedi-Yu, J., Yang, Y., Callan, J., & Neubig, G. (2023) · arXiv

Topic ModelingInformation Retrieval and Search Behavior

Cited by 18

TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Tasks

Xu, F. F., Song, Y., Li, B., Tang, Y., Jain, K., Bao, M., Wang, Z. Z., Zhou, X., Guo, Z., Cao, M., et al. (2024) · arXiv

Artificial Intelligence ApplicationsAI-based Problem Solving and Planning

Cited by 17

Multi-Dimensional Evaluation of Text Summarization with In-Context Learning

Jain, S., Keshava, V., Mysore Sathyendra, S., Fernandes, P., Liu, P., Neubig, G., & Zhou, C. (2023) · Findings of the Association for Computational Linguistics: ACL 2023

Topic ModelingNatural Language Processing Techniques

Cited by 15