Zhuo, Terry Yue

Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfaces

Merrill, M. A., Shaw, A. G., Carlini, N., Li, B., Raj, H., Bercovich, I., Shi, L., Shin, J. Y., Walshe, T., Buchanan, E. K., et al. (2026) · arXiv

AI-based Problem Solving and PlanningArtificial Intelligence Applications

Cited by 392

StarCoder: may the source be with you!

Li, R., Allal, L. B., Zi, Y., Muennighoff, N., Kocetkov, D., Mou, C., Marone, M., Akiki, C., Li, J., Chim, J., et al. (2023) · arXiv

Software Engineering ResearchTopic Modeling

Cited by 261

OctoPack: Instruction Tuning Code Large Language Models

Muennighoff, N., Liu, Q., Zebaze, A., Zheng, Q., Hui, B., Zhuo, T. Y., Singh, S., Tang, X., von Werra, L., & Longpre, S. (2023) · arXiv

Software Engineering ResearchTopic Modeling

Cited by 245

Red teaming ChatGPT via Jailbreaking: Bias, Robustness, Reliability and Toxicity

Zhuo, T. Y., Huang, Y., Chen, C., & Xing, Z. (2023) · arXiv

Ethics and Social Impacts of AIAdversarial Robustness in Machine Learning

Cited by 164

StarCoder 2 and The Stack v2: The Next Generation

Lozhkov, A., Li, R., Allal, L. B., Cassano, F., Lamy-Poirier, J., Tazi, N., Tang, A., Pykhtar, D., Liu, J., Wei, Y., et al. (2024) · arXiv

Software Engineering ResearchTopic Modeling

Cited by 74

SantaCoder: don't reach for the stars!

Allal, L. B., Li, R., Kocetkov, D., Mou, C., Akiki, C., Ferrandis, C. M., Muennighoff, N., Mishra, M., Gu, A., Dey, M., et al. (2023) · arXiv

Software Engineering ResearchTopic Modeling

Cited by 61

On Robustness of Prompt-based Semantic Parsing with Large Pre-trained Language Model: An Empirical Study on Codex

Zhuo, T. Y., Li, Z., Huang, Y., Shiri, F., Wang, W., Haffari, G., & Li, Y.-F. (2023) · Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics

Natural Language Processing TechniquesTopic Modeling

Cited by 31

BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions

Zhuo, T. Y., Vu, M. C., Chim, J., Hu, H., Yu, W., Widyasari, R., Yusuf, I. N. B., Zhan, H., He, J., Paul, I., et al. (2024) · arXiv

Software Engineering ResearchTopic Modeling

Cited by 29

LLM-as-a-Judge for Software Engineering: Literature Review, Vision, and the Road Ahead

He, J., Shi, J., Zhuo, T. Y., Treude, C., Sun, J., Du, X., Xing, Z., & Lo, D. (2026) · ACM Transactions on Software Engineering and Methodology

Software Engineering ResearchSoftware Engineering Techniques and Practices

Cited by 12

SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Tasks

Li, X., Liu, Y., Chen, W., You, B., Di, Z., He, Y., Zheng, S., Choe, K. W., Sun, J., Wang, S., et al. (2026) · arXiv

AI-based Problem Solving and PlanningTopic Modeling

Cited by 1

BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution

Zhuo, T. Y., Jin, X., Liu, H., Jiang, J., Liu, T., Gong, C., Bishnoi, B., Mishra, V., Suppa, M., Ziems, N., et al. (2025) · arXiv

Software Engineering ResearchTopic Modeling

Cited by 0