Lei, Fangyu

OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

Xie, T., Zhang, D., Chen, J., Li, X., Zhao, S., Cao, R., Hua, T. J., Cheng, Z., Shin, D., Lei, F., et al. (2024) · arXiv

Multimodal Machine Learning ApplicationsSpeech and dialogue systems

Cited by 64

DA-Code: Agent Data Science Code Generation Benchmark for Large Language Models

Huang, Y., Luo, J., Yu, Y., Zhang, Y., Lei, F., Wei, Y., He, S., Huang, L., Liu, X., Zhao, J., et al. (2024) · Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing

Software Engineering ResearchTopic Modeling

Cited by 22

Spider2-V: How Far Are Multimodal Agents From Automating Data Science and Engineering Workflows?

Cao, R., Lei, F., Wu, H., Chen, J., Fu, Y., Gao, H., Xiong, X., Zhang, H., Mao, Y., Hu, W., et al. (2024) · Advances in Neural Information Processing Systems 37

Web Data Mining and AnalysisScientific Computing and Data Management

Cited by 15

Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflows

Lei, F., Chen, J., Ye, Y., Cao, R., Shin, D., Su, H., Suo, Z., Gao, H., Hu, W., Yin, P., et al. (2024) · arXiv

Software Engineering ResearchTopic Modeling

Cited by 7

Agent-World: Scaling Real-World Environment Synthesis for Evolving General Agent Intelligence

Dong, G., Lu, J., Huang, J., Zhong, W., Liu, L., Huang, S., Li, Z., Zhao, Y., Song, X., Li, X., et al. (2026) · arXiv

Artificial Intelligence ApplicationsTopic Modeling

Cited by 0