Zhou, Shuyan

OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

Xie, T., Zhang, D., Chen, J., Li, X., Zhao, S., Cao, R., Hua, T. J., Cheng, Z., Shin, D., Lei, F., et al. (2024) · arXiv

Multimodal Machine Learning ApplicationsSpeech and dialogue systems

Cited by 64

VisualWebArena: evaluating multimodal agents on realistic visual web tasks

Koh, J. Y., Lo, R., Jang, L., Duvvur, V., Lim, M., Huang, P.-Y., Neubig, G., Zhou, S., Salakhutdinov, R., & Fried, D. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)

Multimodal Machine Learning ApplicationsSpeech and dialogue systems

Cited by 50

TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Tasks

Xu, F. F., Song, Y., Li, B., Tang, Y., Jain, K., Bao, M., Wang, Z. Z., Zhou, X., Guo, Z., Cao, M., et al. (2024) · arXiv

Artificial Intelligence ApplicationsAI-based Problem Solving and Planning

Cited by 17

WebCanvas: Benchmarking Web Agents in Online Environments

Pan, Y., Kong, D., Zhou, S., Cui, C., Leng, Y., Jiang, B., Liu, H., Shang, Y., Zhou, S., Wu, T., et al. (2024) · arXiv

Web Data Mining and AnalysisInformation Retrieval and Search Behavior

Cited by 4

VisualWebArena: Evaluating Multimodal Agents on Realistic Visual Web Tasks

Koh, J. Y., Lo, R., Jang, L., Duvvur, V., Lim, M. C., Huang, P.-Y., Neubig, G., Zhou, S., Salakhutdinov, R., & Fried, D. (2024) · arXiv

Multimodal Machine Learning ApplicationsWeb Data Mining and Analysis

Cited by 1