Zou, Andy

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

Srivastava, A., Rastogi, A., Rao, A., Shoeb, A. A. M., Abid, A., Fisch, A., Brown, A. R., Santoro, A., Gupta, A., Garriga-Alonso, A., et al. (2022) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 569

Measuring Massive Multitask Language Understanding

Hendrycks, D., Burns, C., Basart, S., Zou, A., Mazeika, M., Song, D., & Steinhardt, J. (2020) · arXiv

Topic ModelingMultimodal Machine Learning Applications

Cited by 291

Universal and Transferable Adversarial Attacks on Aligned Language Models

Zou, A., Wang, Z., Carlini, N., Nasr, M., Kolter, J. Z., & Fredrikson, M. (2023) · arXiv

Adversarial Robustness in Machine LearningSpeech Recognition and Synthesis

Cited by 197

The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearning

Li, N., Pan, A., Gopal, A., Yue, S., Berrios, D., Gatti, A., Li, J. D., Dombrowski, A.-K., Goel, S., Phan, L., et al. (2024) · arXiv

Privacy-Preserving Technologies in DataAdversarial Robustness in Machine Learning

Cited by 90

Humanity's Last Exam

Phan, L., Gatti, A., Han, Z., Li, N., Hu, J., Zhang, H., Zhang, C. B. C., Shaaban, M., Ling, J., Shi, S., et al. (2025) · arXiv

Topic ModelingMultimodal Machine Learning Applications

Cited by 65

Do the Rewards Justify the Means? Measuring Trade-Offs Between Rewards and Ethical Behavior in the MACHIAVELLI Benchmark

Pan, A., Chan, J. S., Zou, A., Li, N., Basart, S., Woodside, T., Ng, J., Zhang, H., Emmons, S., & Hendrycks, D. (2023) · arXiv

Ethics and Social Impacts of AIEthics in Business and Education

Cited by 32

HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusal

Mazeika, M., Phan, L., Yin, X., Zou, A., Wang, Z., Mu, N., Sakhaee, E., Li, N., Basart, S., Li, B., et al. (2024) · arXiv

Adversarial Robustness in Machine LearningTopic Modeling

Cited by 28

Improving Alignment and Robustness with Circuit Breakers

Zou, A., Phan, L., Wang, J., Duenas, D., Lin, M., Andriushchenko, M., Wang, R., Kolter, Z., Fredrikson, M., & Hendrycks, D. (2024) · arXiv

Software System Performance and ReliabilityDistributed systems and fault tolerance

Cited by 19

Lessons from the Trenches on Reproducible Evaluation of Language Models

Biderman, S., Schoelkopf, H., Sutawika, L., Gao, L., Tow, J., Abbasi, B., Aji, A. F., Ammanamanchi, P. S., Black, S., Clive, J., et al. (2024) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 9