Mindermann, Sören

Managing extreme AI risks amid rapid progress

Bengio, Y., Hinton, G., Yao, A., Song, D., Abbeel, P., Darrell, T., Harari, Y. N., Zhang, Y.-Q., Xue, L., Shalev-Shwartz, S., et al. (2024) · Science

Ethics and Social Impacts of AIDigitalization, Law, and Regulation

Cited by 349

Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training

Hubinger, E., Denison, C., Mu, J., Lambert, M., Tong, M., MacDiarmid, M., Lanham, T., Ziegler, D. M., Maxwell, T., Cheng, N., et al. (2024) · arXiv

Adversarial Robustness in Machine LearningEthics and Social Impacts of AI

Cited by 46

Occam's razor is insufficient to infer the preferences of irrational agents

Armstrong, S., & Mindermann, S. (2017) · arXiv

Reinforcement Learning in RoboticsAI-based Problem Solving and Planning

Cited by 41

Superintelligent Agents Pose Catastrophic Risks: Can Scientist AI Offer a Safer Path?

Bengio, Y., Cohen, M., Fornasiere, D., Ghosn, J., Greiner, P., MacDermott, M., Mindermann, S., Oberman, A., Richardson, J., Richardson, O., et al. (2025) · SuperIntelligence - Robotics - Safety & Alignment

Ethics and Social Impacts of AIPsychiatry, Mental Health, Neuroscience

Cited by 41

Alignment faking in large language models

Greenblatt, R., Denison, C., Wright, B., Roger, F., MacDiarmid, M., Marks, S., Treutlein, J., Belonax, T., Chen, J., Duvenaud, D., et al. (2024) · arXiv

Ethics and Social Impacts of AIAdversarial Robustness in Machine Learning

Cited by 30

Prioritized Training on Points that are Learnable, Worth Learning, and Not Yet Learnt

Mindermann, S., Brauner, J., Razzak, M., Sharma, M., Kirsch, A., Xu, W., Höltgen, B., Gomez, A. N., Morisot, A., Farquhar, S., et al. (2022) · arXiv

Machine Learning and Data ClassificationStochastic Gradient Optimization Techniques

Cited by 28

International AI Safety Report

Bengio, Y., Mindermann, S., Privitera, D., Besiroglu, T., Bommasani, R., Casper, S., Choi, Y., Fox, P., Garfinkel, B., Goldfarb, D., et al. (2025) · arXiv

Ethics and Social Impacts of AISafety Systems Engineering in Autonomy

Cited by 16

Specific versus General Principles for Constitutional AI

Kundu, S., Bai, Y., Kadavath, S., Askell, A., Callahan, A., Chen, A., Goldie, A., Balwit, A., Mirhoseini, A., McLean, B., et al. (2023) · arXiv

Ethics and Social Impacts of AISpeech and dialogue systems

Cited by 7