Hadfield-Menell, Dylan

Cooperative Inverse Reinforcement Learning

Hadfield-Menell, D., Dragan, A., Abbeel, P., & Russell, S. (2016) · arXiv

Reinforcement Learning in RoboticsMachine Learning and Algorithms

Cited by 413

Eight Methods to Evaluate Robust Unlearning in LLMs

Lynch, A., Guo, P., Ewart, A., Casper, S., & Hadfield-Menell, D. (2024) · arXiv

Privacy-Preserving Technologies in DataAdversarial Robustness in Machine Learning

Cited by 188

Inverse Reward Design

Hadfield-Menell, D., Milli, S., Abbeel, P., Russell, S., & Dragan, A. (2017) · arXiv

Reinforcement Learning in RoboticsAI-based Problem Solving and Planning

Cited by 125

Toward Transparent AI: A Survey on Interpreting the Inner Structures of Deep Neural Networks

Räuker, T., Ho, A., Casper, S., & Hadfield-Menell, D. (2023) · 2023 IEEE Conference on Secure and Trustworthy Machine Learning (SaTML)

Explainable Artificial Intelligence (XAI)Adversarial Robustness in Machine Learning

Cited by 122

The Off-Switch Game

Hadfield-Menell, D., Dragan, A., Abbeel, P., & Russell, S. (2016) · arXiv

Ethics and Social Impacts of AIPsychiatry, Mental Health, Neuroscience

Cited by 119

The Off-Switch Game

Hadfield-Menell, D., Dragan, A., Abbeel, P., & Russell, S. (2017) · Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence

Ethics and Social Impacts of AIPsychiatry, Mental Health, Neuroscience

Cited by 119

Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback

Casper, S., Davies, X., Shi, C., Gilbert, T. K., Scheurer, J., Rando, J., Freedman, R., Korbak, T., Lindner, D., Freire, P., et al. (2023) · arXiv

Reinforcement Learning in RoboticsPsychiatry, Mental Health, Neuroscience

Cited by 101

Spurious normativity enhances learning of compliance and enforcement behavior in artificial agents

Köster, R., Hadfield-Menell, D., Everett, R., Weidinger, L., Hadfield, G. K., & Leibo, J. Z. (2022) · Proceedings of the National Academy of Sciences

Reinforcement Learning in RoboticsEvolutionary Game Theory and Cooperation

Cited by 37

Conservative Agency via Attainable Utility Preservation

Turner, A. M., Hadfield-Menell, D., & Tadepalli, P. (2020) · Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society

Reinforcement Learning in RoboticsEthics and Social Impacts of AI

Cited by 36

Unifying scene registration and trajectory optimization for learning from demonstrations with application to manipulation of deformable objects

Lee, A. X., Huang, S. H., Hadfield-Menell, D., Tzeng, E., & Abbeel, P. (2014) · 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems

Robot Manipulation and LearningReinforcement Learning in Robotics

Cited by 32

Incomplete Contracting and AI Alignment

Hadfield-Menell, D., & Hadfield, G. K. (2018) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society

Law, Economics, and Judicial SystemsEthics and Social Impacts of AI

Cited by 28

Consequences of Misaligned AI

Zhuang, S., & Hadfield-Menell, D. (2021) · arXiv

Reinforcement Learning in RoboticsGame Theory and Applications

Cited by 22

Estimating and Penalizing Preference Shift in Recommender Systems

Carroll, M., Hadfield-Menell, D., Russell, S., & Dragan, A. (2021) · Fifteenth ACM Conference on Recommender Systems

Recommender Systems and TechniquesEthics and Social Impacts of AI

Cited by 20

Estimating and Penalizing Induced Preference Shifts in Recommender Systems

Carroll, M., Dragan, A., Russell, S., & Hadfield-Menell, D. (2022) · arXiv

Recommender Systems and TechniquesEthics and Social Impacts of AI

Cited by 11

Red Teaming with Mind Reading: White-Box Adversarial Policies Against RL Agents

Casper, S., Killian, T., Kreiman, G., & Hadfield-Menell, D. (2022) · arXiv

Adversarial Robustness in Machine LearningSecurity and Verification in Computing

Cited by 10

The AI Agent Index

Casper, S., Bailey, L., Hunter, R., Ezell, C., Cabalé, E., Gerovitch, M., Slocum, S., Wei, K., Jurkovic, N., Khan, A., et al. (2025) · arXiv

Ethics and Social Impacts of AIArtificial Intelligence Applications

Cited by 6

Formal contracts mitigate social dilemmas in multi-agent reinforcement learning

Haupt, A., Christoffersen, P., Damani, M., & Hadfield-Menell, D. (2024) · Autonomous Agents and Multi-Agent Systems

Reinforcement Learning in RoboticsGame Theory and Applications

Cited by 5

Multi-Principal Assistance Games

Fickinger, A., Zhuang, S., Hadfield-Menell, D., & Russell, S. (2020) · arXiv

Game Theory and Voting SystemsAdvanced Bandit Algorithms Research

Cited by 5

Defending Against Unforeseen Failure Modes with Latent Adversarial Training

Casper, S., Schulze, L., Patel, O., & Hadfield-Menell, D. (2024) · arXiv

Adversarial Robustness in Machine LearningSecurity and Verification in Computing

Cited by 3

Open technical problems in open-weight ai model risk management

Casper, S., O'Brien, K., Longpre, S., Seger, E., Klyman, K., Bommasani, R., Nrusimha, A., Shumailov, I., Mindermann, S., Basart, S., et al. (2025) · SSRN Electronic Journal

Ethics and Social Impacts of AIAdversarial Robustness in Machine Learning

Cited by 3

Latent Adversarial Training Improves Robustness to Persistent Harmful Behaviors in LLMs

Sheshadri, A., Ewart, A., Guo, P., Lynch, A., Wu, C., Hebbar, V., Sleight, H., Stickland, A. C., Perez, E., Hadfield-Menell, D., et al. (2024) · arXiv

Adversarial Robustness in Machine LearningPrivacy-Preserving Technologies in Data

Cited by 3

Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback

Casper, S., Davies, X., Shi, C., Krendl Gilbert, T., Scheurer, J., Rando Ramirez, J., Freedman, R., Korbak, T., Lindner, D., Freire, P., et al. (2023) · ETH Zurich

Reinforcement Learning in RoboticsMachine Learning and Algorithms

Cited by 3