Carroll, Micah

On the Utility of Learning about Humans for Human-AI Coordination

Carroll, M., Shah, R., Ho, M. K., Griffiths, T. L., Seshia, S. A., Abbeel, P., & Dragan, A. (2019) · arXiv

Reinforcement Learning in RoboticsArtificial Intelligence in Games

Cited by 168

Harms from Increasingly Agentic Algorithmic Systems

Chan, A., Salganik, R., Markelius, A., Pang, C., Rajkumar, N., Krasheninnikov, D., Langosco, L., He, Z., Duan, Y., Carroll, M., et al. (2023) · 2023 ACM Conference on Fairness Accountability and Transparency

Ethics and Social Impacts of AIExplainable Artificial Intelligence (XAI)

Cited by 149

Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback

Casper, S., Davies, X., Shi, C., Gilbert, T. K., Scheurer, J., Rando, J., Freedman, R., Korbak, T., Lindner, D., Freire, P., et al. (2023) · arXiv

Reinforcement Learning in RoboticsPsychiatry, Mental Health, Neuroscience

Cited by 101

Humanity's Last Exam

Phan, L., Gatti, A., Han, Z., Li, N., Hu, J., Zhang, H., Zhang, C. B. C., Shaaban, M., Ling, J., Shi, S., et al. (2025) · arXiv

Topic ModelingMultimodal Machine Learning Applications

Cited by 65

OpenAI GPT-5 System Card

Singh, A., Fry, A., Perelman, A., Tart, A., Ganesh, A., El-Kishky, A., McLaughlin, A., Low, A., Ostrow, A., Ananthram, A., et al. (2026) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 26

Estimating and Penalizing Preference Shift in Recommender Systems

Carroll, M., Hadfield-Menell, D., Russell, S., & Dragan, A. (2021) · Fifteenth ACM Conference on Recommender Systems

Recommender Systems and TechniquesEthics and Social Impacts of AI

Cited by 20

Estimating and Penalizing Induced Preference Shifts in Recommender Systems

Carroll, M., Dragan, A., Russell, S., & Hadfield-Menell, D. (2022) · arXiv

Recommender Systems and TechniquesEthics and Social Impacts of AI

Cited by 11

AI Alignment with Changing and Influenceable Reward Functions

Carroll, M., Foote, D., Siththaranjan, A., Russell, S., & Dragan, A. (2024) · arXiv

Ethics and Social Impacts of AIReinforcement Learning in Robotics

Cited by 7