Davies, Xander

Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback

Casper, S., Davies, X., Shi, C., Gilbert, T. K., Scheurer, J., Rando, J., Freedman, R., Korbak, T., Lindner, D., Freire, P., et al. (2023) · arXiv

Reinforcement Learning in RoboticsPsychiatry, Mental Health, Neuroscience

Cited by 101

Discovering Variable Binding Circuitry with Desiderata

Davies, X., Nadeau, M., Prakash, N., Shaham, T. R., & Bau, D. (2023) · arXiv

Explainable Artificial Intelligence (XAI)Topic Modeling

Cited by 27

AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agents

Andriushchenko, M., Souly, A., Dziemian, M., Duenas, D., Lin, M., Wang, J., Hendrycks, D., Zou, A., Kolter, Z., Fredrikson, M., et al. (2024) · arXiv

Adversarial Robustness in Machine LearningAccess Control and Trust

Cited by 11

Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback

Casper, S., Davies, X., Shi, C., Krendl Gilbert, T., Scheurer, J., Rando Ramirez, J., Freedman, R., Korbak, T., Lindner, D., Freire, P., et al. (2023) · ETH Zurich

Reinforcement Learning in RoboticsMachine Learning and Algorithms

Cited by 3

Fundamental Limitations in Pointwise Defences of LLM Finetuning APIs

Davies, X., Winsor, E., Souly, A., Korbak, T., Kirk, R., de Witt, C. S., & Gal, Y. (2025) · arXiv

Adversarial Robustness in Machine LearningSecurity and Verification in Computing

Cited by 0

Deep Ignorance: Filtering Pretraining Data Builds Tamper-Resistant Safeguards into Open-Weight LLMs

O'Brien, K., Casper, S., Anthony, Q., Korbak, T., Kirk, R., Davies, X., Mishra, I., Irving, G., Gal, Y., & Biderman, S. (2025) · arXiv

Adversarial Robustness in Machine LearningTopic Modeling

Cited by 0