Leike, Jan

Training language models to follow instructions with human feedback

Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C. L., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., et al. (2022) · arXiv

Domain Adaptation and Few-Shot LearningTopic Modeling

Cited by 4,208

Training Language Models to Follow Instructions with Human Feedback

Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., et al. (2022) · Advances in Neural Information Processing Systems 35

Natural Language Processing TechniquesTopic Modeling

Cited by 3,117

Evaluating Large Language Models Trained on Code

Chen, M., Tworek, J., Jun, H., Yuan, Q., Pinto, H. P. D. O., Kaplan, J., Edwards, H., Burda, Y., Joseph, N., Brockman, G., et al. (2021) · arXiv

Software Engineering ResearchNatural Language Processing Techniques

Cited by 1,436

Deep reinforcement learning from human preferences

Christiano, P., Leike, J., Brown, T. B., Martic, M., Legg, S., & Amodei, D. (2017) · arXiv

Reinforcement Learning in RoboticsMachine Learning and Algorithms

Cited by 1,058

AI Safety Gridworlds

Leike, J., Martic, M., Krakovna, V., Ortega, P. A., Everitt, T., Lefrancq, A., Orseau, L., & Legg, S. (2017) · arXiv

Reinforcement Learning in RoboticsEthics and Social Impacts of AI

Cited by 240

GPT-4o System Card

OpenAI, :, Hurst, A., Lerer, A., Goucher, A. P., Perelman, A., Ramesh, A., Clark, A., Ostrow, A., Welihinda, A., et al. (2024) · arXiv

Multimodal Machine Learning ApplicationsTopic Modeling

Cited by 180

Scalable agent alignment via reward modeling: a research direction

Leike, J., Krueger, D., Everitt, T., Martic, M., Maini, V., & Legg, S. (2018) · arXiv

Reinforcement Learning in RoboticsDomain Adaptation and Few-Shot Learning

Cited by 121

Reward learning from human preferences and demonstrations in Atari

Ibarz, B., Leike, J., Pohlen, T., Irving, G., Legg, S., & Amodei, D. (2018) · arXiv

Reinforcement Learning in RoboticsArtificial Intelligence in Games

Cited by 117

Recursively Summarizing Books with Human Feedback

Wu, J., Ouyang, L., Ziegler, D. M., Stiennon, N., Lowe, R., Leike, J., & Christiano, P. (2021) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 76

Let's Verify Step by Step

Lightman, H., Kosaraju, V., Burda, Y., Edwards, H., Baker, B., Lee, T., Leike, J., Schulman, J., Sutskever, I., & Cobbe, K. (2023) · arXiv

Topic ModelingMachine Learning and Algorithms

Cited by 65

Self-critiquing models for assisting human evaluators

Saunders, W., Yeh, C., Wu, J., Bills, S., Ouyang, L., Ward, J., & Leike, J. (2022) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 50

Weak-to-Strong Generalization: Eliciting Strong Capabilities With Weak Supervision

Burns, C., Izmailov, P., Kirchner, J. H., Baker, B., Gao, L., Aschenbrenner, L., Chen, Y., Ecoffet, A., Joglekar, M., Leike, J., et al. (2023) · arXiv

Topic ModelingDomain Adaptation and Few-Shot Learning

Cited by 34

Scaling and evaluating sparse autoencoders

Gao, L., la Tour, T. D., Tillman, H., Goh, G., Troll, R., Radford, A., Sutskever, I., Leike, J., & Wu, J. (2024) · arXiv

Topic ModelingExplainable Artificial Intelligence (XAI)

Cited by 21

Reasoning Models Don't Always Say What They Think

Chen, Y., Benton, J., Radhakrishnan, A., Uesato, J., Denison, C., Schulman, J., Somani, A., Hase, P., Wagner, M., Roger, F., et al. (2025) · arXiv

Explainable Artificial Intelligence (XAI)Ethics and Social Impacts of AI

Cited by 18

Hidden Incentives for Auto-Induced Distributional Shift

Krueger, D., Maharaj, T., & Leike, J. (2020) · arXiv

Ethics and Social Impacts of AIRecommender Systems and Techniques

Cited by 14

LLM Critics Help Catch LLM Bugs

McAleese, N., Pokorny, R. M., Uribe, J. F. C., Nitishinskaya, E., Trebacz, M., & Leike, J. (2024) · arXiv

Software Engineering ResearchSoftware Testing and Debugging Techniques

Cited by 10

Constitutional Classifiers: Defending against Universal Jailbreaks across Thousands of Hours of Red Teaming

Sharma, M., Tong, M., Mu, J., Wei, J., Kruthoff, J., Goodfriend, S., Ong, E., Peng, A., Agarwal, R., Anil, C., et al. (2025) · arXiv

Adversarial Robustness in Machine LearningSecurity and Verification in Computing

Cited by 7

Auditing language models for hidden objectives

Marks, S., Treutlein, J., Bricken, T., Lindsey, J., Marcus, J., Mishra-Sharma, S., Ziegler, D., Ameisen, E., Batson, J., Belonax, T., et al. (2025) · arXiv

Explainable Artificial Intelligence (XAI)Ethics and Social Impacts of AI

Cited by 4

Prover-Verifier Games improve legibility of LLM outputs

Kirchner, J. H., Chen, Y., Edwards, H., Leike, J., McAleese, N., & Burda, Y. (2024) · arXiv

Adversarial Robustness in Machine LearningExplainable Artificial Intelligence (XAI)

Cited by 2

Unsupervised Elicitation of Language Models

Wen, J., Ankner, Z., Somani, A., Hase, P., Marks, S., Goldman-Wetzler, J., Petrini, L., Sleight, H., Burns, C., He, H., et al. (2025) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 0