Drain, Dawn

In-context Learning and Induction Heads

Olsson, C., Elhage, N., Nanda, N., Joseph, N., DasSarma, N., Henighan, T., Mann, B., Askell, A., Bai, Y., Chen, A., et al. (2022) · arXiv

Topic ModelingDomain Adaptation and Few-Shot Learning

Cited by 1,170

CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation

Lu, S., Guo, D., Ren, S., Huang, J., Svyatkovskiy, A., Blanco, A., Clement, C., Drain, D., Jiang, D., Tang, D., et al. (2021) · arXiv

Software Engineering ResearchTopic Modeling

Cited by 536

GraphCodeBERT: Pre-training Code Representations with Data Flow

Guo, D., Ren, S., Lu, S., Feng, Z., Tang, D., Liu, S., Zhou, L., Duan, N., Svyatkovskiy, A., Fu, S., et al. (2020) · arXiv

Software Engineering ResearchTopic Modeling

Cited by 480

Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback

Bai, Y., Jones, A., Ndousse, K., Askell, A., Chen, A., DasSarma, N., Drain, D., Fort, S., Ganguli, D., Henighan, T., et al. (2022) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 442

Predictability and Surprise in Large Generative Models

Ganguli, D., Hernandez, D., Lovitt, L., DasSarma, N., Henighan, T., Jones, A., Joseph, N., Kernion, J., Mann, B., Askell, A., et al. (2022) · arXiv

Ethics and Social Impacts of AIExplainable Artificial Intelligence (XAI)

Cited by 324

Predictability and Surprise in Large Generative Models

Ganguli, D., Hernandez, D., Lovitt, L., Askell, A., Bai, Y., Chen, A., Conerly, T., Dassarma, N., Drain, D., Elhage, N., et al. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency

Ethics and Social Impacts of AIExplainable Artificial Intelligence (XAI)

Cited by 207

Discovering Language Model Behaviors with Model-Written Evaluations

Perez, E., Ringer, S., Lukosiute, K., Nguyen, K., Chen, E., Heiner, S., Pettit, C., Olsson, C., Kundu, S., Kadavath, S., et al. (2023) · Findings of the Association for Computational Linguistics: ACL 2023

Topic ModelingNatural Language Processing Techniques

Cited by 194

Language Models (Mostly) Know What They Know

Kadavath, S., Conerly, T., Askell, A., Henighan, T., Drain, D., Perez, E., Schiefer, N., Hatfield-Dodds, Z., DasSarma, N., Tran-Johnson, E., et al. (2022) · arXiv

Topic ModelingAdversarial Robustness in Machine Learning

Cited by 187

A General Language Assistant as a Laboratory for Alignment

Askell, A., Bai, Y., Chen, A., Drain, D., Ganguli, D., Henighan, T., Jones, A., Joseph, N., Mann, B., DasSarma, N., et al. (2021) · arXiv

Topic ModelingEthics and Social Impacts of AI

Cited by 146

Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learned

Ganguli, D., Lovitt, L., Kernion, J., Askell, A., Bai, Y., Kadavath, S., Mann, B., Perez, E., Schiefer, N., Ndousse, K., et al. (2022) · arXiv

Adversarial Robustness in Machine LearningEthics and Social Impacts of AI

Cited by 130

Discovering Language Model Behaviors with Model-Written Evaluations

Perez, E., Ringer, S., Lukošiūtė, K., Nguyen, K., Chen, E., Heiner, S., Pettit, C., Olsson, C., Kundu, S., Kadavath, S., et al. (2022) · arXiv

Ethics and Social Impacts of AITopic Modeling

Cited by 53

The Capacity for Moral Self-Correction in Large Language Models

Ganguli, D., Askell, A., Schiefer, N., Liao, T. I., Lukošiūtė, K., Chen, A., Goldie, A., Mirhoseini, A., Olsson, C., Hernandez, D., et al. (2023) · arXiv

Ethics and Social Impacts of AITopic Modeling

Cited by 53

Toy Models of Superposition

Elhage, N., Hume, T., Olsson, C., Schiefer, N., Henighan, T., Kravec, S., Hatfield-Dodds, Z., Lasenby, R., Drain, D., Chen, C., et al. (2022) · arXiv

Neural Networks and ApplicationsAdvanced Neural Network Applications

Cited by 51

Measuring Progress on Scalable Oversight for Large Language Models

Bowman, S. R., Hyun, J., Perez, E., Chen, E., Pettit, C., Heiner, S., Lukošiūtė, K., Askell, A., Jones, A., Chen, A., et al. (2022) · arXiv

Ethics and Social Impacts of AINatural Language Processing Techniques

Cited by 34

Scaling Laws and Interpretability of Learning from Repeated Data

Hernandez, D., Brown, T., Conerly, T., DasSarma, N., Drain, D., El-Showk, S., Elhage, N., Hatfield-Dodds, Z., Henighan, T., Hume, T., et al. (2022) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 24

Long-Range Modeling of Source Code Files with eWASH: Extended Window Access by Syntax Hierarchy

Clement, C., Lu, S., Liu, X., Tufano, M., Drain, D., Duan, N., Sundaresan, N., & Svyatkovskiy, A. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing

Software Engineering ResearchTopic Modeling

Cited by 12