McCandlish, Sam

Language Models are Few-Shot Learners

Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv

Topic ModelingDomain Adaptation and Few-Shot Learning

Cited by 23,372

Scaling Laws for Neural Language Models

Kaplan, J., McCandlish, S., Henighan, T., Brown, T. B., Chess, B., Child, R., Gray, S., Radford, A., Wu, J., & Amodei, D. (2020) · arXiv

Artificial Intelligence ApplicationsTopic Modeling

Cited by 9,550

Evaluating Large Language Models Trained on Code

Chen, M., Tworek, J., Jun, H., Yuan, Q., Pinto, H. P. D. O., Kaplan, J., Edwards, H., Burda, Y., Joseph, N., Brockman, G., et al. (2021) · arXiv

Software Engineering ResearchNatural Language Processing Techniques

Cited by 1,436

In-context Learning and Induction Heads

Olsson, C., Elhage, N., Nanda, N., Joseph, N., DasSarma, N., Henighan, T., Mann, B., Askell, A., Bai, Y., Chen, A., et al. (2022) · arXiv

Topic ModelingDomain Adaptation and Few-Shot Learning

Cited by 1,170

Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback

Bai, Y., Jones, A., Ndousse, K., Askell, A., Chen, A., DasSarma, N., Drain, D., Fort, S., Ganguli, D., Henighan, T., et al. (2022) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 442

Predictability and Surprise in Large Generative Models

Ganguli, D., Hernandez, D., Lovitt, L., DasSarma, N., Henighan, T., Jones, A., Joseph, N., Kernion, J., Mann, B., Askell, A., et al. (2022) · arXiv

Ethics and Social Impacts of AIExplainable Artificial Intelligence (XAI)

Cited by 324

Predictability and Surprise in Large Generative Models

Ganguli, D., Hernandez, D., Lovitt, L., Askell, A., Bai, Y., Chen, A., Conerly, T., Dassarma, N., Drain, D., Elhage, N., et al. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency

Ethics and Social Impacts of AIExplainable Artificial Intelligence (XAI)

Cited by 207

Discovering Language Model Behaviors with Model-Written Evaluations

Perez, E., Ringer, S., Lukosiute, K., Nguyen, K., Chen, E., Heiner, S., Pettit, C., Olsson, C., Kundu, S., Kadavath, S., et al. (2023) · Findings of the Association for Computational Linguistics: ACL 2023

Topic ModelingNatural Language Processing Techniques

Cited by 194

Language Models (Mostly) Know What They Know

Kadavath, S., Conerly, T., Askell, A., Henighan, T., Drain, D., Perez, E., Schiefer, N., Hatfield-Dodds, Z., DasSarma, N., Tran-Johnson, E., et al. (2022) · arXiv

Topic ModelingAdversarial Robustness in Machine Learning

Cited by 187

Scaling Laws for Autoregressive Generative Modeling

Henighan, T., Kaplan, J., Katz, M., Chen, M., Hesse, C., Jackson, J., Jun, H., Brown, T. B., Dhariwal, P., Gray, S., et al. (2020) · arXiv

Advanced Neural Network ApplicationsGenerative Adversarial Networks and Image Synthesis

Cited by 150

A General Language Assistant as a Laboratory for Alignment

Askell, A., Bai, Y., Chen, A., Drain, D., Ganguli, D., Henighan, T., Jones, A., Joseph, N., Mann, B., DasSarma, N., et al. (2021) · arXiv

Topic ModelingEthics and Social Impacts of AI

Cited by 146

Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learned

Ganguli, D., Lovitt, L., Kernion, J., Askell, A., Bai, Y., Kadavath, S., Mann, B., Perez, E., Schiefer, N., Ndousse, K., et al. (2022) · arXiv

Adversarial Robustness in Machine LearningEthics and Social Impacts of AI

Cited by 130

Discovering Language Model Behaviors with Model-Written Evaluations

Perez, E., Ringer, S., Lukošiūtė, K., Nguyen, K., Chen, E., Heiner, S., Pettit, C., Olsson, C., Kundu, S., Kadavath, S., et al. (2022) · arXiv

Ethics and Social Impacts of AITopic Modeling

Cited by 53

The Capacity for Moral Self-Correction in Large Language Models

Ganguli, D., Askell, A., Schiefer, N., Liao, T. I., Lukošiūtė, K., Chen, A., Goldie, A., Mirhoseini, A., Olsson, C., Hernandez, D., et al. (2023) · arXiv

Ethics and Social Impacts of AITopic Modeling

Cited by 53

Scaling Laws for Transfer

Hernandez, D., Kaplan, J., Henighan, T., & McCandlish, S. (2021) · arXiv

Domain Adaptation and Few-Shot LearningTopic Modeling

Cited by 51

Toy Models of Superposition

Elhage, N., Hume, T., Olsson, C., Schiefer, N., Henighan, T., Kravec, S., Hatfield-Dodds, Z., Lasenby, R., Drain, D., Chen, C., et al. (2022) · arXiv

Neural Networks and ApplicationsAdvanced Neural Network Applications

Cited by 51

Towards Measuring the Representation of Subjective Global Opinions in Language Models

Durmus, E., Nguyen, K., Liao, T. I., Schiefer, N., Askell, A., Bakhtin, A., Chen, C., Hatfield-Dodds, Z., Hernandez, D., Joseph, N., et al. (2023) · arXiv

Ethics and Social Impacts of AITopic Modeling

Cited by 48

Measuring Progress on Scalable Oversight for Large Language Models

Bowman, S. R., Hyun, J., Perez, E., Chen, E., Pettit, C., Heiner, S., Lukošiūtė, K., Askell, A., Jones, A., Chen, A., et al. (2022) · arXiv

Ethics and Social Impacts of AINatural Language Processing Techniques

Cited by 34

Measuring Faithfulness in Chain-of-Thought Reasoning

Lanham, T., Chen, A., Radhakrishnan, A., Steiner, B., Denison, C., Hernandez, D., Li, D., Durmus, E., Hubinger, E., Kernion, J., et al. (2023) · arXiv

Topic ModelingExplainable Artificial Intelligence (XAI)

Cited by 33

Studying Large Language Model Generalization with Influence Functions

Grosse, R., Bae, J., Anil, C., Elhage, N., Tamkin, A., Tajdini, A., Steiner, B., Li, D., Durmus, E., Perez, E., et al. (2023) · arXiv

Explainable Artificial Intelligence (XAI)Adversarial Robustness in Machine Learning

Cited by 26

Scaling Laws and Interpretability of Learning from Repeated Data

Hernandez, D., Brown, T., Conerly, T., DasSarma, N., Drain, D., El-Showk, S., Elhage, N., Hatfield-Dodds, Z., Henighan, T., Hume, T., et al. (2022) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 24

Question Decomposition Improves the Faithfulness of Model-Generated Reasoning

Radhakrishnan, A., Nguyen, K., Chen, A., Chen, C., Denison, C., Hernandez, D., Durmus, E., Hubinger, E., Kernion, J., Lukošiūtė, K., et al. (2023) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 8

Specific versus General Principles for Constitutional AI

Kundu, S., Bai, Y., Kadavath, S., Askell, A., Callahan, A., Chen, A., Goldie, A., Balwit, A., Mirhoseini, A., McLean, B., et al. (2023) · arXiv

Ethics and Social Impacts of AISpeech and dialogue systems

Cited by 7