Santoro, Adam

A simple neural network module for relational reasoning

Santoro, A., Raposo, D., Barrett, D. G. T., Malinowski, M., Pascanu, R., Battaglia, P., & Lillicrap, T. (2017) · arXiv

Multimodal Machine Learning ApplicationsLogic, Reasoning, and Knowledge

Cited by 1,281

Backpropagation and the brain

Lillicrap, T. P., Santoro, A., Marris, L., Akerman, C. J., & Hinton, G. (2020) · Nature Reviews Neuroscience

Neural Networks and ApplicationsNeural dynamics and brain function

Cited by 908

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

Srivastava, A., Rastogi, A., Rao, A., Shoeb, A. A. M., Abid, A., Fisch, A., Brown, A. R., Santoro, A., Gupta, A., Garriga-Alonso, A., et al. (2022) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 569

Patterns across multiple memories are identified over time

Richards, B. A., Xia, F., Santoro, A., Husse, J., Woodin, M. A., Josselyn, S. A., & Frankland, P. W. (2014) · Nature Neuroscience

Memory and Neural MechanismsMemory Processes and Influences

Cited by 150

Environmental drivers of systematicity and generalization in a situated agent

Hill, F., Lampinen, A., Schneider, R., Clark, S., Botvinick, M., McClelland, J. L., & Santoro, A. (2019) · arXiv

Reinforcement Learning in RoboticsDomain Adaptation and Few-Shot Learning

Cited by 81

Data Distributional Properties Drive Emergent In-Context Learning in Transformers

Chan, S., Santoro, A., Lampinen, A., Wang, J., Singh, A., Richemond, P., McClelland, J., & Hill, F. (2022) · Advances in Neural Information Processing Systems 35

Topic ModelingDomain Adaptation and Few-Shot Learning

Cited by 69

Data Distributional Properties Drive Emergent In-Context Learning in Transformers

Chan, S. C. Y., Santoro, A., Lampinen, A. K., Wang, J. X., Singh, A., Richemond, P. H., McClelland, J., & Hill, F. (2022) · arXiv

Topic ModelingDomain Adaptation and Few-Shot Learning

Cited by 69

Imitating Interactive Intelligence

Abramson, J., Ahuja, A., Barr, I., Brussee, A., Carnevale, F., Cassin, M., Chhaparia, R., Clark, S., Damoc, B., Dudzik, A., et al. (2020) · arXiv

Reinforcement Learning in RoboticsSocial Robot Interaction and HRI

Cited by 43

Tell me why! Explanations support learning relational and causal structure

Lampinen, A. K., Roy, N. A., Dasgupta, I., Chan, S. C. Y., Tam, A. C., McClelland, J. L., Yan, C., Santoro, A., Rabinowitz, N. C., Wang, J. X., et al. (2021) · arXiv

Reinforcement Learning in RoboticsExplainable Artificial Intelligence (XAI)

Cited by 14

Synthetic Returns for Long-Term Credit Assignment

Raposo, D., Ritter, S., Santoro, A., Wayne, G., Weber, T., Botvinick, M., van Hasselt, H., & Song, F. (2021) · arXiv

Reinforcement Learning in RoboticsArtificial Intelligence in Games

Cited by 12

Mixture-of-Depths: Dynamically allocating compute in transformer-based language models

Raposo, D., Ritter, S., Richards, B., Lillicrap, T., Humphreys, P. C., & Santoro, A. (2024) · arXiv

Advanced Neural Network ApplicationsTopic Modeling

Cited by 8

Intra-agent speech permits zero-shot task acquisition

Yan, C., Carnevale, F., Georgiev, P., Santoro, A., Guy, A., Muldal, A., Hung, C.-C., Abramson, J., Lillicrap, T., & Wayne, G. (2022) · arXiv

Speech and dialogue systemsDomain Adaptation and Few-Shot Learning

Cited by 3