Environmental drivers of systematicity and generalization in a situated agent
Open accessAbstract
The question of whether deep neural networks are good at generalising beyond their immediate training experience is of critical importance for learning-based approaches to AI. Here, we consider tests of out-of-sample generalisation that require an agent to respond to never-seen-before instructions by manipulating and positioning objects in a 3D Unity simulated room. We first describe a comparatively generic agent architecture that exhibits strong performance on these tests. We then identify three aspects of the training regime and environment that make a significant difference to its performance: (a) the number of object/word experiences in the training set; (b) the visual invariances afforded by the agent's perspective, or frame of reference; and (c) the variety of visual input inherent in the perceptual aspect of the agent's perception. Our findings indicate that the degree of generalisation that networks exhibit can depend critically on particulars of the environment in which a given task is instantiated. They further suggest that the propensity for neural networks to generalise in systematic ways may increase if, like human children, those networks have access to many frames of richly varying, multi-modal observations as they learn.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
When language is tied to rich environments, a system's grasp of language can become more systematic and generalizable.
“In turn, grounding language in rich environments can make a system's understanding of the language itself more systematic and generalizable (Hill et al., 2019).”
From Scaling Instructable Agents Across Many Simulated Worlds (2024) · cites this paper as Hill et al., 2019
Empirical evidence indicates that grounding supports even basic generalization; Hill et al. (2019) found that agents in richer, more embodied environments show more systematic compositional generalization.
“Beyond this theoretical argument, empirical evidence shows that grounding can support even fundamental kinds of generalization- Hill et al. (2019) show that agents grounded in richer, more-embodied environments exhibit more systematic compositional generalization.”
From Scaling Instructable Agents Across Many Simulated Worlds (2024) · cites this paper as Hill et al., 2019
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The publisher hasn’t deposited this paper’s reference list.
Research works printed but not linked: 36
- Zeyuan Allen-Zhu, Yuanzhi Li, and Yingyu Liang. Learning and generalization in overparameterized neural networks, going beyond two layers. arXiv preprint arXiv:1811.04918 , 2018. · arXiv
- Michael L Anderson. Embodied cognition: A field guide. Artificial intelligence , 149(1):91-130, 2003.
- Philip W Anderson. More is different. Science , 177(4047):393-396, 1972.
- Jacob Andreas, Marcus Rohrbach, Trevor Darrell, and Dan Klein. Neural module networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , pp. 39-48, 2016.
- Jacob Andreas, Dan Klein, and Sergey Levine. Modular multitask reinforcement learning with policy sketches. In Proceedings of the 34th International Conference on Machine LearningVolume 70 , pp. 166-175. JMLR. org, 2017.
- Sanjeev Arora, Rong Ge, Behnam Neyshabur, and Yi Zhang. Stronger generalization bounds for deep nets via a compression approach. arXiv preprint arXiv:1802.05296 , 2018. · arXiv
- Sanjeev Arora, Simon S Du, Wei Hu, Zhiyuan Li, and Ruosong Wang. Fine-grained analysis of optimization and generalization for overparameterized two-layer neural networks. arXiv preprint arXiv:1901.08584 , 2019. · arXiv
- Dzmitry Bahdanau, Shikhar Murty, Michael Noukhovitch, Thien Huu Nguyen, Harm de Vries, and Aaron Courville. Systematic generalization: What is required and can it be learned? arXiv preprint arXiv:1811.12889 , 2018. · arXiv
- Peter W Battaglia, Jessica B Hamrick, Victor Bapst, Alvaro Sanchez-Gonzalez, Vinicius Zambaldi, Mateusz Malinowski, Andrea Tacchetti, David Raposo, Adam Santoro, Ryan Faulkner, et al. Relational inductive biases, deep learning, and graph networks. arXiv preprint arXiv:1806.01261 , 2018. · arXiv
- Charles Beattie, Joel Z. Leibo, Denis Teplyashin, Tom Ward, Marcus Wainwright, Heinrich K¨ uttler, Andrew Lefrancq, Simon Green, V´ ıctor Vald´ es, Amir Sadik, Julian Schrittwieser, Keith Anderson, Sarah York, Max Cant, Adam Cain, Adrian Bolton, Stephen Gaffney, Helen King, Demis Hassabis, Shane Legg, and Stig Petersen. Deepmind lab. arXiv preprint arXiv:1612.03801 , 2016. · arXiv
- Devendra Singh Chaplot, Kanthashree Mysore Sathyendra, Rama Kumar Pasumarthi, Dheeraj Rajagopal, and Ruslan Salakhutdinov. Gated-attention architectures for task-oriented language grounding. In Thirty-Second AAAI Conference on Artificial Intelligence , 2018.
- Elizabeth M Clerkin, Elizabeth Hart, James M Rehg, Chen Yu, and Linda B Smith. Real-world visual statistics and infants' first-learned object names. Philosophical Transactions of the Royal Society B: Biological Sciences , 372(1711):20160055, 2017.
- Lasse Espeholt, Hubert Soyer, Remi Munos, Karen Simonyan, Volodymir Mnih, Tom Ward, Yotam Doron, Vlad Firoiu, Tim Harley, Iain Dunning, et al. Impala: Scalable distributed deep-rl with importance weighted actor-learner architectures. arXiv preprint arXiv:1802.01561 , 2018. · arXiv
- Stefan L Frank. Learn more by training less: systematicity in sentence processing by recurrent networks. Connection Science , 18(3):287-302, 2006.
- Irina Higgins, Nicolas Sonnerat, Loic Matthey, Arka Pal, Christopher P Burgess, Matko Bosnjak, Murray Shanahan, Matthew Botvinick, Demis Hassabis, and Alexander Lerchner. Scan: Learning hierarchical compositional visual concepts. arXiv preprint arXiv:1707.03389 , 2017. · arXiv
- Felix Hill, Karl Moritz Hermann, Phil Blunsom, and Stephen Clark. Understanding grounded language learning agents. arXiv preprint arXiv:1710.09867 , 2017. · arXiv
- Karin H James, Susan S Jones, Linda B Smith, and Shelley N Swain. Young children's selfgenerated object views and object recognition. Journal of Cognition and Development , 15(3): 393-401, 2014.
- Philip J Kellman and Martha E Arterberry. The cradle of knowledge: Development of perception in infancy . MIT press, 2000.
- Brenden M Lake. Compositional generalization through meta sequence-to-sequence learning. arXiv preprint arXiv:1906.05381 , 2019. · arXiv
- Brenden M Lake and Marco Baroni. Generalization without systematicity: On the compositional skills of sequence-to-sequence recurrent networks. arXiv preprint arXiv:1711.00350 , 2017. · arXiv
- Brenden M Lake, Ruslan Salakhutdinov, and Joshua B Tenenbaum. Human-level concept learning through probabilistic program induction. Science , 350(6266):1332-1338, 2015.
- Brenden M Lake, Tal Linzen, and Marco Baroni. Human few-shot learning of compositional instructions. arXiv preprint arXiv:1901.04587 , 2019. · arXiv
- Andrew K Lampinen and Surya Ganguli. An analytic theory of generalization dynamics and transfer learning in deep linear networks. arXiv preprint arXiv:1809.10374 , 2018. · arXiv
- Jiayuan Mao, Chuang Gan, Pushmeet Kohli, Joshua B Tenenbaum, and Jiajun Wu. The neurosymbolic concept learner: Interpreting scenes, words, and sentences from natural supervision. arXiv preprint arXiv:1904.12584 , 2019. · arXiv
- Gary F Marcus. Rethinking eliminative connectionism. Cognitive psychology , 37(3):243-282, 1998.
- James L McClelland, David E Rumelhart, PDP Research Group, et al. Parallel distributed processing , volume 2. MIT press Cambridge, MA:, 1987.
- James L McClelland, Matthew M Botvinick, David C Noelle, David C Plaut, Timothy T Rogers, Mark S Seidenberg, and Linda B Smith. Letting structure emerge: connectionist and dynamical systems approaches to cognition. Trends in cognitive sciences , 14(8):348-356, 2010.
- Marvin Minsky and Seymour Papert. Perceptron: an introduction to computational geometry. The MIT Press, Cambridge, expanded edition , 19(88):2, 1969.
- Randall C O'Reilly. Generalization in interactive networks: The benefits of inhibitory competition and hebbian learning. Neural computation , 13(6):1199-1241, 2001.
- Randall C O'Reilly, Alex A Petrov, Jonathan D Cohen, Christian J Lebiere, Seth A Herd, Trent Kriete, In Paco Calvo, and John Symons. How limited systematicity emerges: A computational cognitive neuroscience approach. The architecture of cognition: Rethinking fodor and Pylyshyn's systematicity challenge , 2013.
- David C Plaut. Systematicity and specialization in semantics. In Connectionist Models in Cognitive Neuroscience , pp. 184-193. Springer, 1999.
- D. E. Rumelhart, G. E. Hinton, and R. J. Williams. Learning internal representations by error propagation. In J L McClelland, D E Rumelhart, PDP Research Group, et al. (eds.), Parallel distributed processing , volume 2, chapter 8, pp. 318-362. The MIT Press, 1986.
- Mark Steedman. Connectionist sentence processing in perspective. Cognitive Science , 23(4):615634, 1999.
- Mark Steedman. Taking Scope - The Natural Semantics of Quantifiers . The MIT Press, 2011.
- Haonan Yu, Haichao Zhang, and Wei Xu. Interactive grounded language acquisition and generalization in a 2d world. arXiv preprint arXiv:1802.01433 , 2018. · arXiv
- Daniel Yurovsky, Linda B Smith, and Chen Yu. Statistical word learning at scale: The baby's view is better. Developmental science , 16(6):959-966, 2013.
Cited by
Sorted by citations
Learning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293 · see citing works
Using cognitive psychology to understand GPT-3
Binz, M., & Schulz, E. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2218523120 · Cited by 559 · see citing works
“The upside of our findings is the recommendation that to create more intelligent agents, researchers should not only scale up algorithms that are passively fed with data but instead let agents directly interact and engage with the world (39, 40).”
BackgroundThe Next Decade in AI: Four Steps Towards Robust Artificial Intelligence
Marcus, G. (2020) · arXiv · doi:10.48550/arxiv.2002.06177 · Cited by 297 · see citing works
How variability shapes learning and generalization
Raviv, L., Lupyan, G., & Green, C. S. (2022) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2022.03.007 · Cited by 212 · see citing works
A Survey of Zero-shot Generalisation in Deep Reinforcement Learning
Kirk, R., Zhang, A., Grefenstette, E., & Rocktäschel, T. (2023) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.14174 · Cited by 193 · see citing works
“…with worse generalisation; Igl et al. (2021) studies transient non-stationarity in RL and shows that it negatively impacts RL generalisation; and Hill et al. (2020a) investigates what environmental factors affect generalisation in an instruction-following task, finding for example that an…”
BackgroundAbstraction and analogy‐making in artificial intelligence
Mitchell, M. (2021) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.14619 · Cited by 125 · see citing works
Auxiliary Tasks and Exploration Enable ObjectGoal Navigation
Ye, J., Batra, D., Das, A., & Wijmans, E. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01581 · Cited by 120 · see citing works
Interactive Language: Talking to Robots in Real Time
Lynch, C., Wahid, A., Tompson, J., Ding, T., Betker, J., Baruch, R., Armstrong, T., & Florence, P. (2022) · arXiv · doi:10.48550/arxiv.2210.06407 · Cited by 113 · see citing works
Towards Principled Disentanglement for Domain Generalization
Zhang, H., Zhang, Y., Liu, W., Weller, A., Schölkopf, B., & Xing, E. P. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00786 · Cited by 107 · see citing works
On the Binding Problem in Artificial Neural Networks
Greff, K., van Steenkiste, S., & Schmidhuber, J. (2020) · arXiv · doi:10.48550/arxiv.2012.05208 · Cited by 102 · see citing works
McClelland, J. L., Hill, F., Rudolph, M., Baldridge, J., & Schütze, H. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1910416117 · Cited by 91 · see citing works
Self-citationCompositional Generalization in Semantic Parsing: Pre-training vs. Specialized ArchitecturesPreprint
Furrer, D., van Zee, M., Scales, N., & Schärli, N. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.08970 · Cited by 79 · see citing works
A Benchmark for Systematic Generalization in Grounded Language UnderstandingPreprint
Ruis, L., Andreas, J., Baroni, M., Bouchacourt, D., & Lake, B. M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.05161 · Cited by 66 · see citing works
Artificial Intelligence and the Common Sense of Animals
Shanahan, M., Crosby, M., Beyret, B., & Cheke, L. G. (2020) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2020.09.002 · Cited by 59 · see citing works
From Deep Learning to Rational Machines
Buckner, C. J. (2023) · doi:10.1093/oso/9780197653302.001.0001 · Cited by 55 · see citing works
Learning TSP Requires Rethinking Generalization
Joshi, C. K., Cappart, Q., Rousseau, L.-M., & Laurent, T. (2021) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.cp.2021.33 · Cited by 46 · see citing works
Graph Density-Aware Losses for Novel Compositions in Scene Graph Generation
Knyazev, B. A., de Vries, H., Cangea, C., Taylor, G. W., Courville, A. C., & Belilovsky, E. (2020) · British Machine Vision Conference (BMVC) · doi:10.5244/c.34.99 · Cited by 46 · see citing works
Warmth and competence in human-agent cooperation
McKee, K. R., Bai, X., & Fiske, S. (2022) · Autonomous Agents and Multi-Agent Systems · doi:10.1007/s10458-024-09649-6 · Cited by 60 · see citing works
Imitating Interactive Intelligence
Abramson, J., Ahuja, A., Barr, I., Brussee, A., Carnevale, F., Cassin, M., Chhaparia, R., Clark, S., Damoc, B., Dudzik, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2012.05672 · Cited by 43 · see citing works
Self-citationGrounded Language Learning Fast and Slow
Hill, F., Tieleman, O., von Glehn, T., Wong, N., Merzic, H., & Clark, S. (2020) · arXiv · doi:10.48550/arxiv.2009.01719 · Cited by 35 · see citing works
Self-citationGenerative Compositional Augmentations for Scene Graph Prediction
Knyazev, B. A., de Vries, H., Cangea, C., Taylor, G. W., Courville, A. C., & Belilovsky, E. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01553 · Cited by 31 · see citing works
The role of Disentanglement in Generalisation
Montero, M. L., Ludwig, C. J. H., Costa, R. P., Malhotra, G., & Bowers, J. S. (2021) · Bristol Research (University of Bristol) · Cited by 31 · see citing works
Kozlowski, A. C., & Evans, J. A. (2025) · Sociological Methods & Research · doi:10.1177/00491241251337316 · Cited by 34 · see citing works
Are Neural Nets Modular? Inspecting Functional Modularity Through Differentiable Weight MasksPreprint
Csordás, R., van Steenkiste, S., & Schmidhuber, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.02066 · Cited by 27 · see citing works
Symbolic Behaviour in Artificial IntelligencePreprint
Santoro, A., Lampinen, A. K., Mathewson, K. W., Lillicrap, T., & Raposo, D. C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.03406 · Cited by 34 · see citing works
Self-citationModular Networks for Compositional Instruction Following
Corona, R., Fried, D., Devin, C., Klein, D., & Darrell, T. (2021) · North American Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2021.naacl-main.81 · Cited by 30 · see citing works
Predictive Chemistry Augmented with Text Retrieval
Qian, Y., Li, Z., Tu, Z., Coley, C. W., & Barzilay, R. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.784 · Cited by 17 · see citing works
Mice identify subgoal locations through an action-driven mapping process
Shamash, P., Lee, S., Saxe, A., & Branco, T. (2023) · Neuron · doi:10.1016/j.neuron.2023.03.034 · Cited by 13 · see citing works
Auxiliary Tasks and Exploration Enable ObjectNavPreprint
Ye, J., Batra, D., Das, A., & Wijmans, E. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.04112 · Cited by 16 · see citing works
Oren, I., Herzig, J., & Berant, J. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.843 · Cited by 15 · see citing works
Transforming task representations to perform novel tasks
Lampinen, A. K., & McClelland, J. L. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2008852117 · Cited by 13 · see citing works
Self-citationSymbolic Brittleness in Sequence Models: On Systematic Generalization in Symbolic Mathematics
Welleck, S., West, P., Cao, J., & Choi, Y. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i8.20841 · Cited by 13 · see citing works
Towards mental time travel: a hierarchical memory for reinforcement learning agentsPreprint
Lampinen, A. K., Chan, S. C. Y., Banino, A., & Hill, F. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.14039 · Cited by 13 · see citing works
Self-citationBuilding human-like communicative intelligence: A grounded perspective
Dubova, M. (2021) · Cognitive Systems Research · doi:10.1016/j.cogsys.2021.12.002 · Cited by 13 · see citing works
Exploring Exploration: Comparing Children with RL Agents in Unified EnvironmentsPreprint
Kosoy, E., Collins, J., Chan, D. M., Huang, S., Pathak, D., Agrawal, P., Canny, J., Alison Gopnik, C., & Hamrick, J. B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.02880 · Cited by 11 · see citing works
Systematic Generalisation through Task Temporal Logic and Deep Reinforcement LearningPreprint
León, B. G., Shanahan, M., & Belardinelli, F. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.08767 · Cited by 11 · see citing works
*-CFQ: Analyzing the Scalability of Machine Learning on a Compositional Task
Tsarkov, D., Tihon, T., Scales, N., Momchev, N., Sinopalnikov, D., & Schärli, N. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i11.17195 · Cited by 10 · see citing works
Scaling Instructable Agents Across Many Simulated Worlds
SIMA Team, Raad, M. A., Ahuja, A., Barros, C., Besse, F., Bolt, A., Bolton, A., Brownfield, B., Buttimore, G., Cant, M., et al. (2024) · arXiv · doi:10.48550/arxiv.2404.10179 · Cited by 9 · see citing works
“In turn, grounding language in rich environments can make a system’s understanding of the language itself more systematic and generalizable (Hill et al., 2019).”
Self-citationAlignNet: Unsupervised Entity AlignmentPreprint
Creswell, A., Nikiforou, K., Vinyals, O., Saraiva, A., Kabra, R., Matthey, L., Burgess, C., Reynolds, M., Tanburn, R., Garnelo, M., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.08973 · Cited by 9 · see citing works
The MAGICAL Benchmark for Robust ImitationPreprint
Toyer, S., Shah, R., Critch, A., & Russell, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.00401 · Cited by 9 · see citing works
Generalization in Multimodal Language Learning from Simulation
Eisermann, A., Lee, J. H., Weber, C., & Wermter, S. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9534275 · Cited by 8 · see citing works
The Roles of Neural Networks in Language Acquisition
Portelance, E., & Jasbi, M. (2024) · Language and Linguistics Compass · doi:10.1111/lnc3.70001 · Cited by 9 · see citing works
Distinguishing rule- and exemplar-based generalization in learning systemsPreprint
Dasgupta, I., Grant, E., & Griffiths, T. L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.04328 · Cited by 7 · see citing works
The Embodied Crossmodal Self Forms Language and Interaction: A Computational Cognitive Review
Röder, F., Özdemir, O., Nguyen, P. D. H., Wermter, S., & Eppe, M. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.716671 · Cited by 7 · see citing works
Grounding Artificial Intelligence in the Origins of Human BehaviorPreprint
Nisioti, E., & Moulin-Frier, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.08564 · Cited by 6 · see citing works
Robotic Occlusion Reasoning for Efficient Object Existence Prediction
Li, M., Weber, C., Kerzel, M., Lee, J. H., Zeng, Z., Liu, Z., & Wermter, S. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9635947 · Cited by 5 · see citing works
Publishing fast and slow: A path toward generalizability in psychology and AI
Lampinen, A. K., Chan, S. C. Y., Santoro, A., & Hill, F. (2022) · Behavioral and Brain Sciences · doi:10.1017/s0140525x21000224 · Cited by 5 · see citing works
Self-citationSystematic Generalization on gSCAN with Language Conditioned EmbeddingPreprint
Gao, T. Y., Huang, Q., & Mooney, R. J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.05552 · Cited by 5 · see citing works
Meta-Learning of Structured Task Distributions in Humans and MachinesPreprint
Kumar, S., Dasgupta, I., Cohen, J. D., Daw, N. D., & Griffiths, T. L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.02317 · Cited by 7 · see citing works
Learning Multi-Object Positional Relationships via Emergent Communication
Feng, Y., An, B., & Lu, Z. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i16.29685 · Cited by 4 · see citing works
Systematic Generalization on gSCAN with Language Conditioned Embedding
Gao, T. Y., Huang, Q., & Mooney, R. J. (2020) · Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the International Joint Conference on Natural Language Processing (AACL-IJCNLP) · doi:10.18653/v1/2020.aacl-main.49 · Cited by 3 · see citing works
A Sensorimotor Perspective on Contrastive Multiview Visual Representation Learning
Laflaquière, A. (2021) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2021.3086267 · Cited by 3 · see citing works
Ecological Semantics: Programming Environments for Situated Language UnderstandingPreprint
Tamari, R., Stanovsky, G., Shahaf, D., & Tsarfaty, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.04567 · Cited by 3 · see citing works
Modularity Improves Out-of-Domain Instruction Following.Preprint
Corona, R., Fried, D., Devin, C., Klein, D., & Darrell, T. (2020) · arXiv (Cornell University) · Cited by 3 · see citing works
Grounding Spatio-Temporal Language with TransformersPreprint
Karch, T., Teodorescu, L., Hofmann, K., Moulin-Frier, C., & Oudeyer, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.08858 · Cited by 3 · see citing works
A Chinese verb semantic feature dataset (CVFD)
Deng, Y., Li, J., Niu, M., Wang, Y., Fu, W., Gong, Y., Ding, S., Li, W., He, W., & Cao, L. (2023) · Behavior Research Methods · doi:10.3758/s13428-022-02047-4 · Cited by 2 · see citing works
Zero-Shot DDPG Controller Design for Liquid Level Control of a Benchmark Quadruple-Tank Process
Machacuay, J., & Ipanaqué, W. (2024) · International Conference on Control, Decision and Information Technologies (CoDIT) · doi:10.1109/codit62066.2024.10708234 · Cited by 2 · see citing works
Meta-Learning of Compositional Task Distributions in Humans and Machines.Preprint
Kumar, S., Dasgupta, I., Cohen, J., Daw, N. D., & Griffiths, T. L. (2020) · arXiv (Cornell University) · Cited by 2 · see citing works
Orhan, A. E. (2021) · arXiv (Cornell University) · Cited by 2 · see citing works
SILG: The Multi-environment Symbolic Interactive Language Grounding BenchmarkPreprint
Zhong, V., Hanjie, A. W., Wang, S. I., Narasimhan, K., & Zettlemoyer, L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.10661 · Cited by 4 · see citing works
Enabling Markovian Representations under Imperfect Information
Belardinelli, F., León, B. G., & Malvone, V. (2022) · International Conference on Agents and Artificial Intelligence (ICAART) · doi:10.5220/0010882200003116 · Cited by 1 · see citing works
Language Models Understand Us, Poorly
Moore, J. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.16 · Cited by 2 · see citing works
For human-like models, train on human-like tasks
Hermann, K. L., Nayebi, A., van Steenkiste, S., & Jones, M. (2023) · Behavioral and Brain Sciences · doi:10.1017/s0140525x23001516 · Cited by 1 · see citing works
Generative Graph Perturbations for Scene Graph Prediction.Preprint
Knyazev, B. A., de Vries, H., Cangea, C., Taylor, G. W., Courville, A. C., & Belilovsky, E. (2020) · arXiv (Cornell University) · Cited by 1 · see citing works
Learning Canonical TransformationsPreprint
Dulberg, Z., & Cohen, J. D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.08822 · Cited by 1 · see citing works
SocialAI: Benchmarking Socio-Cognitive Abilities in Deep Reinforcement Learning AgentsPreprint
Kovač, G., Portelas, R., Hofmann, K., & Oudeyer, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.00956 · Cited by 4 · see citing works
Binz, M. (2002) · CRC Press eBooks · doi:10.1201/9780203164587.ch3
Artificial Intelligence (AI) and Big Data
Collins, G. J. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-824339-8.15002-3
Inventory Management with Attention-Based Meta Actions
Izumiya, K., & Simo‐Serra, E. (2021) · IEEE Conference on Games (CoG) · doi:10.1109/cog52621.2021.9619104
Learning Compositional Tasks from Language Instructions
Logeswaran, L., Carvalho, W., & Lee, H. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i11.26561
Note on Abbreviated Citations to Historical Works
Buckner, C. J. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197653302.002.0008
Moderate Empiricism and Machine Learning
Buckner, C. J. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197653302.003.0001
Buckner, C. J. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197653302.003.0008
Buckner, C. J. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197653302.003.0005
Buckner, C. J. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197653302.003.0004
Buckner, C. J. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197653302.002.0007
Buckner, C. J. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197653302.003.0006
Buckner, C. J. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197653302.003.0003
Buckner, C. J. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197653302.002.0003
Buckner, C. J. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197653302.003.0007
What Is Deep Learning, and How Should We Evaluate Its Potential?
Buckner, C. J. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197653302.003.0002
Buckner, C. J. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197653302.002.0004
Grounding Language to Entities and Dynamics for Generalization in Reinforcement Learning
Hanjie, A. W., Zhong, V., & Narasimhan, K. (2021) · arXiv · doi:10.48550/arxiv.2101.07393 · Cited by 15 · see citing works
- Authors
- Hill, F., Lampinen, A., Schneider, R., Clark, S., Botvinick, M., McClelland, J. L., & Santoro, A.
- Affiliations
- Google (United States) (US)
- Stanford University (US)
- University College London (GB)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2019
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1910.00571
- OpenAlex
- W3005188920
- Cited by
- 81
- References
- 0
- Citations by year
- 2025: 1 · 2024: 4 · 2023: 20 · 2022: 6 · 2021: 25 · 2020: 24
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- International Conference on Learning Representations
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Psychiatry, Mental Health, Neuroscience
- Keywords
- out-of-distribution generalization, systematicity, situated agents, embodied AI, object manipulation, training environment design, visual invariance, reference frames, multisensory perception, training data size
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
