Language and culture internalization for human-like autotelic AI
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Language could be a strong means of shaping what agents can do.
“Language may be a powerful tool for shaping agent capabilities (Colas et al., 2022).”
From Scaling Instructable Agents Across Many Simulated Worlds (2024) · cites this paper as Colas et al., 2022
LLMs act as models of human culture, facilitating cultural transmission across individuals and generations.
“Trained on extensive human text data, both historical and contemporary, LLMs act as models of human culture 25 , facilitating cultural transmission across individuals and generations.”
From Machine culture (2023) · cites this paper as [25]
Large language models are facilitating the transmission of cultural knowledge and redefining the value of human intellectual skills.
“Large language models (LLMs) are facilitating the transmission of cultural knowledge and redefining the value of human intellectual skills.”
From Machine culture (2023) · cites this paper as [25]
Cites
Parallel Distributed Processing: Explorations in the Microstructure of Cognition: Foundations
Rumelhart, D. E., McClelland, J. L., & AU (1986) · doi:10.7551/mitpress/5236.001.0001 · Cited by 15,686 · see citing works
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612 · see citing works
The origins of intelligence in children.
Piaget, J. (1952) · doi:10.1037/11494-000 · Cited by 10,687 · see citing works
Chomsky, N. (1957) · doi:10.1515/9783112316009 · Cited by 7,885 · see citing works
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445922 · Cited by 6,988 · see citing works
The Cultural Origins of Human Cognition
Tomasello, M. (2009) · doi:10.2307/j.ctvjsf4jc · Cited by 6,368 · see citing works
Understanding and sharing intentions: The origins of cultural cognition
Tomasello, M., Carpenter, M., Call, J., Behne, T., & Moll, H. (2005) · Behavioral and Brain Sciences · doi:10.1017/s0140525x05000129 · Cited by 4,882 · see citing works
The standard definition of creativity
Runco, M. A., & Jaeger, G. J. (2012) · Creativity Research Journal · doi:10.1080/10400419.2012.650092 · Cited by 3,895 · see citing works
Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning
Sutton, R. S., Precup, D., & Singh, S. (1999) · Artificial Intelligence · doi:10.1016/s0004-3702(99)00052-1 · Cited by 3,119 · see citing works
PaLM: Scaling Language Modeling with Pathways
Chowdhery, A., Narang, S., Devlin, J., Bosma, M., Mishra, G., Roberts, A., Barham, P., Chung, H. W., Sutton, C., Gehrmann, S., et al. (2022) · arXiv · doi:10.48550/arxiv.2204.02311 · Cited by 2,590 · see citing works
Flamingo: a Visual Language Model for Few-Shot Learning
Alayrac, J.-B., Donahue, J., Luc, P., Miech, A., Barr, I., Hasson, Y., Lenc, K., Mensch, A., Millican, K., Reynolds, M., et al. (2022) · arXiv · doi:10.48550/arxiv.2204.14198 · Cited by 1,555 · see citing works
Association for Computational Linguistics
Hirst, G. (2006) · Elsevier eBooks · doi:10.1016/b0-08-044854-2/05234-2 · Cited by 1,152 · see citing works
Berlyne, D. E. (1966) · Science · doi:10.1126/science.153.3731.25 · Cited by 1,150 · see citing works
Intrinsic Motivation Systems for Autonomous Mental Development
Oudeyer, P.-Y., Kaplan, F., & Hafner, V. V. (2007) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2006.890271 · Cited by 1,126 · see citing works
Self-citationThe Psychology and Neuroscience of Curiosity
Kidd, C., & Hayden, B. Y. (2015) · Neuron · doi:10.1016/j.neuron.2015.09.010 · Cited by 1,026 · see citing works
The evolution of cultural evolution
Henrich, J., & Mcelreath, R. (2003) · Evolutionary Anthropology Issues News and Reviews · doi:10.1002/evan.10110 · Cited by 1,024 · see citing works
Words as Invitations to Form Categories: Evidence from 12- to 13-Month-Old Infants
Waxman, S. R., & Markow, D. B. (1995) · Cognitive Psychology · doi:10.1006/cogp.1995.1016 · Cited by 834 · see citing works
Magnetic control of tokamak plasmas through deep reinforcement learning
Degrave, J., Felici, F., Buchli, J., Neunert, M., Tracey, B., Carpanese, F., Ewalds, T., Hafner, R., Abdolmaleki, A., de las Casas, D., et al. (2022) · Nature · doi:10.1038/s41586-021-04301-9 · Cited by 751 · see citing works
McDowell, J. (1996) · Harvard University Press eBooks · doi:10.2307/j.ctvjghtzj · Cited by 736 · see citing works
The double-edged sword of pedagogy: Instruction limits spontaneous exploration and discovery
Bonawitz, E. B., Shafto, P., Gweon, H., Goodman, N. D., Spelke, E. S., & Schulz, L. (2011) · Cognition · doi:10.1016/j.cognition.2010.10.001 · Cited by 734 · see citing works
Curious model-building control systems
Schmidhuber, J. (1991) · [Proceedings] 1991 IEEE International Joint Conference on Neural Networks · doi:10.1109/ijcnn.1991.170605 · Cited by 733 · see citing works
Tomasello, M. (2019) · Harvard University Press eBooks · doi:10.4159/9780674988651 · Cited by 670 · see citing works
Do As I Can, Not As I Say: Grounding Language in Robotic Affordances
Ahn, M., Brohan, A., Brown, N., Chebotar, Y., Cortes, O., David, B., Finn, C., Fu, C., Gopalakrishnan, K., Hausman, K., et al. (2022) · arXiv · doi:10.48550/arxiv.2204.01691 · Cited by 624 · see citing works
(1996) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780198524021.001.0001 · Cited by 588 · see citing works
Experimental evidence for the co-evolution of hominin tool-making teaching and language
Morgan, T. J. H., Uomini, N., Rendell, L. E., Chouinard‐Thuly, L., Street, S. E., Lewis, H. M., Cross, C., Evans, C. L., Kearney, R., de la Torre, I., et al. (2015) · Nature Communications · doi:10.1038/ncomms7029 · Cited by 570 · see citing works
Towards a neuroscience of active sampling and curiosity
Gottlieb, J., & Oudeyer, P.-Y. (2018) · Nature Reviews Neuroscience · doi:10.1038/s41583-018-0078-0 · Cited by 494 · see citing works
Self-citationEthical and social risks of harm from Language Models
Weidinger, L., Mellor, J., Rauh, M., Griffin, C., Uesato, J., Huang, P.-S., Cheng, M., Glaese, M., Balle, B., Kasirzadeh, A., et al. (2021) · arXiv · doi:10.48550/arxiv.2112.04359 · Cited by 477 · see citing works
Magic words: how language augments human computation
Clark, A. (1998) · Language and Thought · doi:10.1017/cbo9780511597909.011 · Cited by 466 · see citing works
Letting structure emerge: connectionist and dynamical systems approaches to cognition
McClelland, J. L., Botvinick, M., Noelle, D. C., Plaut, D. C., Rogers, T. T., Seidenberg, M. S., & Smith, L. B. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.06.002 · Cited by 457 · see citing works
Das, A., Datta, S., Gkioxari, G., Lee, S., Parikh, D., & Batra, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00008 · Cited by 410 · see citing works
Hermer-Vazquez, L. (2001) · Cognition · doi:10.1016/s0010-0277(00)00120-7 · Cited by 347 · see citing works
Autonomous navigation of stratospheric balloons using reinforcement learning
Bellemare, M. G., Candido, S., Castro, P. S., Gong, J., Machado, M. C., Moitra, S., Ponda, S. S., & Wang, Z. (2020) · Nature · doi:10.1038/s41586-020-2939-8 · Cited by 295 · see citing works
Predictive biases in natural language processing models: A conceptual framework and overview
Shah, D. S., Schwartz, H. A., & Hovy, D. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.468 · Cited by 241 · see citing works
TextWorld: A Learning Environment for Text-Based Games
Côté, M.-A., Kádár, Á., Yuan, X., Kybartas, B., Barnes, T., Fine, E., Moore, J. A. Y., Hausknecht, M., Asri, L. E., Adada, M., et al. (2019) · Communications in computer and information science · doi:10.1007/978-3-030-24337-1_3 · Cited by 210 · see citing works
Socratic Models: Composing Zero-Shot Multimodal Reasoning with Language
Zeng, A., Attarian, M., Ichter, B., Choromanski, K., Wong, A., Welker, S., Tombari, F., Purohit, A., Ryoo, M., Sindhwani, V., et al. (2022) · arXiv · doi:10.48550/arxiv.2204.00598 · Cited by 205 · see citing works
Gentner, D., & Hoyos, C. (2017) · Topics in Cognitive Science · doi:10.1111/tops.12278 · Cited by 170 · see citing works
Integration of Action and Language Knowledge: A Roadmap for Developmental Robotics
Cangelosi, A., Giorgio Metta, B., Sagerer, G., Nolfi, S., Nehaniv, C. L., Fischer, K., Tani, J., Belpaeme, T., Sandini, G., Nori, F., et al. (2010) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2010.2053034 · Cited by 168 · see citing works
Symbolic Knowledge Distillation: from General Language Models to Commonsense Models
West, P., Bhagavatula, C., Hessel, J., Hwang, J. D., Jiang, L., Bras, R. J. L., Lu, X., Welleck, S., & Choi, Y. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.341 · Cited by 165 · see citing works
(1998) · Cambridge University Press eBooks · doi:10.1017/cbo9780511597909 · Cited by 160 · see citing works
Why Children Talk to Themselves
Berk, L. E. (1994) · Scientific American · doi:10.1038/scientificamerican1194-78 · Cited by 153 · see citing works
Social Situatedness of Natural and Artificial Intelligence: Vygotsky and Beyond
Lindblom, J., & Tom Ziemke, B. (2003) · Adaptive Behavior · doi:10.1177/10597123030112002 · Cited by 130 · see citing works
Future Thinking in Young Children
Atance, C. M. (2008) · Current Directions in Psychological Science · doi:10.1111/j.1467-8721.2008.00593.x · Cited by 130 · see citing works
Precis of Consciousness Explained
Dennett, D. C. (1993) · Philosophy and Phenomenological Research · doi:10.2307/2108259 · Cited by 127 · see citing works
What Do Words Do? Toward a Theory of Language-Augmented Thought
Lupyan, G. (2012) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/b978-0-12-394293-7.00007-8 · Cited by 120 · see citing works
Language Conditioned Imitation Learning Over Unstructured Data
Lynch*, C., & Sermanet*, P. (2021) · Robotics: Science and Systems XVII · doi:10.15607/rss.2021.xvii.047 · Cited by 110 · see citing works
Addressing the Challenges of Collaborative Goal Setting with Children and Their Families
Brewer, K., Pollock, N., & Wright, F. V. (2013) · Physical & Occupational Therapy In Pediatrics · doi:10.3109/01942638.2013.794187 · Cited by 107 · see citing works
Towards a Vygotskyan cognitive robotics: The role of language as a cognitive tool
Mirolli, M., & Parisi, D. (2009) · New Ideas in Psychology · doi:10.1016/j.newideapsych.2009.07.001 · Cited by 102 · see citing works
Colas, C., Karch, T., Sigaud, O., & Oudeyer, P. (2022) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.13554 · Cited by 101 · see citing works
Self-citationThe Epigenesis of Meaning in Human Beings, and Possibly in Robots
Zlatev, J. (2001) · Minds and Machines · doi:10.1023/a:1011218919464 · Cited by 98 · see citing works
Probing Pre-Trained Language Models for Cross-Cultural Differences in Values
Arora, A., Kaffee, L.-A., & Augenstein, I. (2023) · Workshop on Cross-Cultural Considerations in NLP (C3NLP) · doi:10.18653/v1/2023.c3nlp-1.12 · Cited by 91 · see citing works
Learning to Understand Goal Specifications by Modelling RewardPreprint
Bahdanau, D., Hill, F., Leike, J., Hughes, E., Hosseini, A., Kohli, P., & Grefenstette, E. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.01946 · Cited by 90 · see citing works
Language as a disruptive technology: abstract concepts, embodiment and the flexible mind
Dove, G. O. (2018) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2017.0135 · Cited by 84 · see citing works
BabyAI: First Steps Towards Grounded Language Learning With a Human In the Loop.Preprint
Chevalier-Boisvert, M., Bahdanau, D., Lahlou, S., Willems, L., Saharia, C., Nguyen, T. H., & Bengio, Y. (2018) · arXiv (Cornell University) · Cited by 84 · see citing works
ALFWorld: Aligning Text and Embodied Environments for Interactive Learning
Shridhar, M., Yuan, X., Côté, M.-A., Bisk, Y., Trischler, A., & Hausknecht, M. (2020) · arXiv · doi:10.48550/arxiv.2010.03768 · Cited by 80 · see citing works
MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge
Fan, L., Wang, G., Jiang, Y., Mandlekar, A., Yang, Y., Zhu, H., Tang, A., Huang, D.-A., Zhu, Y., & Anandkumar, A. (2022) · arXiv · doi:10.48550/arxiv.2206.08853 · Cited by 72 · see citing works
Vélez, N., & Hyowon Gweon, C. (2021) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2021.01.006 · Cited by 70 · see citing works
Thinking in language? Evolution and a modularist possibility
Carruthers, P. (1998) · Cambridge University Press eBooks · doi:10.1017/cbo9780511597909.007 · Cited by 66 · see citing works
Language as a Cognitive Tool to Imagine Goals in Curiosity-Driven Exploration
Colas, C., Karch, T., Lair, N., Dussoux, J.-M., Moulin-Frier, C., Dominey, P. F., & Oudeyer, P.-Y. (2020) · arXiv · doi:10.48550/arxiv.2002.09253 · Cited by 64 · see citing works
Self-citationConstruction grammar and creativity: Evolution, psychology, and cognitive science
Hoffmann, T. (2020) · Cognitive Semiotics · doi:10.1515/cogsem-2020-2018 · Cited by 57 · see citing works
Open-Ended Learning Leads to Generally Capable Agents
Open Ended Learning Team, Stooke, A., Mahajan, A., Barros, C., Deck, C., Bauer, J., Sygnowski, J., Trebacz, M., Jaderberg, M., Mathieu, M., et al. (2021) · arXiv · doi:10.48550/arxiv.2107.12808 · Cited by 56 · see citing works
Studying robot social cognition within a developmental psychology framework
Dautenhahn, K., & Billard, A. G. (2003) · doi:10.1109/eurbot.1999.827639 · Cited by 45 · see citing works
Measuring and characterizing generalization in deep reinforcement learning
Witty, S., Lee, J. K., Tosch, E., Atrey, A., Clary, K., Littman, M. L., & Jensen, D. D. (2021) · Applied AI Letters · doi:10.1002/ail2.45 · Cited by 35 · see citing works
Interactive Language Learning by Question Answering
Yuan, X., Côté, M.-A., Fu, J., Lin, Z., Pal, C., Bengio, Y., & Trischler, A. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1280 · Cited by 33 · see citing works
Vyshedskiy, A. (2019) · Research Ideas and Outcomes · doi:10.3897/rio.5.e38546 · Cited by 32 · see citing works
Inverse Reinforcement Learning with Natural Language Goals
Zhou, L., & Small, K. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i12.17326 · Cited by 24 · see citing works
Semantic Exploration from Language Abstractions and Pretrained Representations
Tam, A. C., Rabinowitz, N. C., Lampinen, A. K., Roy, N. A., Chan, S. C. Y., Strouse, D., Wang, J. X., Banino, A., & Hill, F. (2022) · arXiv · doi:10.48550/arxiv.2204.05080 · Cited by 24 · see citing works
HIGhER: Improving instruction following with Hindsight Generation for Experience Replay
Cideron, G., Seurin, M., Strub, F., & Pietquin, O. (2020) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci47803.2020.9308603 · Cited by 22 · see citing works
Emergent Systematic Generalization In a Situated AgentPreprint
Hill, F., Lampinen, A. K., Schneider, R. G., Clark, S. C., Botvinick, M., McClelland, J. L., & Santoro, A. (2019) · arXiv (Cornell University) · Cited by 21 · see citing works
Improving Intrinsic Exploration with Language AbstractionsPreprint
Mu, J., Zhong, V., Răileanu, R., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2202.08938 · Cited by 16 · see citing works
Modularity, language, and the flexibility of thought
Carruthers, P. (2002) · Behavioral and Brain Sciences · doi:10.1017/s0140525x02550123 · Cited by 13 · see citing works
Toward Teachable Autotelic Agents
Sigaud, O., Akakzia, A., Caselles-Dupré, H., Colas, C., Oudeyer, P., & Chétouani, M. (2022) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2022.3231731 · Cited by 11 · see citing works
Self-citationIntra-agent speech permits zero-shot task acquisition
Yan, C., Carnevale, F., Georgiev, P., Santoro, A., Guy, A., Muldal, A., Hung, C.-C., Abramson, J., Lillicrap, T., & Wayne, G. (2022) · arXiv · doi:10.48550/arxiv.2206.03139 · Cited by 3 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Brinkmann, L., Baumann, F., Bonnefon, J.-F., Derex, M., Müller, T. F., Nussberger, A.-M., Czaplicka, A., Acerbi, A., Griffiths, T. L., Henrich, J., et al. (2023) · Nature Human Behaviour · doi:10.1038/s41562-023-01742-2 · Cited by 132 · see citing works
Self-citationMeta-learned models of cognition
Binz, M., Dasgupta, I., Jagadish, A. K., Botvinick, M., Wang, J. X., & Schulz, E. (2024) · Behavioral and Brain Sciences · doi:10.1017/s0140525x23003266 · Cited by 38 · see citing works
Darwin Gödel Machine: Open-Ended Evolution of Self-Improving Agents
Zhang, J., Hu, S., Lu, C., Lange, R., & Clune, J. (2025) · SuperIntelligence - Robotics - Safety & Alignment · doi:10.70777/si.v2i3.15063 · Cited by 34 · see citing works
Absolute Zero: Reinforced Self-play Reasoning with Zero Data
Zhao, A., Wu, Y., Yue, Y., Wu, T., Xu, Q., Yue, Y., Lin, M., Wang, S., Wu, Q., Zheng, Z., et al. (2025) · arXiv · Cited by 13 · see citing works
Scaling Instructable Agents Across Many Simulated Worlds
SIMA Team, Raad, M. A., Ahuja, A., Barros, C., Besse, F., Bolt, A., Bolton, A., Brownfield, B., Buttimore, G., Cant, M., et al. (2024) · arXiv · doi:10.48550/arxiv.2404.10179 · Cited by 9 · see citing works
“Language may be a powerful tool for shaping agent capabilities (Colas et al., 2022).”
Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agents
Zhang, J., Hu, S., Lu, C., Lange, R., & Clune, J. (2025) · arXiv · doi:10.48550/arxiv.2505.22954 · Cited by 5 · see citing works
- Authors
- Colas, C., Karch, T., Moulin-Frier, C., & Oudeyer, P.-Y.
- Affiliations
- Institut national de recherche en sciences et technologies du numérique (FR)
- Corresponding author
- Colas, Cédric
- Venue
- Nature Machine Intelligence
- Published
- 2022-12-20
- Volume
- 4
- Issue
- 12
- Pages
- 1068-1076
- ISSN
- 2522-5839 (ISSN-L)
- OpenAlex
- W4313449193
- Cited by
- 34
- References
- 73
- Citations by year
- 2026: 6 · 2025: 6 · 2024: 14 · 2023: 7 · 2022: 1
- FWCI
- 2.31
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- Nature Machine Intelligence (publishedVersion)
- HAL (submittedVersion)
- Funders
- Agence Nationale de la Recherche (ANR-20-CE23-0006)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Psychiatry, Mental Health, Neuroscience
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Keywords
- language acquisition, cultural internalization, intrinsic motivation, human-like AI, sociocultural learning, cognitive development
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
