CoChat
Sign Up
PreprintCited by 4Child and Animal Learning DevelopmentSocial Robot Interaction and HRIReinforcement Learning in Robotics

The SocialAI School: Insights from Developmental Psychology Towards Artificial Socio-Cultural Agents

Open access
Kovač, Grgur, Portelas, Rémy, Dominey, Peter Ford, Oudeyer, Pierre-Yves·2023·arXiv
DOI 10.48550/arxiv.2307.07871arXiv 2307.07871
Open this paper in CoChat — free accountOpen PDF

Abstract

Developmental psychologists have long-established the importance of socio-cognitive abilities in human intelligence. These abilities enable us to enter, participate and benefit from human culture. AI research on social interactive agents mostly concerns the emergence of culture in a multi-agent setting (often without a strong grounding in developmental psychology). We argue that AI research should be informed by psychology and study socio-cognitive abilities enabling to enter a culture too. We discuss the theories of Michael Tomasello and Jerome Bruner to introduce some of their concepts to AI and outline key concepts and socio-cognitive abilities. We present The SocialAI school - a tool including a customizable parameterized uite of procedurally generated environments, which simplifies conducting experiments regarding those concepts. We show examples of such experiments with RL agents and Large Language Models. The main motivation of this work is to engage the AI community around the problem of social intelligence informed by developmental psychology, and to provide a tool to simplify first steps in this direction. Refer to the project website for code and additional information: https://sites.google.com/view/socialai-school.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2307.07871

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Kovač et al. (2023) introduces SocialAI school for creating interactive environments simulating social interactions, drawing from developmental psychology to understand how agents acquire, demonstrate, and evolve social skills.

    “[Kovač et al., 2023] introduces a tool named SocialAI school for creating interactive environments simulating social interactions.It draws from developmental psychology to understand how agents can acquire, demonstrate, and evolve social skills such as joint attention, communication, and cultural learning.”

    From Large Language Model based Multi-Agents: A Survey of Progress and Challenges (2024) · cites this paper as Kovač et al., 2023

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 108

  1. Andreas, J. (2022). Language models as agent models. In Conference on Empirical Methods in Natural Language Processing.
  2. Argall, B. D., Chernova, S., Veloso, M., & Browning, B. (2009). A survey of robot learning from demonstration. Robotics and Autonomous Systems, 57 (5), 469-483.
  3. Aru, J., Labash, A., Corcoll, O., & Vicente, R. (2022). Mind the gap: Challenges of deep learning approaches to theory of mind. ArXiv, abs/2203.16540. · arXiv
  4. Asada, M., Hosoda, K., Kuniyoshi, Y., Ishiguro, H., Inui, T., Yoshikawa, Y., Ogino, M., & Yoshida, C. (2009). Cognitive developmental robotics: A survey. IEEE Transactions on Autonomous Mental Development, 1 (1), 12-34.
  5. Baker, B., Kanitscheider, I., Markov, T., Wu, Y., Powell, G., McGrew, B., & Mordatch, I. (2019). Emergent tool use from multi-agent autocurricula. ArXiv, abs/1909.07528. · arXiv
  6. Baker, C. L., Saxe, R., & Tenenbaum, J. B. (2011). Bayesian theory of mind: Modeling joint belief-desire attribution. In Carlson, L. A., Hölscher, C., & Shipley, T. F. (Eds.), Proceedings of the 33th Annual Meeting of the Cognitive Science Society, CogSci 2011, Boston, Massachusetts, USA, July 20-23, 2011. cognitivesciencesociety.org.
  7. Behne, T., Carpenter, M., & Tomasello, M. (2005). One-year-olds comprehend the commu- nicative intentions behind gestures in a hiding game. Developmental Science, 8 (6), 492-499.
  8. Bengio, Y., Louradour, J., Collobert, R., & Weston, J. (2009). Curriculum learning. In ICML.
  9. Bhoopchand, A., Brownfield, B., Collister, A., Lago, A. D., Edwards, A. D., Everett, R., Frechette, A., Oliveira, Y. G., Hughes, E., Mathewson, K. W., Mendolicchio, P., Pawar, J., Pislar, M., Platonov, A. K., Senter, E., Singh, S., Zacherl, A., & Zhang, L. M. (2022). Learning robust real-time cultural transmission without human data. ArXiv, abs/2203.00715. · arXiv
  10. Billard, A., & Dautenhahn, K. (1998). Grounding communication in autonomous robots: An experimental study. Robotics and Autonomous Systems, 24 (1), 71 -79. Scientific Methods in Mobile Robotics.
  11. Billard, A., & Dautenhahn, K. (1999). Experiments in learning by imitation -grounding and use of communication in robotic agents. Adaptive Behavior, 7 (3-4), 415-438.
  12. Brown, T., Mann, B., Ryder, N., Subbiah, M., Kaplan, J. D., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020). Language models are few-shot learners. Advances in neural information processing systems, 33, 1877-1901.
  13. Bruner, J. (1985). Child's talk: Learning to use language. Child Language Teaching and Therapy, 1 (1), 111-114.
  14. Bruner, J. (1990). Acts of meaning. Harvard university press.
  15. Burda, Y., Edwards, H., Storkey, A. J., & Klimov, O. (2018). Exploration by random network distillation. CoRR, abs/1810.12894. · arXiv
  16. Butler, L. P., & Tomasello, M. (2016). Two-and 3-year-olds integrate linguistic and pedagog- ical cues in guiding inductive generalization and exploration. Journal of Experimental Child Psychology, 145, 64-78.
  17. Cangelosi, A., Metta, G., Sagerer, G., Nolfi, S., Nehaniv, C., Fischer, K., Tani, J., Belpaeme, T., Sandini, G., Nori, F., et al. (2010). Integration of action and language knowledge: A roadmap for developmental robotics. IEEE Transactions on Autonomous Mental Development, 2 (3), 167-195.
  18. Cangelosi, A., & Schlesinger, M. (2014). Developmental Robotics: From Babies to Robots. The MIT Press.
  19. Carpenter, M., Tomasello, M., & Striano, T. (2005). Role reversal imitation and language in typically developing infants and children with autism. Infancy, 8 (3), 253-278.
  20. Carta, T., Romac, C., Wolf, T., Lamprier, S., Sigaud, O., & Oudeyer, P.-Y. (2023). Grounding large language models in interactive environments with online reinforcement learning. ArXiv, abs/2302.02662. · arXiv
  21. Carvalho, E. (2020). Social affordance. In Vonk, J., & Shackelford, T. (Eds.), Encyclopedia of Animal Cognition and Behavior, pp. 1-4. Springer.
  22. Celemin, C., & Ruiz-del Solar, J. (2015). Coach: Learning continuous actions from corrective advice communicated by humans. In 2015 International Conference on Advanced Robotics (ICAR), pp. 581-586.
  23. Chevalier-Boisvert, M., Bahdanau, D., Lahlou, S., Willems, L., Saharia, C., Nguyen, T. H., & Bengio, Y. (2019). Babyai: A platform to study the sample efficiency of grounded language learning. In 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA, May 6-9, 2019. OpenReview.net.
  24. Chung, J., Gülçehre, Ç., Cho, K., & Bengio, Y. (2015). Gated feedback recurrent neural networks. In Bach, F. R., & Blei, D. M. (Eds.), Proceedings of the 32nd International Conference on Machine Learning, ICML 2015, Lille, France, 6-11 July 2015, Vol. 37 of JMLR Workshop and Conference Proceedings, pp. 2067-2075. JMLR.org.
  25. Clark, A. (1996). Being There: Putting Brain, Body, and World Together Again (1st edition). MIT Press, Cambridge, MA, USA.
  26. Côté, M., Kádár, Á., Yuan, X., Kybartas, B., Barnes, T., Fine, E., Moore, J., Hausknecht, M. J., Asri, L. E., Adada, M., Tay, W., & Trischler, A. (2018). Textworld: A learning environment for text-based games. ArXiv, abs/1806.11532. · arXiv
  27. Das, A., Datta, S., Gkioxari, G., Lee, S., Parikh, D., & Batra, D. (2017). Embodied question answering. ArXiv, abs/1711.11543. · arXiv
  28. D'Entremont, B., Hains, S., & Muir, D. (1997). A demonstration of gaze following in 3-to 6-month-olds. Infant Behavior and Development, 20 (4), 569-572.
  29. Devlin, J., Chang, M., Lee, K., & Toutanova, K. (2018). BERT: pre-training of deep bidirectional transformers for language understanding. CoRR, abs/1810.04805. · arXiv
  30. Flavell, J. H., Flavell, E. R., & Green, F. L. (1983). Development of the appearance-reality distinction. Cognitive Psychology, 15 (1), 95-120.
  31. Fletcher, G. E., Warneken, F., & Tomasello, M. (2012). Differences in cognitive processes un- derlying the collaborative activities of children and chimpanzees. Cognitive Development, 27 (2), 136-153.
  32. Franzmeyer, T., Malinowski, M., & Henriques, J. F. (2021). Learning altruistic behaviours in reinforcement learning without external rewards. ArXiv, abs/2107.09598. · arXiv
  33. Gergely, G., Bekkering, H., & Király, I. (2002). Rational imitation in preverbal infants. Nature, 415 (6873), 755-755.
  34. Gibson, J. J. (1977). The theory of affordances. Hilldale, USA, 1 (2), 67-82.
  35. Gopnik, A., & Meltzoff, A. N. (1997). Words, thoughts, and theories. Mit Press.
  36. Gordon, D., Kembhavi, A., Rastegari, M., Redmon, J., Fox, D., & Farhadi, A. (2018). IQA: visual question answering in interactive environments. In 2018 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4089-4098. IEEE Computer Society.
  37. Grizou, J., Iturrate, I. n., Montesano, L., Oudeyer, P.-Y., & Lopes, M. (2014). Interactive learning from unlabeled instructions. In Proceedings of the Thirtieth Conference on Uncertainty in Artificial Intelligence, UAI'14, p. 290-299, Arlington, Virginia, USA. AUAI Press.
  38. Grollman, D. H., & Billard, A. (2011). Donut as i do: Learning from failed demonstrations. In 2011 IEEE International Conference on Robotics and Automation, pp. 3804-3809.
  39. Hare, B., Call, J., & Tomasello, M. (2001). Do chimpanzees know what conspecifics know?. Animal behaviour, 61 (1), 139-151.
  40. Herrmann, E., Call, J., Hernàndez-Lloreda, M. V., Hare, B., & Tomasello, M. (2007). Humans have evolved specialized skills of social cognition: The cultural intelligence hypothesis. Science, 317 (5843), 1360-1366.
  41. Hochreiter, S., & Schmidhuber, J. (1997). Long short-term memory. Neural Comput., 9 (8), 1735-1780.
  42. Huang, W., Abbeel, P., Pathak, D., & Mordatch, I. (2022). Language models as zero-shot planners: Extracting actionable knowledge for embodied agents. CoRR, abs/2201.07207. · arXiv
  43. Hui, D. Y.-T., Chevalier-Boisvert, M., Bahdanau, D., & Bengio, Y. (2020). Babyai 1.1.. Hutchins, E. (1996). Cognition in the Wild (Bradford Books). The MIT Press.
  44. Jaques, N., Lazaridou, A., Hughes, E., Gülçehre, Ç., Ortega, P. A., Strouse, D., Leibo, J. Z., & de Freitas, N. (2019). Social influence as intrinsic motivation for multi-agent deep reinforcement learning. In Chaudhuri, K., & Salakhutdinov, R. (Eds.), Proceedings of the 36th International Conference on Machine Learning, ICML 2019, Vol. 97, pp. 3040-3049. PMLR.
  45. Keupp, S., Behne, T., & Rakoczy, H. (2013). Why do children overimitate? normativity is crucial. Journal of Experimental Child Psychology, 116 (2), 392-406.
  46. Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2012). Imagenet classification with deep convolutional neural networks. Advances in neural information processing systems, 25, 1097-1105.
  47. Lazaridou, A., & Baroni, M. (2020). Emergent multi-agent communication in the deep learning era. CoRR, abs/2006.02419. · arXiv
  48. Le, M., Boureau, Y.-L., & Nickel, M. (2019). Revisiting the evaluation of theory of mind through question answering. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp. 5872-5877, Hong Kong, China. Association for Computational Linguistics.
  49. LeCun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W., & Jackel, L. D. (1989). Backpropagation applied to handwritten zip code recognition. Neural computation, 1 (4), 541-551.
  50. Lee, D., Jaques, N., Kew, J. C., Eck, D., Schuurmans, D., & Faust, A. (2021). Joint attention for multi-agent coordination and social learning. CoRR, abs/2104.07750. · arXiv
  51. Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2016). Continuous control with deep reinforcement learning. In ICLR.
  52. Lindblom, J., & Ziemke, T. (2003). Social situatedness of natural and artificial intelligence: Vygotsky and beyond. Adaptive Behavior, 11 (2), 79-96.
  53. Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2021). Pre-train, prompt, and predict: A systematic survey of prompting methods in natural language processing. CoRR, abs/2107.13586. · arXiv
  54. Lyons, D. E., Young, A. G., & Keil, F. C. (2007). The hidden structure of overimitation. Proceedings of the National Academy of Sciences, 104, 19751 -19756.
  55. Meltzoff, A. N., & Moore, M. K. (1997). Explaining facial imitation: A theoretical model. Infant and child development, 6 (3-4), 179-192.
  56. Mirolli, M., & Parisi, D. (2011). Towards a vygotskyan cognitive robotics: The role of language as a cognitive tool. New Ideas in Psychology, 29 (3), 298-311. Special Issue: Cognitive Robotics and Reevaluation of Piaget Concept of Egocentrism.
  57. Misra, D. K., Bennett, A., Blukis, V., Niklasson, E., Shatkhin, M., & Artzi, Y. (2018). Mapping instructions to actions in 3d environments with visual goal prediction. In Riloff, E., Chiang, D., Hockenmaier, J., & Tsujii, J. (Eds.), Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium, October 31 - November 4, 2018, pp. 2667-2678. Association for Computational Linguistics.
  58. Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015). Human-level control through deep reinforcement learning. Nature, 518 (7540), 529.
  59. Moll, H., & Tomasello, M. (2006). Level 1 perspective-taking at 24 months of age. British Journal of Developmental Psychology, 24 (3), 603-613.
  60. Mordatch, I., & Abbeel, P. (2018). Emergence of grounded compositional language in multi- agent populations. In McIlraith, S. A., & Weinberger, K. Q. (Eds.), Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, pp. 1495-1502. AAAI Press.
  61. Moulin-Frier, C., & Oudeyer, P. (2020). Multi-agent reinforcement learning as a computational tool for language evolution research: Historical context and future challenges. CoRR, abs/2002.08878. · arXiv
  62. Mundy, P., Sigman, M., Ungerer, J., & Sherman, T. (1986). Defining the social deficits of autism: The contribution of non-verbal communication measures. Journal of Child Psychology and Psychiatry, 27, 657 -669.
  63. Ndousse, K. K., Eck, D., Levine, S., & Jaques, N. (2021). Emergent social learning via multi-agent reinforcement learning. In International Conference on Machine Learning, pp. 7991-8004.
  64. PMLR.
  65. Netanyahu, A., Shu, T., Katz, B., Barbu, A., & Tenenbaum, J. B. (2021). PHASE: physically- grounded abstract social events for machine social perception. In Thirty-Fifth AAAI Conference on Artificial Intelligence, AAAI 2021, Thirty-Third Conference on Inno- vative Applications of Artificial Intelligence, IAAI 2021, The Eleventh Symposium on Educational Advances in Artificial Intelligence, EAAI 2021, Virtual Event, February 2-9, 2021, pp. 845-853. AAAI Press.
  66. Nisioti, E., & Moulin-Frier, C. (2023). Dynamics of niche construction in adaptable popula- tions evolving in diverse environments. arXiv, abs/2305.09369. · arXiv
  67. Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C. L., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Alex Ray, J. S., Hilton, J., Kelton, F., Miller, L., Simens, M., Askell, A., Welinder, P., Christiano, P., Leike, J., & Lowe, R. (2022). Training language models to follow instructions with human feedback. In arXiv preprint.
  68. Over, H., & Carpenter, M. (2013). The social side of imitation. Child Development Perspec- tives, 7 (1), 6-11.
  69. Park, J. S., O'Brien, J. C., Cai, C. J., Morris, M. R., Liang, P., & Bernstein, M. S. (2023). Generative agents: Interactive simulacra of human behavior. arXiv, abs/2304.03442. · arXiv
  70. Parker-Holder, J., Jiang, M., Dennis, M., Samvelyan, M., Foerster, J. N., Grefenstette, E., & Rocktaschel, T. (2022). Evolving curricula with regret-based environment design. In International Conference on Machine Learning.
  71. Pathak, D., Agrawal, P., Efros, A. A., & Darrell, T. (2017). Curiosity-driven exploration by self-supervised prediction. In ICML.
  72. Perez, E., Strub, F., de Vries, H., Dumoulin, V., & Courville, A. C. (2017). Film: Visual reasoning with a general conditioning layer. CoRR, abs/1709.07871. · arXiv
  73. Portelas, R., Colas, C., Weng, L., Hofmann, K., & Oudeyer, P. (2020). Automatic curriculum learning for deep RL: A short survey. CoRR, abs/2003.04664. · arXiv
  74. Puig, X., Shu, T., Li, S., Wang, Z., Liao, Y., Tenenbaum, J. B., Fidler, S., & Torralba, A. (2021). Watch-and-help: A challenge for social perception and human-ai collaboration. In 9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3-7, 2021. OpenReview.net.
  75. Rabinowitz, N. C., Perbet, F., Song, H. F., Zhang, C., Eslami, S. M. A., & Botvinick, M. (2018). Machine theory of mind. In Dy, J. G., & Krause, A. (Eds.), Proceedings of the 35th International Conference on Machine Learning, ICML 2018, Stockholmsmässan, Stockholm, Sweden, July 10-15, 2018, Vol. 80 of Proceedings of Machine Learning Research, pp. 4215-4224. PMLR.
  76. Raileanu, R., & Rocktäschel, T. (2020). RIDE: rewarding impact-driven exploration for procedurally-generated environments. CoRR, abs/2002.12292. · arXiv
  77. Richerson, P. J., & Boyd, R. (2006). Not by Genes Alone: How Culture Transformed Human Evolution. University Of Chicago Press.
  78. Ruis, L., Andreas, J., Baroni, M., Bouchacourt, D., & Lake, B. M. (2020). A benchmark for systematic generalization in grounded language understanding. In Larochelle, H., Ranzato, M., Hadsell, R., Balcan, M. F., & Lin, H. (Eds.), Advances in Neural Information Processing Systems, Vol. 33, pp. 19861-19872.
  79. Ruis, L., Khan, A., Biderman, S. R., Hooker, S., Rocktaschel, T., & Grefenstette, E. (2022). Large language models are not zero-shot communicators. ArXiv, abs/2210.14986. · arXiv
  80. Sap, M., Bras, R. L., Fried, D., & Choi, Y. (2022). Neural theory-of-mind? on the limits of social intelligence in large lms. ArXiv, abs/2210.13312. · arXiv
  81. Sap, M., Rashkin, H., Chen, D., Bras, R. L., & Choi, Y. (2019). Socialiqa: Commonsense reasoning about social interactions. CoRR, abs/1904.09728. · arXiv
  82. Savinov, N., Raichuk, A., Marinier, R., Vincent, D., Pollefeys, M., Lillicrap, T. P., & Gelly, S. (2018). Episodic curiosity through reachability. ArXiv, abs/1810.02274. · arXiv
  83. Scao, T. L., Fan, A., Akiki, C., Pavlick, E.-J., Ilić, S., Hesslow, D., Castagné, R., Luccioni, A. S., Yvon, F., Gallé, M., Tow, J., Rush, A. M., Biderman, S. R., Webson, A., Ammanamanchi, P. S., Wang, T., Sagot, B., ..., & Wolf, T. (2022). Bloom: A 176b- parameter open-access multilingual language model. ArXiv, abs/2211.05100. · arXiv
  84. Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017). Proximal policy optimization algorithms. ArXiv, abs/1707.06347. · arXiv
  85. Shu, T., Bhandwaldar, A., Gan, C., Smith, K. A., Liu, S., Gutfreund, D., Spelke, E. S., Tenenbaum, J. B., & Ullman, T. D. (2021). AGENT: A benchmark for core psychological reasoning. In Meila, M., & Zhang, T. (Eds.), Proceedings of the 38th International Conference on Machine Learning, ICML 2021, 18-24 July 2021, Virtual Event, Vol. 139 of Proceedings of Machine Learning Research, pp. 9614-9625.
  86. PMLR.
  87. Shu, T., Kryven, M., Ullman, T. D., & Tenenbaum, J. (2020). Adventures in flatland: Perceiving social interactions under physical dynamics. In Denison, S., Mack, M., Xu, Y., & Armstrong, B. C. (Eds.), Proceedings of the 42th Annual Meeting of the Cognitive Science Society -Developing a Mind: Learning in Humans, Animals, and Machines, CogSci 2020, virtual, July 29 -August 1, 2020. cognitivesciencesociety.org.
  88. Tejwani, R., Kuo, Y., Shu, T., Stankovits, B., Gutfreund, D., Tenenbaum, J. B., Katz, B., & Barbu, A. (2021). Incorporating rich social interactions into mdps. CoRR, abs/2110.10298. · arXiv
  89. Tennie, C., Call, J., & Tomasello, M. (2006). Push or pull: Imitation vs. emulation in great apes and human children. Ethology, 112 (12), 1159-1169.
  90. Tennie, C., Walter, V., Gampe, A., Carpenter, M., & Tomasello, M. (2014). Limitations to the cultural ratchet effect in young children. Journal of experimental child psychology, 126, 152-160.
  91. Tomasello, M. (1999). The Cultural Origins of Human Cognition. Harvard University Press.
  92. Tomasello, M. (2019). Becoming human. In Becoming Human. Harvard University Press.
  93. Tomasello, M. (2020). The role of roles in uniquely human cognition and sociality. Journal for the Theory of Social Behaviour, 50 (1), 2-19.
  94. Tomasello, M., Kruger, A. C., & Ratner, H. H. (1993). Cultural learning. Behavioral and brain sciences, 16 (3), 495-511.
  95. Trott, S., Jones, C. J., Chang, T. A., Michaelov, J. A., & Bergen, B. K. (2022). Do large language models know what humans know?. ArXiv, abs/2209.01515. · arXiv
  96. Ullman, T. (2023). Large language models fail on trivial alterations to theory-of-mind tasks. ArXiv, abs/2302.08399. · arXiv
  97. Urbanek, J., Fan, A., Karamcheti, S., Jain, S., Humeau, S., Dinan, E., Rocktäschel, T., Kiela, D., Szlam, A., & Weston, J. (2019). Learning to speak and act in a fantasy text adventure game. In Inui, K., Jiang, J., Ng, V., & Wan, X. (Eds.), Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, EMNLP-IJCNLP 2019, Hong Kong, China, November 3-7, 2019, pp. 673-683. Association for Computational Linguistics.
  98. Vollmer, A.-L., Wrede, B., Rohlfing, K. J., & Oudeyer, P.-Y. (2016). Pragmatic frames for teaching and learning in human-robot interaction: Review and challenges. Frontiers in Neurorobotics, 10, 10.
  99. Vygotsky, L. S., & Cole, M. (1978). Mind in society : the development of higher psychological processes. Harvard University Press Cambridge.
  100. Wan, Y., Mao, J., & Tenenbaum, J. B. (2022). Handmethat: Human-robot communication in physical and social environments. In Thirty-sixth Conference on Neural Information Processing Systems Datasets and Benchmarks Track.
  101. Wei, J., Wang, X., Schuurmans, D., Bosma, M., Chi, E. H., Le, Q., & Zhou, D. (2022). Chain of thought prompting elicits reasoning in large language models. CoRR, abs/2201.11903. · arXiv
  102. Whiten, A., McGuigan, N., Marshall-Pescini, S., & Hopper, L. M. (2009). Emulation, imita- tion, over-imitation and the scope of culture for child and chimpanzee. Philosophical Transactions of the Royal Society B: Biological Sciences, 364 (1528), 2417-2428.
  103. Wood, D., Bruner, J. S., & Ross, G. (1976). The role of tutoring in problem solving.. Journal of child psychology and psychiatry, and allied disciplines, 17 (2), 89-100.
  104. Wyman, E., Rakoczy, H., & Tomasello, M. (2009). Normativity and context in young children's pretend play. Cognitive development, 24 (2), 146-155.
  105. Yao, S., Zhao, J., Yu, D., Du, N., Shafran, I., Narasimhan, K., & Cao, Y. (2022). React: Synergizing reasoning and acting in language models. ArXiv, abs/2210.03629. · arXiv
  106. Zhang, S., Roller, S., Goyal, N., Artetxe, M., Chen, M., Chen, S., Dewan, C., Diab, M., Li, X., Lin, X. V., Mihaylov, T., Ott, M., Shleifer, S., Shuster, K., Simig, D., Koura, P. S., Sridhar, A., Wang, T., & Zettlemoyer, L. (2022). Opt: Open pre-trained transformer language models. ArXiv, abs/2205.01068. · arXiv
  107. Zhang, T., Xu, H., Wang, X., Wu, Y., Keutzer, K., Gonzalez, J. E., & Tian, Y. (2020). Bebold: Exploration beyond the boundary of explored regions. CoRR, abs/2012.08621. · arXiv
  108. Zhang, Z., Zhang, A., Li, M., Zhao, H., Karypis, G., & Smola, A. J. (2023). Multimodal chain-of-thought reasoning in language models. ArXiv, abs/2302.00923. · arXiv

Cited by

Sorted by citations

Authors
Kovač, G., Portelas, R., Dominey, P. F., & Oudeyer, P.-Y.
Affiliations
Ubisoft (France) (FR)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2023
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2307.07871
arXiv
2307.07871
OpenAlex
W4384644007
Cited by
3
References
0
Citations by year
2025: 1 · 2023: 2
Type
posted content
Language
en
Open access
Licence
Locations
  • arXiv (Cornell University) (submittedVersion, other-oa)
  • HAL (submittedVersion, cc-by)
  • arXiv (Cornell University)
Topics
  • Social Sciences › Psychology › Developmental and Educational Psychology › Child and Animal Learning Development
  • Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
  • Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
Keywords
socio-cognitive abilities, social intelligence, developmental psychology, Michael Tomasello, Bruner, emergence of culture, multi-agent systems, procedural environment generation, large language models, reinforcement learning agents

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review