Exploration Behaviors, Body Representations, and Simulation Processes for the Development of Cognition in Artificial Agents
Open accessThe DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
Sensorimotor control and learning are fundamental prerequisites for cognitive development in humans and animals. Evidence from behavioural sciences and neuroscience suggests that motor and brain development are strongly intertwined with the experiential process of \textit{exploration}, where internal body representations are formed and maintained over time. In order to guide our movements, our brain must hold an internal model of our body and constantly monitor its configuration state. How can sensorimotor control using such low-level body representations enable the development of more complex cognitive and motor capabilities? Although a clear answer has still not been found for this question, several studies suggest that processes of mental simulation of action-perception loops are likely to be executed in our brain and are dependent on internal body representations. Therefore, the capability to re-enact sensorimotor experience might represent a key mechanism behind the implementation of higher cognitive capabilities, such as behaviour recognition, arbitration and imitation, sense of agency and self-other distinction. Addressed mainly to researchers on autonomous motor and mental development in artificial agents, this work aims at gathering the latest development in the study on exploration behaviours, on internal body representations, on internal models, and on mechanisms for internal sensorimotor simulations. Relevant studies in human and animal sciences are discussed and a parallel to similar investigations in robotics is presented.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Self-organized formation of topologically correct feature maps
Kohonen, T. (1982) · Biological Cybernetics · doi:10.1007/bf00337288 · Cited by 9,529
Barsalou, L. W. (2008) · Annual Review of Psychology · doi:10.1146/annurev.psych.59.103006.093639 · Cited by 5,936 · cited 10×
“, Barsalou, L. W., Cangelosi, A., Fischer, M. H., Spivey, M., and McRae, K. (2011). The mechanics of embodiment: a dialogue on embodiment and computational modeling. Front. Psychol. 2, 5. doi:10.3389/ fpsyg.2011.00005 Pfeifer, R., and Bongard, J. C. (2006). How the Body Shapes the Way We Think: A New View of Intellige…”
BackgroundInfluentialThe construction of reality in the child.
Piaget, J. (1954) · doi:10.1037/11168-000 · Cited by 4,558
Psychology as the behaviorist views it
Watson, J. B. (1913) · Psychological Review · doi:10.1037/h0074428 · Cited by 3,230
Computational principles of movement neuroscience
Wolpert, D. M., & Ghahramani, Z. (2000) · Nature Neuroscience · doi:10.1038/81497 · Cited by 2,122 · cited 1×
“Research has been done on computational internal models for action preparation and movement, in the context of reaching objects and of handling objects with different weights (Wolpert and Ghahramani, 2000).”
BackgroundThe cognitive neuropsychology of schizophrenia
(1993) · Choice Reviews Online · doi:10.5860/choice.31-0601 · Cited by 1,901
Forward models: supervised learning with a distal teacher
Jordan, M. I., & Rumelhart, D. E. (1992) · Cognitive Science · doi:10.1207/s15516709cog1603_1 · Cited by 1,451 · cited 1×
“This internal model was first proposed in the control literature as a means to overcome problems, such as the delay of feedback on standard control strategies and the presence of noise, both also characteristic of natural systems (Jordan and Rumelhart, 1992).”
BackgroundCoding of modified body schema during tool use by macaque postcentral neurones
lriki, A., Tanaka, M., & Iwamura, Y. (1996) · NeuroReport · doi:10.1097/00001756-199610020-00010 · Cited by 1,274
A unifying computational framework for motor control and social interaction
Wolpert, D. M., Doya, K., & Kawato, M. (2003) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.2002.1238 · Cited by 1,228
Maravita, A., & Iriki, A. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2003.12.008 · Cited by 1,214 · cited 4×
“Other studies (Iriki et al., 1996; Maravita and Iriki, 2004; Sposito et al., 2012; Ganesh et al., 2014) reported effects in the dynamics of movements with the usage of tools (see Figure 2), as well as plastic changes in”
BackgroundMethodInfluentialIntrinsic Motivation Systems for Autonomous Mental Development
Oudeyer, P.-Y., Kaplan, F., & Hafner, V. V. (2007) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2006.890271 · Cited by 1,126
Self-citationHow the Body Shapes the Way We Think: A New View of Intelligence
Pfeifer, R., & Bongard, J. (2006) · doi:10.7551/mitpress/3585.001.0001 · Cited by 956
Why canʼt you tickle yourself?
Blakemore, S.-J., Wolpert, D., & Frith, C. (2000) · NeuroReport · doi:10.1097/00001756-200008030-00002 · Cited by 904
Information-seeking, curiosity, and attention: computational and neural mechanisms
Gottlieb, J., Oudeyer, P.-Y., Lopes, M., & Baranes, A. (2013) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2013.09.001 · Cited by 784 · cited 9×
“Information seeking through exploration behaviors, according to Gottlieb et al. (2013), is “a process that obeys the imperative to reduce uncertainty and can be extrinsically or intrinsically motivated.” This is in line with what has been proposed by Litman (2005), as mentioned before in this section, that the drive o…”
InfluentialExplaining the symptoms of schizophrenia: abnormalities in the awareness of action.
Frith, C. (2000) · Brain Research Reviews · doi:10.1016/s0165-0173(99)00052-1 · Cited by 782
Maintaining internal representations: the role of the human superior parietal lobe
Wolpert, D. M., Goodbody, S. J., & Husain, M. (1998) · Nature Neuroscience · doi:10.1038/2245 · Cited by 745
Multisensory integration and the body schema: Close to hand and within reach
Maravita, A., Spence, C., & Driver, J. (2003) · Current Biology · doi:10.1016/s0960-9822(03)00449-4 · Cited by 578
BLAKEMORE, S.-J., SMITH, J., STEEL, R., JOHNSTONE, E. C., & FRITH, C. D. (2000) · Psychological Medicine · doi:10.1017/s0033291799002676 · Cited by 497
Topographic Maps are Fundamental to Sensory Processing
Kaas, J. H. (1997) · Brain Research Bulletin · doi:10.1016/s0361-9230(97)00094-4 · Cited by 478
Mapping the brain's metaphor circuitry: metaphorical thought in everyday reason
Lakoff, G. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00958 · Cited by 335 · cited 1×
“Therefore, Lakoff (2014) concludes that the meaning of concepts comes through embodied cognition.”
BackgroundSelf-perception and action in infancy
Rochat, P. (1998) · Experimental Brain Research · doi:10.1007/s002210050550 · Cited by 282
Developmental mechanisms of topographic map formation and alignment
Cang, J., & Feldheim, D. A. (2013) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-062012-170341 · Cited by 275 · cited 1×
“Studies 248 on body representations (Udin and Fawcett, 1988; Cang and Feldheim, 2013) suggested the existence of 249 topographic maps in the brain, or projections of sensory receptors and of effector systems into structured 250 areas of the brain.”
BackgroundLearning tactile skills through curious exploration
Pape, L., Oddo, C. M., Controzzi, M., Cipriani, C., Förster, A., Carrozza, M. C., & Schmidhuber, J. (2012) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2012.00006 · Cited by 51
Cited by
Development of reaching to the body in early infancy: From experiments to robotic models
Hoffmann, M., Chinn, L. K., Somogyi, E., Heed, T., Fagard, J., Lockman, J. J., & O'Regan, J. K. (2017) · 2017 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob) · doi:10.1109/devlrn.2017.8329795 · Cited by 60
“Robot “body schemas” often have quite different characteristics (fixed, centralized, explicit, amodal) than what we expect from their biological counterpart, but there has been work on robot body models learning (self-calibration) as well as modeling the biological body representations and their development using robo…”
BackgroundPredictive processing in cognitive robotics: A review
Ciria, A., Schillaci, G., Pezzulo, G., Hafner, V. V., & Lara, B. (2021) · Neural Computation · doi:10.1162/neco_a_01383 · Cited by 51
“It is through bodily-interactions with their environment that agents are expected to learn and then be capable of performing cognitive tasks autonomously (Lara et al., 2018; Schillaci et al., 2016a).”
BackgroundSelf-citationArtificial cognition vs. artificial intelligence for next-generation autonomous robotic agents
Sandini, G., Sciutti, A., & Morasso, P. (2024) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2024.1349408 · Cited by 40
Personalizing Human-Agent Interaction Through Cognitive Models
Schürmann, T., & Beckerle, P. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.561510 · Cited by 24
“…of applying cognitive approaches lies in the potentially realistic imitation of human behavior and can foster both psychological research and the development of humanoid robots (Asada et al., 2009; Hoffmann et al., 2010; Schillaci et al., 2016; Prescott et al., 2019; Schürmann et al., 2019).”
BackgroundIntrinsic Robotic Introspection: Learning Internal States From Neuron Activations
Pitsillos, N., Pore, A., Jensen, B. S., & Aragon-Camarasa, G. (2021) · 2021 IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/icdl49984.2021.9515672 · Cited by 2
Metadata
- Authors
- Schillaci, G., Hafner, V. V., & Lara, B.
- Venue
- Frontiers in Robotics and AI
- Publisher
- Frontiers Media SA
- Published
- 2016-06-30
- Volume
- 3
- ISSN
- 2296-9144 (ISSN-L)
- OpenAlex
- W2470271743
- Cited by
- 67
- References
- 23
- FWCI
- 5.68
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.