Integration of Action and Language Knowledge: A Roadmap for Developmental Robotics
Open accessThe DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
This position paper proposes that the study of embodied cognitive agents, such as humanoid robots, can advance our understanding of the cognitive development of complex sensorimotor, linguistic, and social learning skills. This in turn will benefit the design of cognitive robots capable of learning to handle and manipulate objects and tools autonomously, to cooperate and communicate with other robots and humans, and to adapt their abilities to changing internal, environmental, and social conditions. Four key areas of research challenges are discussed, specifically for the issues related to the understanding of: 1) how agents learn and represent compositional actions; 2) how agents learn and represent compositional lexica; 3) the dynamics of social interaction and learning; and 4) how compositional action and language representations are integrated to bootstrap the cognitive system. The review of specific issues and progress in these areas is then translated into a practical roadmap based on a series of milestones. These milestones provide a possible set of cognitive robotics goals and test scenarios, thus acting as a research roadmap for future work on cognitive developmental robotics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
THE ROLE OF TUTORING IN PROBLEM SOLVING *
Wood, D., Bruner, J. S., & Ross, G. (1976) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.1976.tb00381.x · Cited by 8,851 · cited 1×
“F However, the experiment was limited in its scalability and lacked developmental aspects. o New studies should include more advanced experiments to look at developmental processes of acquiring manipulation action patterns based on combination and sequences of movements.”
Understanding and sharing intentions: The origins of cultural cognition
Tomasello, M., Carpenter, M., Call, J., Behne, T., & Moll, H. (2005) · Behavioral and Brain Sciences · doi:10.1017/s0140525x05000129 · Cited by 4,882
The construction of reality in the child.
Piaget, J. (1954) · doi:10.1037/11168-000 · Cited by 4,558
Harnad, S. (1990) · Physica D: Nonlinear Phenomena · doi:10.1016/0167-2789(90)90087-6 · Cited by 4,235 · cited 4×
“…should possess a categorical perception ability which allows them to transform continuous signals perceived by sensory organs into internal states or internal dynamics in which members of the same category resemble one another more than they resemble members of other categories (Harnad 1990).”
InfluentialLanguage identification in the limit
Gold, E. M. (1967) · Information and Control · doi:10.1016/s0019-9958(67)91165-5 · Cited by 3,572 · cited 2×
“Also in the community of theoretical computational linguistics, which had traditionally seen the grammar learning problem to be intractable without universal grammar in view of Gold’s results [88], biases in the”
A Dynamic Systems Approach to the Development of Cognition and Action
Thelen, E., & Smith, L. B. (1994) · doi:10.7551/mitpress/2524.001.0001 · Cited by 3,470
A sensorimotor account of vision and visual consciousness
O'Regan, J. K., & Noë, A. (2001) · Behavioral and Brain Sciences · doi:10.1017/s0140525x01000115 · Cited by 3,126 · cited 1×
“However these modules co-influence each other through some shared neurons (called parametric bias) that are forced to assume similar states during the execution of the two related tasks.”
Action and embodiment within situated human interaction
Goodwin, C. (2000) · Journal of Pragmatics · doi:10.1016/s0378-2166(99)00096-x · Cited by 3,073
Rizzolatti, G., & Arbib, M. A. (1998) · Trends in Neurosciences · doi:10.1016/s0166-2236(98)01260-0 · Cited by 2,858
Social cognition, joint attention, and communicative competence from 9 to 15 months of age.
Carpenter, M., Nagell, K., Tomasello, M., Butterworth, G., & Moore, C. (1998) · Monographs of the Society for Research in Child Development · doi:10.2307/1166214 · Cited by 2,727
Glenberg, A. M., & Kaschak, M. P. (2002) · Psychonomic Bulletin & Review · doi:10.3758/bf03196313 · Cited by 2,361
Parietal Lobe: From Action Organization to Intention Understanding
Fogassi, L., Ferrari, P. F., Gesierich, B., Rozzi, S., Chersi, F., & Rizzolatti, G. (2005) · Science · doi:10.1126/science.1106138 · Cited by 1,990 · cited 2×
“We are convinced that experiments of human-robot interaction, coupled with observations of parent-children tutoring situations, can shed light on these topics.”
The Infant's Response to Entrapment between Contradictory Messages in Face-to-Face Interaction
Tronick, E., Als, H., Adamson, L., Wise, S., & Brazelton, T. B. (1978) · Journal of the American Academy of Child Psychiatry · doi:10.1016/s0002-7138(09)62273-1 · Cited by 1,880 · cited 1×
“In the literature, there is an agreement that contingency is an important factor in the cognitive development of infants – as researched, e.g., within the still face paradigm (e.g. Tronick et al., 1978 ; Muir and Lee, 2003).”
Intrinsic Motivation Systems for Autonomous Mental Development
Oudeyer, P.-Y., Kaplan, F., & Hafner, V. V. (2007) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2006.890271 · Cited by 1,126
Language Acquisition and Conceptual Development
(2001) · doi:10.1017/cbo9780511620669 · Cited by 1,082
Tomasello, M., Carpenter, M., & Liszkowski, U. (2007) · Child Development · doi:10.1111/j.1467-8624.2007.01025.x · Cited by 1,039
CONSTRUCTING A LANGUAGE: A USAGE-BASED THEORY OF LANGUAGE ACQUISITION
Foster-Cohen, S. (2004) · Studies in Second Language Acquisition · doi:10.1017/s0272263104363059 · Cited by 969
Neural mechanisms for the recognition of biological movements
Giese, M. A., & Poggio, T. (2003) · Nature Reviews Neuroscience · doi:10.1038/nrn1057 · Cited by 955 · cited 1×
“The underlying principle of these systems is to gradually increase both the selectivity of neurons to stimuli along with their invariance to (2D) transformations in a series of processing levels (Giese and Poggio 2003).”
Object Representation in the Ventral Premotor Cortex (Area F5) of the Monkey
Murata, A., Fadiga, L., Fogassi, L., Gallese, V., Raos, V., & Rizzolatti, G. (1997) · Journal of Neurophysiology · doi:10.1152/jn.1997.78.4.2226 · Cited by 753
Self-citationRizzolatti, G., Fadiga, L., Fogassi, L., & Gallese, V. (1997) · Science · doi:10.1126/science.277.5323.190 · Cited by 712
Self-citationCoding of peripersonal space in inferior premotor cortex (area F4).
Fogassi, L., Gallese, V., Fadiga, L., Luppino, G., Matelli, M., & Rizzolatti, G. (1996) · Journal of Neurophysiology · doi:10.1152/jn.1996.76.1.141 · Cited by 688 · cited 2×
“The design of object manipulation and communication capabilities should be inspired by interdisciplinary empirical and theoretical investigations of linguistic and cognitive development in children and adults, as well as of experiments with humanoid robots.”
Self-citationVisuospatial properties of ventral premotor cortex
Graziano, M. S. A., Hu, X. T., & Gross, C. G. (1997) · Journal of Neurophysiology · doi:10.1152/jn.1997.77.5.2268 · Cited by 603
A construction based analysis of child directed speech
Cameron‐Faulkner, T., Lieven, E., & Tomasello, M. (2003) · Cognitive Science · doi:10.1207/s15516709cog2706_2 · Cited by 592
Coordinating perceptually grounded categories through language: A case study for colour
steels, L., & belpaeme, T. (2005) · Behavioral and Brain Sciences · doi:10.1017/s0140525x05000087 · Cited by 440 · cited 2×
“…of coordinating gaze and attention together with reaching and eventually of manipulating the external world via grasping (von Hofsten 2004). remains to be considered that none of these skills is innate, but rather they develop through experience and in many cases require several years before…”
Self-citationBahrick, L. E., Lickliter, R., & Flom, R. (2004) · Current Directions in Psychological Science · doi:10.1111/j.0963-7214.2004.00283.x · Cited by 341 · cited 2×
“The idea is that e.g. words as acoustically perceived signal and actions as visually perceived signal may become paired by the shared temporal synchrony (Bahrick et al., 2004).”
Acquiring basic word order: evidence for data-driven learning of syntactic structure
AKHTAR, N. (1999) · Journal of Child Language · doi:10.1017/s030500099900375x · Cited by 320 · cited 2×
“For instance, are generalized constructional schemas only formed after an initial item-based phase of syntactic development, and possibly only after a certain critical mass of relevant ‘verb islands’ has been acquired (Tomasello 1992; Akhtar 1999)?”
Tani, J., & Nolfi, S. (1999) · Neural Networks · doi:10.1016/s0893-6080(99)00060-x · Cited by 259
Self-citation
Cited by
Interpersonal synchrony: a survey of evaluation methods across disciplines.
Delaherche, E., Chetouani, M., Mahdhaoui, A., Saint-Georges, C., Viaux, S., & Cohen, D. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2012.12 · Cited by 474
Symbol emergence in robotics: a survey
Taniguchi, T., Nagai, T., Nakamura, T., Iwahashi, N., Ogata, T., & Asoh, H. (2016) · Advanced Robotics · doi:10.1080/01691864.2016.1164622 · Cited by 150
Language and culture internalization for human-like autotelic AI
Colas, C., Karch, T., Moulin-Frier, C., & Oudeyer, P.-Y. (2022) · Nature Machine Intelligence · doi:10.1038/s42256-022-00591-4 · Cited by 34
Metadata
- Authors
- Cangelosi, A., Metta, G., Sagerer, G., Nolfi, S., Nehaniv, C., Fischer, K., Tani, J., Belpaeme, T., Sandini, G., Nori, F., Fadiga, L., Wrede, B., Rohlfing, K., Tuci, E., Dautenhahn, K., Saunders, J., & Zeschel, A.
- Venue
- IEEE Transactions on Autonomous Mental Development
- Published
- 2010-09
- Volume
- 2
- Issue
- 3
- Pages
- 167-195
- ISSN
- 1943-0604 (ISSN-L)
- 1943-0612
- OpenAlex
- W2162457740
- Cited by
- 169
- References
- 27
- FWCI
- 21.88
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.