Integration of Action and Language Knowledge: A Roadmap for Developmental Robotics
Open accessThe DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
This position paper proposes that the study of embodied cognitive agents, such as humanoid robots, can advance our understanding of the cognitive development of complex sensorimotor, linguistic, and social learning skills. This in turn will benefit the design of cognitive robots capable of learning to handle and manipulate objects and tools autonomously, to cooperate and communicate with other robots and humans, and to adapt their abilities to changing internal, environmental, and social conditions. Four key areas of research challenges are discussed, specifically for the issues related to the understanding of: 1) how agents learn and represent compositional actions; 2) how agents learn and represent compositional lexica; 3) the dynamics of social interaction and learning; and 4) how compositional action and language representations are integrated to bootstrap the cognitive system. The review of specific issues and progress in these areas is then translated into a practical roadmap based on a series of milestones. These milestones provide a possible set of cognitive robotics goals and test scenarios, thus acting as a research roadmap for future work on cognitive developmental robotics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
THE ROLE OF TUTORING IN PROBLEM SOLVING *
Wood, D., Bruner, J. S., & Ross, G. (1976) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.1976.tb00381.x · Cited by 8,851 · cited 1×
“F However, the experiment was limited in its scalability and lacked developmental aspects. o New studies should include more advanced experiments to look at developmental processes of acquiring manipulation action patterns based on combination and sequences of movements.”
Understanding and sharing intentions: The origins of cultural cognition
Tomasello, M., Carpenter, M., Call, J., Behne, T., & Moll, H. (2005) · Behavioral and Brain Sciences · doi:10.1017/s0140525x05000129 · Cited by 4,882
The construction of reality in the child.
Piaget, J. (1954) · doi:10.1037/11168-000 · Cited by 4,558
Harnad, S. (1990) · Physica D: Nonlinear Phenomena · doi:10.1016/0167-2789(90)90087-6 · Cited by 4,235 · cited 4×
“…should possess a categorical perception ability which allows them to transform continuous signals perceived by sensory organs into internal states or internal dynamics in which members of the same category resemble one another more than they resemble members of other categories (Harnad 1990).”
InfluentialLanguage identification in the limit
Gold, E. M. (1967) · Information and Control · doi:10.1016/s0019-9958(67)91165-5 · Cited by 3,572 · cited 2×
“Also in the community of theoretical computational linguistics, which had traditionally seen the grammar learning problem to be intractable without universal grammar in view of Gold’s results [88], biases in the”
A Dynamic Systems Approach to the Development of Cognition and Action
Thelen, E., & Smith, L. B. (1994) · doi:10.7551/mitpress/2524.001.0001 · Cited by 3,470
A sensorimotor account of vision and visual consciousness
O'Regan, J. K., & Noë, A. (2001) · Behavioral and Brain Sciences · doi:10.1017/s0140525x01000115 · Cited by 3,126 · cited 1×
“However these modules co-influence each other through some shared neurons (called parametric bias) that are forced to assume similar states during the execution of the two related tasks.”
Action and embodiment within situated human interaction
Goodwin, C. (2000) · Journal of Pragmatics · doi:10.1016/s0378-2166(99)00096-x · Cited by 3,073
Rizzolatti, G., & Arbib, M. A. (1998) · Trends in Neurosciences · doi:10.1016/s0166-2236(98)01260-0 · Cited by 2,858
Social cognition, joint attention, and communicative competence from 9 to 15 months of age.
Carpenter, M., Nagell, K., Tomasello, M., Butterworth, G., & Moore, C. (1998) · Monographs of the Society for Research in Child Development · doi:10.2307/1166214 · Cited by 2,727
Cited by
Interpersonal synchrony: a survey of evaluation methods across disciplines.
Delaherche, E., Chetouani, M., Mahdhaoui, A., Saint-Georges, C., Viaux, S., & Cohen, D. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2012.12 · Cited by 474
Symbol emergence in robotics: a survey
Taniguchi, T., Nagai, T., Nakamura, T., Iwahashi, N., Ogata, T., & Asoh, H. (2016) · Advanced Robotics · doi:10.1080/01691864.2016.1164622 · Cited by 150
Language and culture internalization for human-like autotelic AI
Colas, C., Karch, T., Moulin-Frier, C., & Oudeyer, P.-Y. (2022) · Nature Machine Intelligence · doi:10.1038/s42256-022-00591-4 · Cited by 34
Metadata
- Authors
- Cangelosi, A., Metta, G., Sagerer, G., Nolfi, S., Nehaniv, C., Fischer, K., Tani, J., Belpaeme, T., Sandini, G., Nori, F., Fadiga, L., Wrede, B., Rohlfing, K., Tuci, E., Dautenhahn, K., Saunders, J., & Zeschel, A.
- Venue
- IEEE Transactions on Autonomous Mental Development
- Published
- 2010-09
- Volume
- 2
- Issue
- 3
- Pages
- 167-195
- ISSN
- 1943-0604 (ISSN-L)
- 1943-0612
- OpenAlex
- W2162457740
- Cited by
- 169
- References
- 27
- FWCI
- 21.88
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.