The DOI matches its Crossref record; 68 of the 68 references it cites were found in a registry or an index.
Emergence of Functional Hierarchy in a Multiple Timescale Neural Network Model: A Humanoid Robot Experiment
Open accessAbstract
It is generally thought that skilled behavior in human beings results from a functional hierarchy of the motor control system, within which reusable motor primitives are flexibly integrated into various sensori-motor sequence patterns. The underlying neural mechanisms governing the way in which continuous sensori-motor flows are segmented into primitives and the way in which series of primitives are integrated into various behavior sequences have, however, not yet been clarified. In earlier studies, this functional hierarchy has been realized through the use of explicit hierarchical structure, with local modules representing motor primitives in the lower level and a higher module representing sequences of primitives switched via additional mechanisms such as gate-selecting. When sequences contain similarities and overlap, however, a conflict arises in such earlier models between generalization and segmentation, induced by this separated modular structure. To address this issue, we propose a different type of neural network model. The current model neither makes use of separate local modules to represent primitives nor introduces explicit hierarchical structure. Rather than forcing architectural hierarchy onto the system, functional hierarchy emerges through a form of self-organization that is based on two distinct types of neurons, each with different time properties ("multiple timescales"). Through the introduction of multiple timescales, continuous sequences of behavior are segmented into reusable primitives, and the primitives, in turn, are flexibly integrated into novel sequences. In experiments, the proposed network model, coordinating the physical body of a humanoid robot through high-dimensional sensori-motor control, also successfully situated itself within a physical environment. Our results suggest that it is not only the spatial connections between neurons but also the timescales of neural activity that act as important mechanisms leading to functional hierarchy in neural systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Kohonen, T. (2001) · Springer Series in Information Sciences · doi:10.1007/978-3-642-56927-2 · Cited by 16,019
Parallel Distributed Processing: Explorations in the Microstructure of Cognition: Foundations
Rumelhart, D. E., McClelland, J. L., & AU (1986) · doi:10.7551/mitpress/5236.001.0001 · Cited by 15,686
Elman, J. L. (1990) · Cognitive Science · doi:10.1207/s15516709cog1402_1 · Cited by 11,212
Distributed hierarchical processing in the primate cerebral cortex
Felleman, D. J., & Van Essen, D. C. (1991) · Cerebral Cortex · doi:10.1093/cercor/1.1.1 · Cited by 7,783
The Embodied Mind: Cognitive Science and Human Experience
Varela, F. J., Rosch, E., & Thompson, E. (1991) · doi:10.7551/mitpress/6730.001.0001 · Cited by 5,765
The brainweb: phase synchronization and large-scale integration
Varela, F., Lachaux, J.-P., Rodriguez, E., & Martinerie, J. (2001) · Nature Reviews Neuroscience · doi:10.1038/35067550 · Cited by 4,761
A theory of cortical responses.
Friston, K. (2005) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2005.1622 · Cited by 4,578
An internal model for sensorimotor integration
Wolpert, D. M., Ghahramani, Z., & Jordan, M. I. (1995) · Science · doi:10.1126/science.7569931 · Cited by 3,553
Preface: Cerebral Cortex Has Come of Age
Goldman-Rakic, P. S., & Rakic, P. (1991) · Cerebral Cortex · doi:10.1093/cercor/1.1.1-a · Cited by 3,393
The representing brain: Neural correlates of motor intention and imagery
Jeannerod, M. (1994) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00034026 · Cited by 2,569
Parallel & distributed processing
Slusallek, P., Shirley, P., Mark, W., Stoll, G., & Wald, I. (2005) · ACM SIGGRAPH 2005 Courses on - SIGGRAPH '05 · doi:10.1145/1198555.1198750 · Cited by 2,568
The Embodied Mind: Cognitive Science and Human Experience
Varela, F. J., Thompson, E., & Rosch, E. (2017) · doi:10.7551/mitpress/9780262529365.001.0001 · Cited by 2,449
Multiple paired forward and inverse models for motor control
Wolpert, D. M., & Kawato, M. (1998) · Neural Networks · doi:10.1016/s0893-6080(98)00066-5 · Cited by 2,151
The Prefrontal Cortex—An Update
Fuster, J. M. (2001) · Neuron · doi:10.1016/s0896-6273(01)00285-9 · Cited by 1,775
Network structure of cerebral cortex shapes functional connectivity on multiple time scales
Honey, C. J., Kötter, R., Breakspear, M., & Sporns, O. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0701519104 · Cited by 1,711
Rizzolatti, G., Camarda, R., Fogassi, L., Gentilucci, M., Luppino, G., & Matelli, M. (1988) · Experimental Brain Research · doi:10.1007/bf00248742 · Cited by 1,550
Forward models: supervised learning with a distal teacher
Jordan, M. I., & Rumelhart, D. E. (1992) · Cognitive Science · doi:10.1207/s15516709cog1603_1 · Cited by 1,451
Rizzolatti, G., & Luppino, G. (2001) · Neuron · doi:10.1016/s0896-6273(01)00423-8 · Cited by 1,348
Self-Organization, Embodiment, and Biologically Inspired Robotics
Pfeifer, R., Lungarella, M., & Iida, F. (2007) · Science · doi:10.1126/science.1145803 · Cited by 1,227
Identification and classification of hubs in brain networks
Sporns, O., Honey, C. J., & Kötter, R. (2007) · PLoS ONE · doi:10.1371/journal.pone.0001049 · Cited by 1,165
Distinct spatial frequency sensitivities for processing faces and emotional expressions
Vuilleumier, P., Armony, J. L., Driver, J., & Dolan, R. J. (2003) · Nature Neuroscience · doi:10.1038/nn1057 · Cited by 1,117
Interacting adaptive processes with different timescales underlie short-term motor learning
Smith, M. A., Ghazizadeh, A., & Shadmehr, R. (2006) · PLoS Biology · doi:10.1371/journal.pbio.0040179 · Cited by 1,113 · cited 1×
“Biological observations on motor adaptation, such as for example saccade adaptation and force field adaptation, likewise suggest that these processes involve distinct subsystems with differing timescales [21,22].”
BackgroundThe dynamics of embodiment: A field theory of infant perseverative reaching
Thelen, E., Schöner, G., Scheier, C., & Smith, L. B. (2001) · Behavioral and Brain Sciences · doi:10.1017/s0140525x01003910 · Cited by 1,066
Cisek, P., & Kalaska, J. F. (2005) · Neuron · doi:10.1016/j.neuron.2005.01.027 · Cited by 1,054
Learning of action through adaptive combination of motor primitives
Thoroughman, K. A., & Shadmehr, R. (2000) · Nature · doi:10.1038/35037588 · Cited by 945
Muscle and movement representations in the primary motor cortex
Kakei, S., Hoffman, D. S., & Strick, P. L. (1999) · Science · doi:10.1126/science.285.5436.2136 · Cited by 796
MOSAIC Model for Sensorimotor Learning and Control
Haruno, M., Wolpert, D. M., & Kawato, M. (2001) · Neural Computation · doi:10.1162/089976601750541778 · Cited by 709
Motor areas in the frontal lobe of the primate
DUM, R., & STRICK, P. (2002) · Physiology & Behavior · doi:10.1016/s0031-9384(02)00929-0 · Cited by 653
The premotor cortex of the monkey
Weinrich, M., & Wise, S. (1982) · The Journal of Neuroscience · doi:10.1523/jneurosci.02-09-01329.1982 · Cited by 617
Hierarchical and asymmetric temporal sensitivity in human auditory cortices
Boemio, A., Fromm, S., Braun, A., & Poeppel, D. (2005) · Nature Neuroscience · doi:10.1038/nn1409 · Cited by 582
Convergent force fields organized in the frog's spinal cord
Giszter, S., Mussa-Ivaldi, F., & Bizzi, E. (1993) · The Journal of Neuroscience · doi:10.1523/jneurosci.13-02-00467.1993 · Cited by 544
Speech perception at the interface of neurobiology and linguistics
Poeppel, D., Idsardi, W. J., & van Wassenhove, V. (2008) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2007.2160 · Cited by 497
Hoshi, E., & Tanji, J. (2007) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2007.02.003 · Cited by 445
Time scales in motor learning and development.
Newell, K. M., Liu, Y.-T., & Mayer‐Kress, G. (2001) · Psychological Review · doi:10.1037//0033-295x.108.1.57 · Cited by 405
The dynamics of memory as a consequence of optimal adaptation to a changing body
Kording, K. P., Tenenbaum, J. B., & Shadmehr, R. (2007) · Nature Neuroscience · doi:10.1038/nn1901 · Cited by 393
Spatial Relationships among Three Columnar Systems in Cat Area 17
Hübener, M., Shoham, D., Grinvald, A., & Bonhoeffer, T. (1997) · The Journal of Neuroscience · doi:10.1523/jneurosci.17-23-09270.1997 · Cited by 377
Asanuma, H., & Ros�n, I. (1972) · Experimental Brain Research · doi:10.1007/bf00816161 · Cited by 370
A NEUROPHYSIOLOGICAL STUDY OF THE PREMOTOR CORTEX IN THE RHESUS MONKEY
WEINRICH, M., WISE, S. P., & MAURITZ, K.-H. (1984) · Brain · doi:10.1093/brain/107.2.385 · Cited by 370
The Cortical Control of Movement Revisited
Graziano, M. S. A., Taylor, C. S. R., Moore, T., & Cooke, D. F. (2002) · Neuron · doi:10.1016/s0896-6273(02)01003-6 · Cited by 363
Dynamical consequences of lesions in cortical networks
Honey, C. J., & Sporns, O. (2008) · Human Brain Mapping · doi:10.1002/hbm.20579 · Cited by 353
Learning in spiking neural networks by reinforcement of stochastic synaptic transmission
Seung, H. S. (2003) · Neuron · doi:10.1016/s0896-6273(03)00761-x · Cited by 340 · cited 1×
“Similar results could be obtained using a different learning algorithm, such as for example the biologically plausible algorithm proposed by Seung’s group [46,47], a kind of reinforcement learning.”
ResultModel-based learning for mobile robot navigation from the dynamical systems perspective
Tani, J. (1996) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/3477.499793 · Cited by 335
Self-citationMotor learning through the combination of primitives
Mussa–Ivaldi, F. A., & Bizzi, E. (2000) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.2000.0733 · Cited by 330
Mapping Behavioral Repertoire onto the Cortex
Graziano, M. S. A., & Aflalo, T. N. (2007) · Neuron · doi:10.1016/j.neuron.2007.09.013 · Cited by 318
The color-opponent and broad-band channels of the primate visual system
Schiller, P. H., & Logothetis, N. K. (1990) · Trends in Neurosciences · doi:10.1016/0166-2236(90)90117-s · Cited by 311
Chunking during human visuomotor sequence learning
Sakai, K., Kitaguchi, K., & Hikosaka, O. (2003) · Experimental Brain Research · doi:10.1007/s00221-003-1548-8 · Cited by 306
Tani, J., & Nolfi, S. (1999) · Neural Networks · doi:10.1016/s0893-6080(99)00060-x · Cited by 259
Self-citationForward estimation of movement state in posterior parietal cortex
Mulliken, G. H., Musallam, S., & Andersen, R. A. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0802602105 · Cited by 214
Spatial Frequency Columns in Primary Visual Cortex
Tootell, R. B., Silverman, M. S., & De Valois, R. L. (1981) · Science · doi:10.1126/science.7292014 · Cited by 207
Selective coding of motor sequence in the supplementary motor area of the monkey cerebral cortex
Mushiake, H., Inase, M., & Tanji, J. (1990) · Experimental Brain Research · doi:10.1007/bf00230853 · Cited by 170
Hilgetag, C., O'Neill, M. A., & Young, M. P. (2000) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.2000.0550 · Cited by 167
Fiete, I. R., Fee, M. S., & Seung, H. S. (2007) · Journal of Neurophysiology · doi:10.1152/jn.01311.2006 · Cited by 167
Neural Organization: Structure, Function, and Dynamics
Arbib, M. A., Érdi, P., & Szentágothai, J. (1997) · Cited by 161
Learning in neural networks by reinforcement of irregular spiking
Xie, X. S., & Seung, H. S. (2004) · Physical Review E · doi:10.1103/physreve.69.041909 · Cited by 157
Detecting Neural-State Transitions Using Hidden Markov Models for Motor Cortical Prostheses
Kemere, C., Santhanam, G., Yu, B. M., Afshar, A., Ryu, S. I., Meng, T. H., & Shenoy, K. V. (2008) · Journal of Neurophysiology · doi:10.1152/jn.00924.2007 · Cited by 157
Adaptive neural oscillator using continuous-time back-propagation learning
Doya, K., & Yoshizawa, S. (1989) · Neural Networks · doi:10.1016/0893-6080(89)90022-1 · Cited by 129
Kuniyoshi, Y., & Sangawa, S. (2006) · Biological Cybernetics · doi:10.1007/s00422-006-0127-z · Cited by 108
How Hierarchical Control Self-organizes in Artificial Adaptive Systems
Paine, R. W., & Tani, J. (2005) · Adaptive Behavior · doi:10.1177/105971230501300303 · Cited by 92
Self-citationLi, M., & Greenside, H. (2006) · Physical Review E · doi:10.1103/physreve.74.011918 · Cited by 77
A model of smooth pursuit in primates based on learning the target dynamics
Shibata, T., Tabata, H., Stefan Schaal, A., & Kawato, M. (2005) · Neural Networks · doi:10.1016/j.neunet.2005.01.001 · Cited by 72
Codevelopmental Learning Between Human and Humanoid Robot Using a Dynamic Neural-Network Model
Tani, J., Nishimoto, R., Namikawa, J., & Ito, M. (2008) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2007.907738 · Cited by 55
Self-citationNolfi, S. (2002) · Connection Science · doi:10.1080/09540090208559329 · Cited by 53
Multiple Time Scales and Multiform Dynamics in Learning to Juggle
Huys, R., Daffertshofer, A., & Beek, P. J. (2004) · Motor Control · doi:10.1123/mcj.8.2.188 · Cited by 47
Tani, J., Nishimoto, R., & Paine, R. W. (2008) · Neural Networks · doi:10.1016/j.neunet.2008.03.008 · Cited by 42
Self-citationLearning Nonparametric Models for Probabilistic Imitation
Grimes, D. B., Rashid, D. R., & Rao, R. P. N. (2007) · The MIT Press eBooks · doi:10.7551/mitpress/7503.003.0070 · Cited by 40
Structure of Spontaneous UP and DOWN Transitions Self-Organizing in a Cortical Network Model
Kang, S., Kitano, K., & Fukai, T. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000022 · Cited by 38
Nishimoto, R., Namikawa, J., & Tani, J. (2008) · Adaptive Behavior · doi:10.1177/1059712308089185 · Cited by 35
Self-citationNishimoto, R., & Tani, J. (2004) · Neural Networks · doi:10.1016/j.neunet.2004.02.003 · Cited by 28
Self-citation
Cited by
Understanding complexity in the human brain
Bassett, D. S., & Gazzaniga, M. S. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.03.006 · Cited by 572
“Although the majority of metaphors have been drawn from systems that are constructed (e.g. robots, computers, the Internet and social systems), it is possible that some important insights can only be gleaned by examining the system that is doing the constructing.”
Design of deep echo state networks
Gallicchio, C., Micheli, A., & Pedrelli, L. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.08.002 · Cited by 262
Internally generated sequences in learning and executing goal-directed behavior
Pezzulo, G., van der Meer, M. A. A., Lansink, C. S., & Pennartz, C. M. A. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.06.011 · Cited by 217
The brain and its time: intrinsic neural timescales are key for input processing
Golesorkhi, M., Gomez-Pilar, J., Zilio, F., Berberian, N., Wolff, A., Yagoub, M. C. E., & Northoff, G. (2021) · Communications Biology · doi:10.1038/s42003-021-02483-6 · Cited by 198
The human dynamic clamp as a paradigm for social interaction
Dumas, G., de Guzman, G. C., Tognoli, E., & Kelso, J. A. S. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1407486111 · Cited by 175
Metadata
- Authors
- Yamashita, Y., & Tani, J.
- Venue
- PLoS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2008-11-07
- Volume
- 4
- Issue
- 11
- Pages
- e1000220
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- OpenAlex
- W2028418738
- Cited by
- 468
- References
- 68
- FWCI
- 13.15
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.