A Kendama Learning Robot Based on Bi-directional Theory
Abstract
A general theory of movement-pattern perception based on bi-directional theory for sensory-motor integration can be used for motion capture and learning by watching in robotics. We demonstrate our methods using the game of Kendama, executed by the SARCOS Dextrous Slave Arm, which has a very similar kinematic structure to the human arm. Three ingredients have to be integrated for the successful execution of this task. The ingredients are (1) to extract via-points from a human movement trajectory using a forward-inverse relaxation model, (2) to treat via-points as a control variable while reconstructing the desired trajectory from all the via-points, and (3) to modify the via-points for successful execution. In order to test the validity of the via-point representation, we utilized a numerical model of the SARCOS arm, and examined the behavior of the system under several conditions. Copyright 1996 Elsevier Science Ltd.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Cites
The coordination of arm movements: an experimentally confirmed mathematical model
Flash, T., & Hogan, N. (1985) · The Journal of Neuroscience · doi:10.1523/jneurosci.05-07-01688.1985 · Cited by 4,395 · see citing works
Perception of the speech code.
Liberman, A. M., Cooper, F. S., Shankweiler, D. P., & Studdert-Kennedy, M. (1967) · Psychological Review · doi:10.1037/h0020279 · Cited by 3,722 · see citing works
Understanding motor events: a neurophysiological study
di Pellegrino, G., Fadiga, L., Fogassi, L., Gallese, V., & Rizzolatti, G. (1992) · Experimental Brain Research · doi:10.1007/bf00230027 · Cited by 3,539 · see citing works
The motor theory of speech perception revised
Liberman, A. M., & Mattingly, I. G. (1985) · Cognition · doi:10.1016/0010-0277(85)90021-6 · Cited by 2,855 · see citing works
Generalized Inverse of Matrices and Its Applications
Banerjee, K. S. (1973) · Technometrics · doi:10.1080/00401706.1973.10489026 · Cited by 2,291 · see citing works
Formation and control of optimal trajectory in human multijoint arm movement
Yasuo, U. N. O., Kawato, M., & Suzuki, R. (1989) · Biological Cybernetics · doi:10.1007/bf00204593 · Cited by 1,718 · see citing works
Self-citationA hierarchical neural-network model for control and learning of voluntary movement
Kawato, M., Furukawa, K., & Suzuki, R. (1987) · Biological Cybernetics · doi:10.1007/bf00364149 · Cited by 1,573 · see citing works
Self-citationSpatial control of arm movements
Morasso, P. (2004) · Experimental Brain Research · doi:10.1007/bf00236911 · Cited by 1,215 · see citing works
Mapping motor representations with positron emission tomography
Decety, J., Perani, D., Jeannerod, M., Bettinardi, V., Tadary, B., Woods, R., Mazziotta, J. C., & Fazio, F. (1994) · Nature · doi:10.1038/371600a0 · Cited by 976 · see citing works
Featherstone, R. (1987) · Springer eBooks · doi:10.1007/978-0-387-74315-8 · Cited by 877 · see citing works
Kuniyoshi, Y., Inaba, M., & Inoue, H. (1994) · IEEE Transactions on Robotics and Automation · doi:10.1109/70.338535 · Cited by 683 · see citing works
The control of hand equilibrium trajectories in multi-joint arm movements
Flash, T. (1987) · Biological Cybernetics · doi:10.1007/bf00338819 · Cited by 676 · see citing works
A computational model of four regions of the cerebellum based on feedback-error learning
Kawato, M., & Gomi, H. (1992) · Biological Cybernetics · doi:10.1007/bf00201431 · Cited by 627 · see citing works
Self-citationFrameworks of analysis for the neural representation of animate objects and actions
Perrett, D. I., Harries, M. H., Bevan, R., Thomas, S. M., Benson, P. J., Mistlin, A. J., Chitty, A. J., Hietanen, J. K., & Ortega, J. E. (1989) · Journal of Experimental Biology · doi:10.1242/jeb.146.1.87 · Cited by 609 · see citing works
Georgopoulos, A. P., Kalaska, J. F., & Massey, J. T. (1981) · Journal of Neurophysiology · doi:10.1152/jn.1981.46.4.725 · Cited by 597 · see citing works
Time-varying stiffness of human elbow joint during cyclic voluntary movement
Bennett, D. J., Hollerbach, J. M., Xu, Y., & Hunter, I. W. (1992) · Experimental Brain Research · doi:10.1007/bf02259118 · Cited by 480 · see citing works
Inverse-dynamics model eye movement control by Purkinje cells in the cerebellum
Shidara, M., Kawano, K., Gomi, H., & Kawato, M. (1993) · Nature · doi:10.1038/365050a0 · Cited by 393 · see citing works
Self-citationModels of Trajectory Formation and Temporal Interaction of Reach and Grasp.
Hoff, B., & Arbib, M. (1993) · Journal of Motor Behavior · doi:10.1080/00222895.1993.9942048 · Cited by 379 · see citing works
Arm Trajectory Modifications During Reaching Towards Visual Targets
Flash, T., & Henis, E. A. (1991) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1991.3.3.220 · Cited by 298 · see citing works
Kawato, M., Maeda, Y., Yasuo, U. N. O., & Suzuki, R. (1990) · Biological Cybernetics · doi:10.1007/bf00201442 · Cited by 257 · see citing works
Self-citationControl of Trajectory Modifications in Target-Directed Reaching.
Flanagan, J., Ostry, D., & Feldman, A. G. (1993) · Journal of Motor Behavior · doi:10.1080/00222895.1993.9942045 · Cited by 231 · see citing works
Katayama, M., & Kawato, M. (1993) · Biological Cybernetics · doi:10.1007/bf00199435 · Cited by 179 · see citing works
Self-citationA neural network model for arm trajectory formation using forward and inverse dynamics models
Wada, Y., & Kawato, M. (1993) · Neural Networks · doi:10.1016/s0893-6080(09)80003-8 · Cited by 156 · see citing works
Self-citationKatayama, M., & Kawato, M. (1993) · Biological Cybernetics · doi:10.1007/bf01185407 · Cited by 154 · see citing works
Self-citationA forward-inverse optics model of reciprocal connections between visual cortical areas
Kawato, M., Hayakawa, H., & Inui, T. (1993) · Network: Computation in Neural Systems · doi:10.1088/0954-898x_4_4_001 · Cited by 151 · see citing works
Self-citationBennett, D. (1993) · Experimental Brain Research · doi:10.1007/bf00227142 · Cited by 143 · see citing works
A neural network model for limb trajectory formation
Massone, L. L. E., & Bizzi, E. (1989) · Biological Cybernetics · doi:10.1007/bf02414903 · Cited by 132 · see citing works
Generalized inverse of matrices and its applications
Rao, C. R., & Mitra, S. K. (1971) · CERN Document Server (European Organization for Nuclear Research) · Cited by 128 · see citing works
Toward automatic robot instruction from perception-recognizing a grasp from observation
Kang, S. B., & Ikeuchi, K. (1993) · IEEE Transactions on Robotics and Automation · doi:10.1109/70.246054 · Cited by 120 · see citing works
Optimization and Learning in Neural Networks for Formation and Control of Coordinated Movement
Kawato, M. (1993) · The MIT Press eBooks · doi:10.7551/mitpress/1477.003.0047 · Cited by 100 · see citing works
Self-citationA theory for cursive handwriting based on the minimization principle
Wada, Y., & Kawato, M. (1995) · Biological Cybernetics · doi:10.1007/bf00199051 · Cited by 89 · see citing works
Self-citationAboaf, E. W., Atkeson, C. G., & Reinkensmeyer, D. J. (2003) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.1988.12245 · Cited by 75 · see citing works
Human hand stiffness during discrete point-to-point multi-joint movement
Gomi, H., Koike, Y., & Kawato, M. (1992) · Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society · doi:10.1109/iembs.1992.5761956 · Cited by 54 · see citing works
Self-citationA computational theory for movement pattern recognition based on optimal movement pattern generation
Wada, Y., Koike, Y., Vatikiotis‐Bateson, E., & Kawato, M. (1995) · Biological Cybernetics · doi:10.1007/bf00199052 · Cited by 36 · see citing works
Self-citationBidirectional Theory Approach to Integration
Kawato, M. (1996) · The MIT Press eBooks · doi:10.7551/mitpress/1479.003.0024 · Cited by 24 · see citing works
Self-citationA computational model for shape estimation by integration of shading and edge information
Hayakawa, H., Nishida, S., Wada, Y., & Kawato, M. (1994) · Neural Networks · doi:10.1016/0893-6080(94)90002-7 · Cited by 19 · see citing works
Self-citationSingularity Low-Sensitive Motion Resolution of Articulated Robot Arms
Nakamura, Y., & Hanafusa, H. (1984) · Transactions of the Society of Instrument and Control Engineers · doi:10.9746/sicetr1965.20.453 · Cited by 17 · see citing works
Schaal, S. (1992) · Medical Entomology and Zoology · Cited by 16 · see citing works
Self-citationA virtual pendulum manipulation system on a graphic workstation
Fujii, T., Yasuda, T., Yokoi, S., & Toriwaki, J.-I. (2002) · IEEE RO-MAN · doi:10.1109/roman.1993.367704 · Cited by 4 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Reinforcement learning in robotics: A survey
Kober, J., Bagnell, J. A., & Peters, J. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913495721 · Cited by 3,160 · see citing works
Dynamical Movement Primitives: Learning Attractor Models for Motor Behaviors
Ijspeert, A. J., Nakanishi, J., Hoffmann, H., Pástor, P., & Schaal, S. (2012) · Neural Computation · doi:10.1162/neco_a_00393 · Cited by 1,587 · see citing works
Is imitation learning the route to humanoid robots?
Schaal, S. (1999) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(99)01327-3 · Cited by 1,325 · see citing works
A unifying computational framework for motor control and social interaction
Wolpert, D. M., Doya, K., & Kawato, M. (2003) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.2002.1238 · Cited by 1,228 · see citing works
Self-citationApplication and theory gaps during the rise of artificial intelligence in education
Chen, X., Xie, H., Zou, D., & Hwang, G.-J. (2020) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2020.100002 · Cited by 1,003 · see citing works
Movement imitation with nonlinear dynamical systems in humanoid robots
Ijspeert, A. J., Nakanishi, J., & Stefan Schaal, A. (2003) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2002.1014739 · Cited by 862 · see citing works
Causes and consequences of imitation.
Heyes, C. (2001) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01661-2 · Cited by 684 · see citing works
Computational approaches to motor learning by imitation
Stefan Schaal, A., Ijspeert, A. J., & Billard, A. (2003) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2002.1258 · Cited by 588 · see citing works
Learning Attractor Landscapes for Learning Motor Primitives
Ijspeert, A. J., Nakanishi, J., Stefan Schaal, A., Becker, S., Thrun, S., & Obermayer, K. (2002) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 572 · see citing works
Policy Gradient Methods for Robotics
Peters, J., & Stefan Schaal, A. (2006) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2006.282564 · Cited by 511 · see citing works
Policy search for motor primitives in robotics
Kober, J., & Peters, J. (2010) · Machine Learning · doi:10.1007/s10994-010-5223-6 · Cited by 477 · see citing works
Breazeal, C., & Scassellati, B. M. (2002) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(02)02016-8 · Cited by 426 · see citing works
An algorithmic perspective on imitation learning
Osa, T., Pajarinen, J., Neumann, G., Bagnell, J. A., Abbeel, P., & Peters, J. (2018) · Foundations and Trends in Robotics · doi:10.1561/2300000053 · Cited by 405 · see citing works
Sammut, C., & Webb, G. I. (2010) · Encyclopedia of Machine Learning · doi:10.1007/978-0-387-30164-8_447 · Cited by 400 · see citing works
Learning from demonstration and adaptation of biped locomotion
Nakanishi, J., Morimoto, J., Endo, G., Cheng, G., Stefan Schaal, A., & Kawato, M. (2004) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2004.03.003 · Cited by 399 · see citing works
Self-citationLearning to select and generalize striking movements in robot table tennis
Muelling, K., Kober, J., Kroemer, O., & Peters, J. (2012) · AAAI Fall Symposium: Robots Learning Interactively from Human Teachers · doi:10.1177/0278364912472380 · Cited by 486 · see citing works
An Algorithmic Perspective on Imitation Learning
Osa, T., Pajarinen, J., Neumann, G. M., Bagnell, J. A., Abbeel, P., & Peters, J. (2018) · now publishers, Inc. eBooks · doi:10.1561/9781680834116 · Cited by 387 · see citing works
Task-Specific Generalization of Discrete and Periodic Dynamic Movement Primitives
Ude, A., Gams, A., Asfour, T., & Morimoto, J. (2010) · IEEE Transactions on Robotics · doi:10.1109/tro.2010.2065430 · Cited by 356 · see citing works
Breazeal, C., Buchsbaum, D., Gray, J., Gatenby, D., & Blumberg, B. M. (2005) · Artificial Life · doi:10.1162/1064546053278955 · Cited by 242 · see citing works
Trajectories and keyframes for kinesthetic teaching
Akgün, B., Çakmak, M., Yoo, J. W., & Thomaz, A. L. (2012) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/2157689.2157815 · Cited by 237 · see citing works
Learning motor primitives for robotics
Kober, J., & Peters, J. (2009) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2009.5152577 · Cited by 226 · see citing works
Policy Search for Motor Primitives in Robotics
Kober, J., & Peters, J. (2013) · Springer tracts in advanced robotics · doi:10.1007/978-3-319-03194-1_4 · Cited by 220 · see citing works
Salvato, E., Fenu, G., Medvet, E., & Pellegrino, F. A. (2021) · IEEE Access · doi:10.1109/access.2021.3126658 · Cited by 200 · see citing works
“In addition, policy search approaches result in more efficient trainings in terms of time needed for convergence [33, 34, 35, 36, 37, 38].”
BackgroundKeyframe-based Learning from Demonstration
Akgün, B., Çakmak, M., Jiang, K., & Thomaz, A. L. (2012) · International Journal of Social Robotics · doi:10.1007/s12369-012-0160-0 · Cited by 197 · see citing works
Trajectory formation for imitation with nonlinear dynamical systems
Ijspeert, A. J., Nakanishi, J., & Stefan Schaal, A. (2002) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2001.976259 · Cited by 180 · see citing works
On-line learning and modulation of periodic movements with nonlinear dynamical systems
Gams, A., Ijspeert, A. J., Schaal, S., & Lenarčič, J. (2009) · Autonomous Robots · doi:10.1007/s10514-009-9118-y · Cited by 168 · see citing works
Matarić, M. J. (1998) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(98)01141-3 · Cited by 167 · see citing works
Towards Autonomous Robotic Valve Turning
Carrera, A., Ahmadzadeh, S. R., Ajoudani, A., Kormushev, P. S., Carreras, M., & Caldwell, D. G. (2012) · Cybernetics and Information Technologies · doi:10.2478/cait-2012-0018 · Cited by 159 · see citing works
The meaning of action: a review on action recognition and mapping
Krüger, V., Kragić, D., Ude, A., & Geib, C. (2007) · Advanced Robotics · doi:10.1163/156855307782148578 · Cited by 158 · see citing works
Reinforcement Learning in Robotics: A Survey
Kober, J., & Peters, J. (2012) · Adaptation, learning, and optimization · doi:10.1007/978-3-642-27645-3_18 · Cited by 150 · see citing works
Imitation and Reinforcement Learning
Kober, J., & Peters, J. (2010) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2010.936952 · Cited by 132 · see citing works
Robot arm control exploiting natural dynamics
Williamson, M. M., & Brooks, R. A. (1999) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 127 · see citing works
Learning tasks from a single demonstration
Atkeson, C. G., & Stefan Schaal, A. (2002) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.1997.614389 · Cited by 128 · see citing works
Learning motor skills: from algorithms to robot experiments
Kober, J. (2014) · it - Information Technology · doi:10.1515/itit-2014-1039 · Cited by 116 · see citing works
Fixation behavior in observation and imitation of human movement
Matarić, M. J., & Pomplun, M. (1998) · Cognitive Brain Research · doi:10.1016/s0926-6410(98)00025-1 · Cited by 106 · see citing works
The neuroscience of social interaction : decoding, imitating, and influencing the actions of others
Frith, C., & Wolpert, D. M. (2004) · Cited by 104 · see citing works
Reinforcement learning of clothing assistance with a dual-arm robot
Tamei, T., Matsubara, T., Rai, A., & Shibata, T. (2011) · 2011 11th IEEE-RAS International Conference on Humanoid Robots · doi:10.1109/humanoids.2011.6100915 · Cited by 103 · see citing works
AVID: Learning Multi-Stage Tasks via Pixel-Level Translation of Human Videos
Smith, L., Dhawan, N., Zhang, M., Abbeel, P., & Levine, S. (2020) · Robotics: Science and Systems XVI · doi:10.15607/rss.2020.xvi.024 · Cited by 102 · see citing works
HUMANOID ROBOTS AS COOPERATIVE PARTNERS FOR PEOPLE
Breazeal, C., Brööks, A. G., Gray, J., Hoffman, G., Kidd, C. D., Lee, H. C., Lieberman, J., Thomaz, A. L., & Mulanda, D. (2004) · Cited by 102 · see citing works
A developmental approach to visually-guided reaching in artificial systems
Giorgio Metta, B., Sandini, G., & Konczak, J. (1999) · Neural Networks · doi:10.1016/s0893-6080(99)00070-2 · Cited by 101 · see citing works
From visuo-motor self learning to early imitation-a neural architecture for humanoid learning
Kuniyoshi, Y., Yorozu, Y., Inaba, M., & Inoue, H. (2004) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2003.1242072 · Cited by 96 · see citing works
The new robotics—towards human‐centered machines
Stefan Schaal, A. (2007) · HFSP journal · doi:10.2976/1.2748612 · Cited by 83 · see citing works
On-line frequency adaptation and movement imitation for rhythmic robotic tasks
Petrič, T., Gams, A., Ijspeert, A. J., & Žlajpah, L. (2011) · The International Journal of Robotics Research · doi:10.1177/0278364911421511 · Cited by 82 · see citing works
Morimoto, J., & Atkeson, C. G. (2007) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2007.380654 · Cited by 79 · see citing works
Representation for knot-tying tasks
Takamatsu, J., Morita, T., Ogawara, K., Kimura, H., & Ikeuchi, K. (2006) · IEEE Transactions on Robotics · doi:10.1109/tro.2005.855988 · Cited by 79 · see citing works
Kuniyoshi, Y., Ohmura, Y., Terada, K., Nagakubo, A., Eitoku, S.-I., & 山本, 知. (2004) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2004.07.004 · Cited by 79 · see citing works
Robot Catching: Towards Engaging Human-Humanoid Interaction
Riley, M., & Atkeson, C. G. (2002) · Autonomous Robots · doi:10.1023/a:1013223328496 · Cited by 78 · see citing works
A tennis serve and upswing learning robot based on bi-directional theory
Miyamoto, H., & Kawato, M. (1998) · Neural Networks · doi:10.1016/s0893-6080(98)00062-8 · Cited by 71 · see citing works
Self-citationNeural learning of embodied interaction dynamics
Kuniyoshi, Y., & Luc Berthouze, A. (1998) · Neural Networks · doi:10.1016/s0893-6080(98)00085-9 · Cited by 60 · see citing works
From ‘Understanding the Brain by Creating the Brain’ towards manipulative neuroscience
Kawato, M. (2008) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2008.2272 · Cited by 58 · see citing works
Self-citationMachine learning of motor skills for robotics
Stefan Schaal, A., & Peters, J. (2007) · Cited by 55 · see citing works
Bayesian Nonparametric Reward Learning From Demonstration
Michini, B., Walsh, T. J., Agha–mohammadi, A., & How, J. P. (2015) · IEEE Transactions on Robotics · doi:10.1109/tro.2015.2405593 · Cited by 54 · see citing works
On-line periodic movement and force-profile learning for adaptation to new surfaces
Gams, A., Do, M., Ude, A., Asfour, T., & Dillmann, R. (2010) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/ichr.2010.5686306 · Cited by 47 · see citing works
A via-point time optimization algorithm for complex sequential trajectory formation
Wada, Y., & Kawato, M. (2004) · Neural Networks · doi:10.1016/j.neunet.2003.11.009 · Cited by 46 · see citing works
Self-citationWang, R., Wu, Y. J., Chan, W. L., & Tee, K. P. (2016) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2016.7759554 · Cited by 42 · see citing works
Reinforcement learning of a motor skill for wearing a T-shirt using topology coordinates
Matsubara, T., Shinohara, D., & Kidode, M. (2013) · Advanced Robotics · doi:10.1080/01691864.2013.777012 · Cited by 41 · see citing works
Learning, Generation and Recognition of Motions by Reference-Point-Dependent Probabilistic Models
Sugiura, K., Iwahashi, N., Kashioka, H., & Nakamura, S. (2011) · Advanced Robotics · doi:10.1163/016918611x563328 · Cited by 39 · see citing works
Reinforcement learning with via-point representation
Miyamoto, H., Morimoto, J., Doya, K., & Kawato, M. (2004) · Neural Networks · doi:10.1016/j.neunet.2003.11.004 · Cited by 37 · see citing works
Self-citationETL-Humanoid: A Research Vehicle for Open-Ended Action Imitation
Kuniyoshi, Y., Cheng, G., & Nagakubo, A. (2007) · Springer eBooks · doi:10.1007/3-540-36460-9_5 · Cited by 35 · see citing works
Simultaneously learning actions and goals from demonstration
Akgün, B., & Thomaz, A. L. (2015) · Autonomous Robots · doi:10.1007/s10514-015-9448-x · Cited by 35 · see citing works
A framework for learning from demonstration, generalization and practice in human-robot domains
Matarić, M. J., & Nicolescu, M. N. (2003) · Cited by 34 · see citing works
Nonlinear dynamical systems for imitation with humanoid robots
Ijspeert, A. J., Nakanishi, J., Shibata, T., & Stefan Schaal, A. (2001) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 33 · see citing works
Improvements on action parsing and action interpolation for learning through demonstration
Lieberman, J., & Breazeal, C. (2005) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/ichr.2004.1442131 · Cited by 31 · see citing works
A framework for learning biped locomotion with dynamical movement primitives
Nakanishi, J., Morimoto, J., Endo, G., Cheng, G., Stefan Schaal, A., & Kawato, M. (2005) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/ichr.2004.1442695 · Cited by 29 · see citing works
Self-citationOptimized IoT Service Chain Implementation in Edge Cloud Platform: A Deep Learning Framework
Pham, C., Nguyen, D. T., Tran, N. H. K., Nguyen, K. K., & Cheriet, M. (2021) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2021.3049824 · Cited by 30 · see citing works
Sun, X., Li, J., Kovalenko, A. V., Feng, W., & Ou, Y. (2022) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2022.3185071 · Cited by 29 · see citing works
Casting Manipulation—Midair Control of a Gripper by Impulsive Force
Arisumi, H., Yokoi, K., & Komoriya, K. (2008) · IEEE Transactions on Robotics · doi:10.1109/tro.2008.918055 · Cited by 28 · see citing works
Dynamic Trajectory Generation and a Robust Controller to Intercept a Moving Ball in a Game Setting
Prakash, R., Behera, L., Mohan, S., & Jagannathan, S. (2019) · IEEE Transactions on Control Systems Technology · doi:10.1109/tcst.2019.2913129 · Cited by 27 · see citing works
Generalization of example movements with dynamic systems
Gams, A., & Ude, A. (2009) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/ichr.2009.5379607 · Cited by 27 · see citing works
Park, W., Chaffin, D. B., Martin, B. J., & Faraway, J. J. (2004) · Journal of Biomechanics · doi:10.1016/j.jbiomech.2004.09.035 · Cited by 23 · see citing works
Learning of a ball-in-a-cup playing robot
Nemec, B., Zorko, M., & Žlajpah, L. (2010) · International Workshop on Robotics in Alpe-Adria-Danube Region (RAAD) · doi:10.1109/raad.2010.5524570 · Cited by 23 · see citing works
Reinforcement Learning for Parameterized Motor Primitives
Peters, J., & Stefan Schaal, A. (2006) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2006.246662 · Cited by 23 · see citing works
Using Bayesian Dynamical Systems for Motion Template Libraries
Chiappa, S., Kober, J., & Peters, J. (2008) · Max Planck Institute for Plasma Physics · Cited by 23 · see citing works
Peters, J., Lee, D. D., Kober, J., Nguyen-Tuong, D., Bagnell, J. A., & Stefan Schaal, A. (2016) · Springer handbooks · doi:10.1007/978-3-319-32552-1_15 · Cited by 23 · see citing works
Visually guided movements: learning with modular neural maps in robotics
Buessler, J.-L., & Urban, J.-P. (1998) · Neural Networks · doi:10.1016/s0893-6080(98)00050-1 · Cited by 22 · see citing works
Kadi, H. A., & Terzić, K. (2023) · Sensors · doi:10.3390/s23052389 · Cited by 19 · see citing works
“Tamei et al. (2011) [1] adopt an RL framework [318] to tuck a mannequin’s head into a T-shirt’s hem and its arm into T-shirt sleeves using dual arms; they initialise the “via-points” with demonstration trajectory and refine the trajectory using the policy gradient method [319].”
MethodSafe reinforcement learning in high-risk tasks through policy improvement
García, J., & Rebollo, F. F. (2011) · IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning · doi:10.1109/adprl.2011.5967356 · Cited by 19 · see citing works
Speed adaptation for self-improvement of skills learned from user demonstrations
Vuga, R., Nemec, B., & Ude, A. (2015) · Robotica · doi:10.1017/s0263574715000405 · Cited by 19 · see citing works
Giorgio Metta, B., Sandini, G., Natale, L., & Panerai, F. (2001) · Cited by 19 · see citing works
Yamasaki, T., Gotoh, K., & Xin, X. (2010) · Human Movement Science · doi:10.1016/j.humov.2009.11.007 · Cited by 18 · see citing works
Novel Interaction Strategies for Learning from Teleoperation.
Akgün, B., Subramanian, K. A., & Thomaz, A. L. (2012) · National Conference on Artificial Intelligence · Cited by 18 · see citing works
Exploiting previous experience to constrain robot sensorimotor learning
Nemec, B., Vuga, R., & Ude, A. (2011) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/humanoids.2011.6100913 · Cited by 17 · see citing works
Robotics as a Tool for Neuroscience: Cerebellar Internal Models for Robotics and Cognition
Kawato, M. (2000) · Springer eBooks · doi:10.1007/978-1-4471-0765-1_39 · Cited by 17 · see citing works
Self-citationSynthesizing goal-directed actions from a library of example movements
Ude, A., Riley, M., Nemec, B., Kos, A., Asfour, T., & Cheng, G. (2007) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/ichr.2007.4813857 · Cited by 16 · see citing works
Whole-Body Motion Planning for Humanoid Robots by Specifying Via-Points
Sung, C., Kagawa, T., & Uno, Y. (2013) · International Journal of Advanced Robotic Systems · doi:10.5772/56747 · Cited by 15 · see citing works
Sensorimotor Interaction in a Developing Robot
Giorgio Metta, B., Sandini, G., Natale, L., & Panerai, F. (2001) · Cited by 15 · see citing works
Imitation and Reinforcement Learning for Motor Primitives with Perceptual Coupling
Kober, J., Mohler, B. J., & Peters, J. (2009) · Studies in computational intelligence · doi:10.1007/978-3-642-05181-4_10 · Cited by 14 · see citing works
Learning to exploit dynamics for robot motor coordination
Rosenstein, M. T., & Barto, A. G. (2003) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 14 · see citing works
Vollmer, A.-L., & Hemion, N. (2018) · Frontiers in Robotics and AI · doi:10.3389/frobt.2018.00077 · Cited by 12 · see citing works
Kendama game by casting manipulator
Arisumi, H., Yokoi, K., & Komoriya, K. (2005) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2005.1544972 · Cited by 12 · see citing works
Kawato, M. (2008) · HFSP journal · doi:10.2976/1.2931144 · Cited by 12 · see citing works
Self-citationLearning from Examples: Imitation Learning and Emerging Cognition
Kuniyoshi, Y. (2014) · Frontiers in neuroengineering series/Frontiers in neuroengineering · doi:10.1201/b17949-13 · Cited by 11 · see citing works
Motion recognition and generation by combining reference-point-dependent probabilistic models
Sugiura, K., & Iwahashi, N. (2008) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2008.4651169 · Cited by 11 · see citing works
Neural Networks Organizations to Learn Complex Robotic Functions
Hermann, G., Wira, P., & Urban, J.-P. (2003) · Cited by 11 · see citing works
Hierarchical Rule-Base Reduction-Based ANFIS With Online Optimization Through DDPG
Juston, M., Dekhterman, S. R., Norris, W. R., Nottage, D. S., & Soylemezoglu, A. (2024) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2024.3449147 · Cited by 10 · see citing works
Creating the brain and interacting with the brain: an integrated approach to understanding the brain
Morimoto, J., & Kawato, M. (2015) · Journal of The Royal Society Interface · doi:10.1098/rsif.2014.1250 · Cited by 10 · see citing works
Self-citationDirecting Policy Search with Interactively Taught Via-Points
Schroecker, Y., Amor, H. B., & Thomaz, A. L. (2016) · Adaptive Agents and Multi-Agents Systems · doi:10.5555/2936924.2937078 · Cited by 10 · see citing works
A learning and dynamic pattern generating architecture for skilful robotic baseball batting system
Zheng, X.-Z., Inamura, W., Shibata, K., & Ito, K. (2002) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2000.845160 · Cited by 10 · see citing works
Subjective Robot Imitation by Finding Invariance
吉川, 雄. (2005) · Cited by 10 · see citing works
A reinforcement learning scheme for acquisition of via-point representation of human motion
Wada, Y., & Sumita, K. (2005) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2004.1380089 · Cited by 9 · see citing works
Self-citation
- Authors
- Miyamoto, H., Schaal, S., Gandolfo, F., Gomi, H., Koike, Y., Osu, R., Nakano, E., Wada, Y., & Kawato, M.
- Affiliations
- Massachusetts Institute of Technology (US)
- NTT (Japan) (JP)
- Toyota Motor Corporation (Japan) (JP)
- Kyoto University (JP)
- Kobe University (JP)
- Corresponding author
- Miyamoto, Hiroyuki
- Venue
- Neural Networks
- Publisher
- Elsevier BV
- Published
- 1996-11
- Volume
- 9
- Issue
- 8
- Pages
- 1281-1302
- ISSN
- 0893-6080 (ISSN-L)
- OpenAlex
- W1975318316
- Cited by
- 171
- References
- 39
- Citations by year
- 2026: 1 · 2024: 3 · 2023: 2 · 2022: 3 · 2021: 5 · 2020: 3 · 2019: 4 · 2018: 4 · 2017: 1 · 2016: 4 · 2015: 7 · 2014: 3 · 2013: 5 · 2012: 10
- FWCI
- 2.99
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Neural Networks (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Motor Control and Adaptation
- Physical Sciences › Engineering › Control and Systems Engineering › Human Motion and Animation
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Keywords
- sensorimotor integration, motion capture, trajectory reconstruction, robot learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review