The DOI matches its Crossref record; 214 of the 214 references it cites were found in a registry or an index.
An Algorithmic Perspective on Imitation Learning
Open accessAbstract
As robots and other intelligent agents move from simple environments and problems to more complex, unstructured settings, manually programming their behavior has become increasingly challenging and expensive. Often, it is easier for a teacher to demonstrate a desired behavior rather than attempt to manually engineer it. This process of learning from demonstrations, and the study of algorithms to do so, is called imitation learning. An Algorithmic Perspective on Imitation Learning provides the reader with an introduction to imitation learning. It covers the underlying assumptions, approaches, and how they relate; the rich set of algorithms developed to tackle the problem; and advice on effective tools and implementation. An Algorithmic Perspective on Imitation Learning serves two audiences. First, it familiarizes machine learning experts with the challenges of imitation learning, particularly those arising in robotics, and the interesting theoretical and practical distinctions between it and more familiar frameworks like statistical supervised learning theory and reinforcement learning. Second, it provides roboticists and experts in applied artificial intelligence with a broader appreciation for the frameworks and tools available for imitation learning. It pays particular attention to the intimate connection between imitation learning approaches and those of structured prediction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
(2014) · Cited by 33,419
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Wu, Y. (1999) · Technometrics · doi:10.1080/00401706.1999.10485951 · Cited by 27,221
On Information and Sufficiency
Kullback, S., & Leibler, R. A. (1951) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729694 · Cited by 20,193
Labaca-Castro, R. (2023) · Machine Learning under Malware Attack · doi:10.1007/978-3-658-40442-0_9 · Cited by 19,272
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
Lafferty, J., McCallum, A., & Pereira, F. C. N. (2001) · ScholarlyCommons (University of Pennsylvania) · Cited by 12,935
Information theory and statistical mechanics
Jaynes, E. T. (1957) · Physical Review · doi:10.1103/physrev.106.620 · Cited by 12,931
Pattern Recognition and Machine Learning
(2006) · doi:10.1007/978-0-387-45528-0 · Cited by 9,824
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
Finn, C., Abbeel, P., & Levine, S. (2017) · arXiv · doi:10.48550/arxiv.1703.03400 · Cited by 8,512
Self-citationDynamic Programming Algorithm Optimization for Spoken Word Recognition
Sakoe, H., & Chiba, S. (1978) · IEEE Transactions on Acoustics Speech and Signal Processing · doi:10.1109/tassp.1978.1163055 · Cited by 6,727
(2017) · International Conference on Machine Learning · Cited by 6,382
Adaptive Mixtures of Local Experts
Jacobs, R. A., Jordan, M. I., Nowlan, S. J., & Hinton, G. E. (1991) · Neural Computation · doi:10.1162/neco.1991.3.1.79 · Cited by 5,384
Deep visual-semantic alignments for generating image descriptions
Karpathy, A., & Fei-Fei, L. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298932 · Cited by 4,902
Training Products of Experts by Minimizing Contrastive Divergence
Hinton, G. E. (2002) · Neural Computation · doi:10.1162/089976602760128018 · Cited by 4,879
Trust region policy optimization
Schulman, J., Levine, S., Moritz, P., Jordan, M. I., & Abbeel, P. (2015) · arXiv · doi:10.48550/arxiv.1502.05477 · Cited by 4,578
Self-citationA survey of robot learning from demonstration
Argall, B. D., Chernova, S., Veloso, M., & Browning, B. (2009) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2008.10.024 · Cited by 3,227
Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning
Sutton, R. S., Precup, D., & Singh, S. (1999) · Artificial Intelligence · doi:10.1016/s0004-3702(99)00052-1 · Cited by 3,119
Understanding Machine Learning: From Theory to Algorithms
Shalev-Shwartz, S., & Ben-David, S. (2014) · doi:10.1017/cbo9781107298019 · Cited by 3,115
(2015) · Cited by 2,857
Optimal Control: Linear Quadratic Methods
Anderson, B. D. O., & Moore, J. B. (1979) · Cited by 2,823
Apprenticeship learning via inverse reinforcement learning
Abbeel, P., & Ng, A. Y. (2004) · Twenty-first international conference on Machine learning - ICML '04 · doi:10.1145/1015330.1015430 · Cited by 2,769
Self-citationLarge Margin Methods for Structured and Interdependent Output Variables
Tsochantaridis, I., Joachims, T., Hofmann, T., & Altün, Y. (2005) · Journal of Machine Learning Research · doi:10.5555/1046920.1088722 · Cited by 2,225
Generative adversarial imitation learning
Ho, J., & Ermon, S. (2016) · arXiv · doi:10.48550/arxiv.1606.03476 · Cited by 1,942
A Reduction of Imitation Learning and Structured Prediction to No-Regret Online Learning
Ross, S., Gordon, G. J., & Bagnell, J. A. (2018) · Carnegie Mellon University · doi:10.1184/r1/6550949 · Cited by 1,941
Self-citationMaximum Entropy Inverse Reinforcement Learning
Ziebart, B. D., Maas, A. L., Bagnell, J. A., & Dey, A. K. (2018) · doi:10.1184/r1/6555512 · Cited by 1,869
Self-citationA Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition
RABINER, L. R. (1990) · Readings in Speech Recognition · doi:10.1016/b978-0-08-051584-7.50027-9 · Cited by 1,869
Temporal difference learning and TD-Gammon
Tesauro, G. (1995) · Communications of the ACM · doi:10.1145/203330.203343 · Cited by 1,618
Dynamical Movement Primitives: Learning Attractor Models for Motor Behaviors
Ijspeert, A. J., Nakanishi, J., Hoffmann, H., Pastor, P., & Schaal, S. (2013) · Neural Computation · doi:10.1162/neco_a_00393 · Cited by 1,598
A new point matching algorithm for non-rigid registration
Chui, H., & Rangarajan, A. (2003) · Computer Vision and Image Understanding · doi:10.1016/s1077-3142(03)00009-2 · Cited by 1,560
End-to-End Training of Deep Visuomotor Policies
Levine, S., Finn, C., Darrell, T. J., & Abbeel, P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.00702 · Cited by 1,344
Self-citationALVINN, an autonomous land vehicle in a neural network
Pomerleau, D. (2018) · doi:10.1184/r1/6603146 · Cited by 1,338
Is imitation learning the route to humanoid robots?
Schaal, S. (1999) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(99)01327-3 · Cited by 1,314
f-GAN: Training Generative Neural Samplers using Variational Divergence Minimization
Nowozin, S., Cseke, B., & Tomioka, R. (2016) · arXiv · doi:10.48550/arxiv.1606.00709 · Cited by 1,183
Information Geometry and Its Applications
Amari, S.-I. (2016) · Applied Mathematical Sciences · doi:10.1007/978-4-431-55978-8 · Cited by 1,138
PILCO: A Model-Based and Data-Efficient Approach to Policy Search
Deisenroth, M. P., & Rasmussen, C. E. (2011) · Cambridge University Engineering Department Publications Database · Cited by 1,136
On Learning, Representing, and Generalizing a Task in a Humanoid Robot
Calinon, S., Guenter, F., & Billard, A. (2007) · IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2006.886952 · Cited by 1,090
When Is a Linear Control System Optimal?
Kalman, R. E. (1964) · Journal of Basic Engineering · doi:10.1115/1.3653115 · Cited by 1,071
Algorithms for Reinforcement Learning
Szepesvári, C. (2010) · Synthesis Lectures on Artificial Intelligence and Machine Learning · doi:10.1007/978-3-031-01551-9 · Cited by 1,049
Action understanding as inverse planning
Baker, C. L., Saxe, R., & Tenenbaum, J. B. (2009) · Cognition · doi:10.1016/j.cognition.2009.07.005 · Cited by 920
Semantically Conditioned LSTM-based Natural Language Generation for Spoken Dialogue Systems
Wen, T.-H., Gasic, M., Mrkšić, N., Su, P.-H., Vandyke, D., & Young, S. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1199 · Cited by 874
Movement imitation with nonlinear dynamical systems in humanoid robots
Ijspeert, A. J., Nakanishi, J., & Schaal, S. (2003) · Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292) · doi:10.1109/robot.2002.1014739 · Cited by 840
A Survey on Policy Search for Robotics
Deisenroth, M. P. (2011) · Foundations and Trends in Robotics · doi:10.1561/2300000021 · Cited by 798
Learning Stable Nonlinear Dynamical Systems With Gaussian Mixture Models
Khansari-Zadeh, S. M., & Billard, A. (2011) · IEEE Transactions on Robotics · doi:10.1109/tro.2011.2159412 · Cited by 771
CHOMP: Covariant Hamiltonian optimization for motion planning
Zucker, M., Ratliff, N., Dragan, A. D., Pivtoraiko, M., Klingensmith, M., Dellin, C. M., Bagnell, J. A., & Srinivasa, S. S. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913488805 · Cited by 758
Self-citationIntroduction to Online Convex Optimization
Hazan, E. (2016) · Foundations and Trends in Optimization · doi:10.1561/2400000013 · Cited by 747
Synthesis and stabilization of complex behaviors through online trajectory optimization
Tassa, Y., Erez, T., & Todorov, E. (2012) · 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2012.6386025 · Cited by 744
Yu, S.-Z. (2010) · Artificial Intelligence · doi:10.1016/j.artint.2009.11.011 · Cited by 734
MOSAIC Model for Sensorimotor Learning and Control
Haruno, M., Wolpert, D. M., & Kawato, M. (2001) · Neural Computation · doi:10.1162/089976601750541778 · Cited by 709
Learning and generalization of motor skills by learning from demonstration
Pastor, P., Hoffmann, H., Asfour, T., & Schaal, S. (2009) · 2009 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2009.5152385 · Cited by 702
Cost-sensitive learning by cost-proportionate example weighting
Zadrozny, B., Langford, J., & Abe, N. (2004) · Third IEEE International Conference on Data Mining · doi:10.1109/icdm.2003.1250950 · Cited by 680
Kuniyoshi, Y., Inaba, M., & Inoue, H. (1994) · IEEE Transactions on Robotics and Automation · doi:10.1109/70.338535 · Cited by 676
Gaussian Processes for Data-Efficient Learning in Robotics and Control
Deisenroth, M. P., Fox, D., & Rasmussen, C. E. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.218 · Cited by 659
A Recurrent Latent Variable Model for Sequential Data
Chung, J., Kastner, K., Dinh, L., Goel, K., Courville, A. C., & Bengio, Y. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.02216 · Cited by 635
Todorov, E., & Li, W. (2005) · Proceedings of the 2005, American Control Conference, 2005. · doi:10.1109/acc.2005.1469949 · Cited by 611
Ratliff, N. D., Bagnell, J. A., & Zinkevich, M. A. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143936 · Cited by 606
Self-citationAutonomous Helicopter Aerobatics through Apprenticeship Learning
Abbeel, P., Coates, A., & Ng, A. Y. (2010) · The International Journal of Robotics Research · doi:10.1177/0278364910371999 · Cited by 584
Self-citationLearning Attractor Landscapes for Learning Motor Primitives
Ijspeert, A. J., Nakanishi, J., Stefan Schaal, A., Becker, S., Thrun, S., & Obermayer, K. (2002) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 572
Guided Cost Learning: Deep Inverse Optimal Control via Policy Optimization
Finn, C., Levine, S., & Abbeel, P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.00448 · Cited by 549
Self-citationLocally Weighted Learning for Control
Atkeson, C. G., Moore, A. W., & Schaal, S. (1997) · Artificial Intelligence Review · doi:10.1023/a:1006511328852 · Cited by 527
Incremental Online Learning in High Dimensions
Vijayakumar, S., D'Souza, A., & Schaal, S. (2005) · Neural Computation · doi:10.1162/089976605774320557 · Cited by 527
Constructive Incremental Learning from Only Local Information
Schaal, S., & Atkeson, C. G. (1998) · Neural Computation · doi:10.1162/089976698300016963 · Cited by 517
Model learning for robot control: A survey
Nguyen-Tuong, D., & Peters, J. (2011) · Cognitive Processing · doi:10.1007/s10339-011-0404-1 · Cited by 503
Self-citation(2013) · Lincoln Repository (University of Lincoln) · Cited by 503
Search-based structured prediction
Daumé, H., Langford, J., & Marcu, D. (2009) · Machine Learning · doi:10.1007/s10994-009-5106-x · Cited by 465
Learning and Reproduction of Gestures by Imitation
Calinon, S., D'halluin, F., Sauser, E., Caldwell, D., & Billard, A. (2010) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2010.936947 · Cited by 463
(2005) · neural information processing systems · Cited by 446
Bayesian Inverse Reinforcement Learning
(2025) · Partially Observed Markov Decision Processes · doi:10.1017/9781009449441.027 · Cited by 444
A tutorial on task-parameterized movement learning and retrieval
Calinon, S. (2016) · Intelligent Service Robotics · doi:10.1007/s11370-015-0187-9 · Cited by 422
Action-Conditional Video Prediction using Deep Networks in Atari Games
Oh, J., Guo, X., Lee, H., Lewis, R. L., & Singh, S. P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1507.08750 · Cited by 419
Cooperative Inverse Reinforcement Learning
Hadfield-Menell, D., Dragan, A., Abbeel, P., & Russell, S. (2016) · arXiv · doi:10.48550/arxiv.1606.03137 · Cited by 413
Self-citationLearning monocular reactive UAV control in cluttered natural environments
Ross, S., Melik-Barkhudarov, N., Shankar, K. S., Wendel, A., Dey, D., Bagnell, J. A., & Hebert, M. (2013) · 2013 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2013.6630809 · Cited by 403
Self-citationLearning to select and generalize striking movements in robot table tennis
Mülling, K., Kober, J., Kroemer, O., & Peters, J. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364912472380 · Cited by 396
Self-citationLearning Neural Network Policies with Guided Policy Search under Unknown Dynamics
Levine, S., & Abbeel, P. (2014) · Cited by 389
Self-citationModeling Purposeful Adaptive Behavior with the Principle of Maximum Causal Entropy
Ziebart, B. D. (2010) · doi:10.1184/r1/6720692 · Cited by 380
Efficient Reductions for Imitation Learning
Ross, S., & Bagnell, D. (2018) · doi:10.1184/r1/6554699 · Cited by 365
A framework for behavioural cloning
Bain, M., & Sammut, C. (2000) · Machine Intelligence 15 · doi:10.1093/oso/9780198538677.003.0006 · Cited by 360
Basics of Applied Stochastic Processes
Serfozo, R. (2009) · Probability and Its Applications · doi:10.1007/978-3-540-89332-5 · Cited by 344
Schaal, S., Peters, J., Nakanishi, J., & Ijspeert, A. (2005) · Springer Tracts in Advanced Robotics · doi:10.1007/11008941_60 · Cited by 343
Self-citationOne-Shot Visual Imitation Learning via Meta-Learning
Finn, C., Yu, T., Zhang, T., Abbeel, P., & Levine, S. (2017) · arXiv · doi:10.48550/arxiv.1709.04905 · Cited by 341
Self-citationIncremental learning of gestures by imitation in a humanoid robot
Calinon, S., & Billard, A. (2007) · Proceedings of the ACM/IEEE international conference on Human-robot interaction · doi:10.1145/1228716.1228751 · Cited by 333
Embodied Symbol Emergence Based on Mimesis Theory
Inamura, T., Toshima, I., Tanie, H., & Nakamura, Y. (2004) · The International Journal of Robotics Research · doi:10.1177/0278364904042199 · Cited by 326
On-Line Inference for Multiple Changepoint Problems
Fearnhead, P., & Liu, Z. (2007) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2007.00601.x · Cited by 307
Learning agents for uncertain environments (extended abstract)
Russell, S. (1998) · Proceedings of the eleventh annual conference on Computational learning theory · doi:10.1145/279943.279964 · Cited by 297
(2000) · Cited by 296
Robot learning from demonstration by constructing skill trees
Konidaris, G., Kuindersma, S., Grupen, R., & Barto, A. (2012) · The International Journal of Robotics Research · doi:10.1177/0278364911428653 · Cited by 286
Hoffmann, H., Pastor, P., Park, D.-H., & Schaal, S. (2009) · 2009 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2009.5152423 · Cited by 283
Nonlinear regulator theory and an inverse optimal control problem
Moylan, P., & Anderson, B. (1973) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1973.1100365 · Cited by 283
Nonlinear Inverse Reinforcement Learning with Gaussian Processes
Levine, S., Popović, Z., & Koltun, V. (2011) · Cited by 280
Relative Entropy Inverse Reinforcement Learning
Boularias, A., Kober, J., & Peters, J. (2011) · Max Planck Digital Library · Cited by 279
Self-citationImitation from Observation: Learning to Imitate Behaviors from Raw Video via Context Translation
Liu, Y., Gupta, A., Abbeel, P., & Levine, S. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8462901 · Cited by 278
Self-citationA Hybrid Approach to Intricate Motion, Manipulation and Task Planning
Cambon, S., Alami, R., & Gravot, F. (2009) · The International Journal of Robotics Research · doi:10.1177/0278364908097884 · Cited by 256
Combining self-supervised learning and imitation for vision-based rope manipulation
Nair, A., Chen, D., Agrawal, P., Isola, P., Abbeel, P., Malik, J., & Levine, S. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989247 · Cited by 255
Self-citationvan den Berg, J., Miller, S., Duckworth, D., Hu, H., Wan, A., Fu, X.-Y., Goldberg, K., & Abbeel, P. (2010) · 2010 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2010.5509621 · Cited by 233
Self-citationReinforcement Learning in Robotics: A Survey
Kober, J., & Peters, J. (2012) · Adaptation, learning, and optimization · doi:10.1007/978-3-642-27645-3_18 · Cited by 229
Self-citationLearning for control from multiple demonstrations
Coates, A., Abbeel, P., & Ng, A. Y. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390175 · Cited by 228
Self-citationMohammad Khansari-Zadeh, S., & Billard, A. (2014) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2014.03.001 · Cited by 225
Model-Based Bayesian Exploration
Dearden, R., Friedman, N., & André, D. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.6690 · Cited by 221
Kim, S., Shukla, A., & Billard, A. (2014) · IEEE Transactions on Robotics · doi:10.1109/tro.2014.2316022 · Cited by 220
Learning motor primitives for robotics
Kober, J., & Peters, J. (2009) · 2009 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2009.5152577 · Cited by 220
Self-citationMaximum entropy autoregressive conditional heteroskedasticity model
Park, S. Y., & Bera, A. K. (2009) · Journal of Econometrics · doi:10.1016/j.jeconom.2008.12.014 · Cited by 218
Interactive Policy Learning through Confidence-Based Autonomy
Chernova, S., & Veloso, M. (2009) · Journal of Artificial Intelligence Research · doi:10.1613/jair.2584 · Cited by 218
Kulić, D., Takano, W., & Nakamura, Y. (2008) · The International Journal of Robotics Research · doi:10.1177/0278364908091153 · Cited by 213
Coupling Movement Primitives: Interaction With the Environment and Bimanual Tasks
Gams, A., Nemec, B., Ijspeert, A. J., & Ude, A. (2014) · IEEE Transactions on Robotics · doi:10.1109/tro.2014.2304775 · Cited by 210
Duan, Y., Andrychowicz, M., Stadie, B. C., Ho, J., Schneider, J., Sutskever, I., Abbeel, P., & Zaremba, W. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.07326 · Cited by 208
Self-citationRahmatizadeh, R., Abolghasemi, P., Boloni, L., & Levine, S. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8461076 · Cited by 205
Interaction primitives for human-robot cooperation tasks
Ben Amor, H., Neumann, G., Kamthe, S., Kroemer, O., & Peters, J. (2014) · 2014 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2014.6907265 · Cited by 200
Self-citationLearning to search: Functional gradient techniques for imitation learning
Ratliff, N. D., Silver, D., & Bagnell, J. A. (2009) · Autonomous Robots · doi:10.1007/s10514-009-9121-3 · Cited by 198
Self-citationImproving Multi-Step Prediction of Learned Time Series Models
Venkatraman, A., Hebert, M., & Bagnell, J. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9590 · Cited by 198
Self-citationThird-Person Imitation LearningPreprint
Stadie, B. C., Abbeel, P., & Sutskever, I. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.01703 · Cited by 197
Self-citationProbabilistic movement primitives for coordination of multiple human–robot collaborative tasks
Maeda, G. J., Neumann, G., Ewerton, M., Lioutikov, R., Kroemer, O., & Peters, J. (2017) · Autonomous Robots · doi:10.1007/s10514-016-9556-2 · Cited by 196
Self-citationLearning grounded finite-state representations from unstructured demonstrations
Niekum, S., Osentoski, S., Konidaris, G., Chitta, S., Marthi, B., & Barto, A. G. (2015) · The International Journal of Robotics Research · doi:10.1177/0278364914554471 · Cited by 187
Finn, C., Christiano, P. F., Abbeel, P., & Levine, S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.03852 · Cited by 185
Self-citationLearning to Search Better Than Your TeacherPreprint
Chang, K.-W., Krishnamurthy, A., Agarwal, A., Daumé, H., & Langford, J. C. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1502.02206 · Cited by 176
A Kendama Learning Robot Based on Bi-directional Theory
Miyamoto, H., Schaal, S., Gandolfo, F., Gomi, H., Koike, Y., Osu, R., Nakano, E., Wada, Y., & Kawato, M. (1996) · Neural Networks · doi:10.1016/s0893-6080(96)00043-3 · Cited by 171
Incremental kinesthetic teaching of motion primitives using the motion refinement tube
Lee, D., & Ott, C. (2011) · Autonomous Robots · doi:10.1007/s10514-011-9234-3 · Cited by 167
Introduction to Statistical Machine Learning
杉山, 将. (2016) · Elsevier eBooks · doi:10.1016/c2014-0-01992-2 · Cited by 164
Efficient Reinforcement Learning using Gaussian Processes
Deisenroth, M. P. (2010) · Repository KITopen (Karlsruhe Institute of Technology) · doi:10.5445/ksp/1000019799 · Cited by 163
Active Learning for Reward Estimation in Inverse Reinforcement Learning
Lopes, M. C., Melo, F. S., & Montesano, L. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-04174-7_3 · Cited by 162
Task-level planning of pick-and-place robot motions
Lozano-Perez, T., Jones, J. L., Mazer, E., & O'Donnell, P. A. (1989) · Computer · doi:10.1109/2.16222 · Cited by 161
Continuous Inverse Optimal Control with Locally Optimal Examples
Levine, S., & Koltun, V. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1206.4617 · Cited by 158
Nakaoka, S., Nakazawa, A., Kanehiro, F., Kaneko, K., Morisawa, M., Hirukawa, H., & Ikeuchi, K. (2007) · The International Journal of Robotics Research · doi:10.1177/0278364907079430 · Cited by 154
Learning force-based manipulation of deformable objects from multiple demonstrations
Lee, A. X., Lu, H., Gupta, A., Levine, S., & Abbeel, P. (2015) · 2015 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2015.7138997 · Cited by 140
Self-citationLearning objective functions for manipulation
Kalakrishnan, M., Pástor, P., Righetti, L., & Schaal, S. (2013) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2013.6630743 · Cited by 134
Learning from Demonstrations Through the Use of Non-rigid Registration
Schulman, J., Ho, J., Lee, C., & Abbeel, P. (2016) · Springer Tracts in Advanced Robotics · doi:10.1007/978-3-319-28872-7_20 · Cited by 133
Self-citationSharing Features among Dynamical Systems with Beta Processes
Fox, E. B., Sudderth, E. B., Jordan, M. I., & Willsky, A. S. (2010) · Cited by 132
Learning Non-linear Multivariate Dynamics of Motion in Robotic Manipulators
Gribovskaya, E., Khansari-Zadeh, S. M., & Billard, A. (2010) · The International Journal of Robotics Research · doi:10.1177/0278364910376251 · Cited by 129
Learning preferences for manipulation tasks from online coactive feedback
Jain, A., Sharma, S., Joachims, T., & Saxena, A. (2015) · The International Journal of Robotics Research · doi:10.1177/0278364915581193 · Cited by 127
Multi-task policy search for robotics
Deisenroth, M. P., Englert, P. A. J., Peters, J., & Fox, D. (2014) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2014.6907421 · Cited by 127
Self-citationStatistical Learning by Imitation of Competing Constraints in Joint Space and Task Space
Calinon, S., & Billard, A. (2009) · Advanced Robotics · doi:10.1163/016918609x12529294461843 · Cited by 125
Hierarchical Apprenticeship Learning with Application to Quadruped Locomotion
Kolter, J. Z., Abbeel, P., & Ng, A. Y. (2007) · Cited by 122
Self-citationBoosting Structured Prediction for Imitation Learning
Ratliff, N., Bradley, D., Bagnell, J. A., & Chestnutt, J. E. (2018) · Figshare · doi:10.1184/r1/6552212 · Cited by 122
Self-citationUnsupervised Perceptual Rewards for Imitation Learning
Sermanet, P., Xu, K., & Levine, S. (2017) · Robotics: Science and Systems · doi:10.15607/rss.2017.xiii.050 · Cited by 121
Optimization and learning for rough terrain legged locomotion
Zucker, M., Ratliff, N., Stolle, M., Chestnutt, J. E., Bagnell, J. A., Atkeson, C. G., & Kuffner, J. (2011) · The International Journal of Robotics Research · doi:10.1177/0278364910392608 · Cited by 120
Self-citationInverse Optimal Control with Linearly-Solvable MDPs
Dvijotham, K., & Todorov, E. V. (2010) · Cited by 118
Efficiently combining task and motion planning using geometric constraints
Lagriffoul, F., Dimitrov, D., Bidot, J., Saffiotti, A., & Karlsson, L. (2014) · The International Journal of Robotics Research · doi:10.1177/0278364914545811 · Cited by 117
Towards learning hierarchical skills for multi-phase manipulation tasks
Kroemer, O., Daniel, C., Neumann, G. M., van Hoof, H., & Peters, J. (2015) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2015.7139389 · Cited by 109
Self-citationOnline Trajectory Planning and Force Control for Automation of Surgical Tasks
Osa, T., Sugita, N., & Mitsuishi, M. (2017) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2017.2676018 · Cited by 107
Self-citationEnd-to-End Differentiable Adversarial Imitation Learning
Baram, N., Anschel, O., Caspi, I., & Mannor, S. (2017) · International Conference on Machine Learning · Cited by 107
Robot Learning from Demonstration: A Task-level Planning Approach
Ekvall, S., & Kragić, D. (2008) · International Journal of Advanced Robotic Systems · doi:10.5772/5611 · Cited by 105
Learning Compliant Movement Primitives Through Demonstration and Statistical Generalization
Deniša, M., Gams, A., Ude, A., & Petrič, T. (2015) · IEEE/ASME Transactions on Mechatronics · doi:10.1109/tmech.2015.2510165 · Cited by 99
Learning multiple collaborative tasks with a mixture of Interaction Primitives
Ewerton, M., Neumann, G. M., Lioutikov, R., Amor, H. B., Peters, J., & Maeda, G. J. (2015) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2015.7139393 · Cited by 96
Self-citationRobot learning by demonstration
Billard, A., & Grollman, D. H. (2013) · Scholarpedia · doi:10.4249/scholarpedia.3824 · Cited by 96
Computer animation: algorithms and techniques
(2002) · Choice Reviews Online · doi:10.5860/choice.39-4013 · Cited by 96
Dynamic Imitation in a Humanoid Robot through Nonparametric Probabilistic Inference
Grimes, D. B., Chalodhorn, R., & Rao, R. P. N. (2006) · Robotics: Science and Systems · doi:10.15607/rss.2006.ii.026 · Cited by 95
Mimetic Communication Model with Compliant Physical Contact in Human—Humanoid Interaction
Lee, D., Ott, C., & Nakamura, Y. (2010) · The International Journal of Robotics Research · doi:10.1177/0278364910364164 · Cited by 94
Learning perceptual coupling for motor primitives
Kober, J., Mohler, B. J., & Peters, J. (2008) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2008.4650953 · Cited by 85
Self-citationMulti-Agent Inverse Reinforcement Learning
Natarajan, S., Kunapuli, G., Judah, K., Tadepalli, P. V., Kersting, K., & SHAVLIK, J. W. (2010) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2010.65 · Cited by 83
Inverse Reinforcement Learning in Partially Observable Environments
Choi, J., & Kim, K.-E. (2009) · International Joint Conference on Artificial Intelligence · Cited by 81
Constructing Symbolic Representations for High-Level Planning
Konidaris, G., Kaelbling, L. P., & Lozano‐Pérez, T. (2014) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v28i1.9004 · Cited by 81
Model-based Bayesian reinforcement learning in partially observable domains
Poupart, P., & Vlassis, N. A. (2008) · Open Repository and Bibliography (University of Luxembourg) · Cited by 78
The Principle of Maximum Causal Entropy for Estimating Interacting Processes
Ziebart, B. D., Bagnell, J. A., & Dey, A. K. (2013) · IEEE Transactions on Information Theory · doi:10.1109/tit.2012.2234824 · Cited by 76
Self-citationExploiting Model Uncertainty Estimates for Safe Dynamic Control Learning
Schneider, J. (1996) · Cited by 75
Training parsers by inverse reinforcement learning
Neu, G., & Szepesvári, C. (2009) · Machine Learning · doi:10.1007/s10994-009-5110-1 · Cited by 72
A Dynamic HMM for On-line Segmentation of Sequential Data
Kohlmorgen, J., & Lemm, S. (2001) · Cited by 69
Infinite time horizon maximum causal entropy inverse reinforcement learning
Bloem, M. J., & Bambos, N. (2014) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2014.7040156 · Cited by 68
Bayesian Nonparametric Methods for Partially-Observable Reinforcement Learning
Doshi‐Velez, F., Pfau, D., Wood, F., & Roy, N. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.191 · Cited by 66
Learning movement primitive libraries through probabilistic segmentation
Lioutikov, R., Neumann, G. M., Maeda, G. J., & Peters, J. (2017) · The International Journal of Robotics Research · doi:10.1177/0278364917713116 · Cited by 66
Self-citationMovement primitives via optimization
Dragan, A. D., Muelling, K., Bagnell, J. A., & Srinivasa, S. S. (2015) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2015.7139510 · Cited by 64
Self-citationIncremental motion learning with locally modulated dynamical systems
Kronander, K., Khansari, M., & Billard, A. (2015) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2015.03.010 · Cited by 63
Lens, T., Kunz, J., von Stryk, O., Trommer, C. D.-I., & Karguth, A. D.-I. (2010) · Cited by 60
Learning in-contact control strategies from demonstration
Racca, M., Pajarinen, J., Montebelli, A., & Kyrki, V. (2016) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2016.7759127 · Cited by 60
Self-citationMAP Inference for Bayesian Inverse Reinforcement Learning
Choi, J., & Kim, K.-E. (2011) · Cited by 59
Learning Controllers for Reactive and Proactive Behaviors in Human–Robot Collaboration
Rozo, L. D., Silvério, J., Calinon, S., & Caldwell, D. G. (2016) · Frontiers in Robotics and AI · doi:10.3389/frobt.2016.00030 · Cited by 58
Guiding Trajectory Optimization by Demonstrated Distributions
Osa, T., E., A. M. G., Stolkin, R., Lioutikov, R., Peters, J., & Neumann, G. M. (2017) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2017.2653850 · Cited by 58
Self-citationProbabilistic model-based imitation learning
Englert, P. A. J., Paraschos, A., Deisenroth, M. P., & Peters, J. (2013) · Adaptive Behavior · doi:10.1177/1059712313491614 · Cited by 57
Self-citationDimensionality reduction for density ratio estimation in high-dimensional spaces
Sugiyama, M., Kawanabe, M., & Chui, P. L. (2009) · Neural Networks · doi:10.1016/j.neunet.2009.07.007 · Cited by 57
Learning movement primitive attractor goals and sequential skills from kinesthetic demonstrations
Manschitz, S., Kober, J., Gienger, M., & Peters, J. (2015) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2015.07.005 · Cited by 56
Self-citationLearning Autonomous Driving Styles and Maneuvers from Expert Demonstration
Silver, D., Bagnell, J. A., & Stentz, A. (2013) · Springer tracts in advanced robotics · doi:10.1007/978-3-319-00065-7_26 · Cited by 56
Self-citationCoupled dynamical system based arm–hand grasping model for learning fast adaptation strategies
Shukla, A., & Billard, A. (2012) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2011.07.023 · Cited by 55
Active learning from demonstration for robust autonomous navigation
Silver, D., Bagnell, J. A., & Stentz, A. (2012) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2012.6224757 · Cited by 52
Self-citationLearning to predict phases of manipulation tasks as hidden states
Kroemer, O., van Hoof, H., Neumann, G. M., & Peters, J. (2014) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2014.6907441 · Cited by 49
Self-citationOnline Trajectory Planning in Dynamic Environments for Surgical Task Automation
Osa, T., Sugita, N., & Mitsuishi, M. (2014) · Robotics: Science and Systems · doi:10.15607/rss.2014.x.011 · Cited by 48
Self-citationActive reward learning with a novel acquisition function
Daniel, C., Kroemer, O., Viering, M., Metz, J., & Peters, J. (2015) · Autonomous Robots · doi:10.1007/s10514-015-9454-z · Cited by 47
Self-citationMaximum Entropy Distribution Estimation with Generalized Regularization
Dudı́k, M., & Schapire, R. E. (2006) · Lecture notes in computer science · doi:10.1007/11776420_12 · Cited by 47
Takano, W., & Nakamura, Y. (2015) · The International Journal of Robotics Research · doi:10.1177/0278364915587923 · Cited by 46
Robot Learning with Task-Parameterized Generative Models
Calinon, S. (2017) · Springer proceedings in advanced robotics · doi:10.1007/978-3-319-60916-4_7 · Cited by 43
Active Incremental Learning of Robot Movement Primitives
(2017) · HAL · Cited by 42
Learning Nonparametric Models for Probabilistic Imitation
Grimes, D. B., Rashid, D. R., & Rao, R. P. N. (2007) · The MIT Press eBooks · doi:10.7551/mitpress/7503.003.0070 · Cited by 40
Open-source benchmarking for learned reaching motion generation in robotics
Lemme, A., Meirovitch, Y., Khansari-Zadeh, M. S. M., Flash, T., Billard, A., & Steil, J. J. (2015) · Paladyn Journal of Behavioral Robotics · doi:10.1515/pjbr-2015-0002 · Cited by 39
(2012) · Springer eBooks · doi:10.1007/978-1-4419-1428-6_4646 · Cited by 39
Reinforcement learning with limited reinforcement: Using Bayes risk for active learning in POMDPs
Doshi‐Velez, F., Pineau, J., & Roy, N. (2012) · Artificial Intelligence · doi:10.1016/j.artint.2012.04.006 · Cited by 38
Improved Learning of Dynamics Models for Control
Venkatraman, A., Capobianco, R., Pinto, L., Hebert, M., Nardi, D., & Bagnell, J. A. (2017) · Springer proceedings in advanced robotics · doi:10.1007/978-3-319-50115-4_61 · Cited by 35
Self-citationMimesis Model from Partial Observations for a Humanoid Robot
Lee, D., & Nakamura, Y. (2009) · The International Journal of Robotics Research · doi:10.1177/0278364909342282 · Cited by 34
Hierarchical Bayesian Inverse Reinforcement Learning
Choi, J., & Kim, K.-E. (2014) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2336867 · Cited by 34
Direct Loss Minimization Inverse Optimal Control
Doerr, A., Ratliff, N., Bohg, J., Toussaint, M., & Stefan Schaal, A. (2015) · Robotics: Science and Systems · doi:10.15607/rss.2015.xi.013 · Cited by 33
Supervisory teleoperation with online learning and optimal control
Havoutis, I., & Calinon, S. (2017) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2017.7989183 · Cited by 33
Inverse Game Theory: Learning Utilities in Succinct Games
Kuleshov, V., & Schrijvers, O. (2015) · Lecture notes in computer science · doi:10.1007/978-3-662-48995-6_30 · Cited by 31
Takano, W., & Nakamura, Y. (2015) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2015.09.021 · Cited by 30
Multi-Robot Inverse Reinforcement Learning under Occlusion with Interactions
Bogert, K., & Doshi, P. (2015) · Cited by 29
Encoding the time and space constraints of a task in explicit-duration Hidden Markov Model
Calinon, S., Pistillo, A., & Caldwell, D. G. (2011) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2011.6048064 · Cited by 29
Okamoto, T., Shiratori, T., Kudoh, S., Nakaoka, S., & Ikeuchi, K. (2014) · IEEE Transactions on Robotics · doi:10.1109/tro.2014.2300212 · Cited by 28
Bagnell, J. A., & Bradley, D. M. (2010) · Cited by 27
Self-citationHIRL: Hierarchical Inverse Reinforcement Learning for Long-Horizon Tasks with Delayed RewardsPreprint
Krishnan, S., Garg, A., Liaw, R., Miller, L., Pokorny, F. T., & Goldberg, K. Y. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1604.06508 · Cited by 27
Learning from Demonstration for Autonomous Navigation in Complex Unstructured Terrain
Silver, D., Bagnell, J. A., & Stentz, A. (2010) · Defense Technical Information Center (DTIC) · doi:10.21236/ada525288 · Cited by 26
Self-citationMan-Machine Co-operation on a Learning Task
Chambers, R. A., & Michie, D. (1969) · Springer eBooks · doi:10.1007/978-1-4684-8586-8_18 · Cited by 25
Lukic, L., Santos-Victor, J., & Billard, A. (2014) · Biological Cybernetics · doi:10.1007/s00422-014-0591-9 · Cited by 23
Cited by
Synthetic Data for Deep Learning
Nikolenko, S. I. (2021) · Springer Optimization and Its Applications · doi:10.1007/978-3-030-75178-4 · Cited by 423
PRECOG: PREdiction Conditioned on Goals in Visual Multi-Agent Settings
Rhinehart, N., Mcallister, R., Kitani, K., & Levine, S. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00291 · Cited by 345
Smart industrial robot control trends, challenges and opportunities within manufacturing
Arents, J., & Greitans, M. (2022) · Applied Sciences · doi:10.3390/app12020937 · Cited by 338
A Survey on Policy Search Algorithms for Learning Robot Controllers in a Handful of Trials
Chatzilygeroudis, K., Vassiliades, V., Stulp, F., Calinon, S., & Mouret, J.-B. (2020) · IEEE Transactions on Robotics · doi:10.1109/tro.2019.2958211 · Cited by 160
Florence, P., Lynch, C., Zeng, A., Ramirez, O., Wahid, A., Downs, L., Wong, A., Lee, J., Mordatch, I., & Tompson, J. (2021) · arXiv · doi:10.48550/arxiv.2109.00137 · Cited by 131
Metadata
- Authors
- Osa, T., Pajarinen, J., Neumann, G., Bagnell, J. A., Abbeel, P., & Peters, J.
- Venue
- now publishers, Inc. eBooks
- Publisher
- now Publishers Inc
- Published
- 2018
- OpenAlex
- W2794908222
- Cited by
- 368
- References
- 214
- FWCI
- 18.43
- Type
- book
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.