The DOI matches its Crossref record; 192 of the 192 references it cites were found in a registry or an index.
Recent Advances in Robot Learning from Demonstration
Open accessAbstract
In the context of robotics and automation, learning from demonstration (LfD) is the paradigm in which robots acquire new skills by learning to imitate an expert. The choice of LfD over other robot learning methods is compelling when ideal behavior can be neither easily scripted (as is done in traditional robot programming) nor easily defined as an optimization problem, but can be demonstrated. While there have been multiple surveys of this field in the past, there is a need for a new one given the considerable growth in the number of publications in recent years. This review aims to provide an overview of the collection of machine-learning methods used to enable a robot to learn from and imitate a teacher. We focus on recent advancements in the field and present an updated taxonomy and characterization of existing methods. We also discuss mature and emerging application areas for LfD and highlight the significant challenges that remain to be overcome both in theory and in practice.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
A survey of robot learning from demonstration
Argall, B. D., Chernova, S., Veloso, M., & Browning, B. (2009) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2008.10.024 · Cited by 3,227
Self-citationReinforcement learning in robotics: A survey
Kober, J., Bagnell, J. A., & Peters, J. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913495721 · Cited by 3,160
Apprenticeship learning via inverse reinforcement learning
Abbeel, P., & Ng, A. Y. (2004) · Twenty-first international conference on Machine learning - ICML '04 · doi:10.1145/1015330.1015430 · Cited by 2,769
Toward a Universal Law of Generalization for Psychological Science
Shepard, R. N. (1987) · Science · doi:10.1126/science.3629243 · Cited by 2,416
THE APPLICATION OF CLUSTER ANALYSIS IN STRATEGIC MANAGEMENT RESEARCH: AN ANALYSIS AND CRITIQUE
KETCHEN Jr., D. J., & SHOOK, C. L. (1996) · Strategic Management Journal · doi:10.1002/(sici)1097-0266(199606)17:6<441::aid-smj819>3.0.co;2-g · Cited by 2,375
Generative adversarial imitation learning
Ho, J., & Ermon, S. (2016) · arXiv · doi:10.48550/arxiv.1606.03476 · Cited by 1,942
A Reduction of Imitation Learning and Structured Prediction to No-Regret Online Learning
Ross, S., Gordon, G. J., & Bagnell, J. A. (2018) · Carnegie Mellon University · doi:10.1184/r1/6550949 · Cited by 1,941
(2000) · doi:10.2460/ajvr.67.2.323 · Cited by 1,621
Dynamical Movement Primitives: Learning Attractor Models for Motor Behaviors
Ijspeert, A. J., Nakanishi, J., Hoffmann, H., Pastor, P., & Schaal, S. (2013) · Neural Computation · doi:10.1162/neco_a_00393 · Cited by 1,598
Research works printed but not linked: 30
- 10.1109/ROBOT.2003.1242017 · doi:10.1109/robot.2003.1242017
- Rosen E, Whitney D, Phillips E, Ullman D, Tellex S. 2018. Testing robot teleoperation using a virtual reality interface with ROS reality . Paper presented at the 1st International Workshop on Virtual, Augmented, and Mixed Reality for Human-Robot Interaction, Chicago, Mar. 5
- Whitney D, Rosen E, Tellex S. 2018. Learning from crowdsourced virtual reality demonstrations . Paper presented at the 1st International Workshop on Virtual, Augmented, and Mixed Reality for Human-Robot Interaction, Chicago, Mar. 5
- 10.1109/ICRA.2015.7139823 · doi:10.1109/icra.2015.7139823
- 10.1109/ICRA.2011.5979632 · doi:10.1109/icra.2011.5979632
- 10.1109/HRI.2019.8673287 · doi:10.1109/hri.2019.8673287
- 10.1145/3173386.3177066 · doi:10.1145/3173386.3177066
- 10.1109/ICRA.2018.8461012 · doi:10.1109/icra.2018.8461012
- Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, et al. 2014. Generative adversarial nets. In Advances in Neural Information Processing Systems 27 , ed. Z Ghahramani, M Welling, C Cortes, ND Lawrence, KQ Weinberger, pp. 2672–80. Red Hook, NY: Curran
- 10.1109/ICRA.2012.6225222 · doi:10.1109/icra.2012.6225222
- Paraschos A, Daniel C, Peters J, Neumann G. 2013. Probabilistic movement primitives. In Advances in Neural Information Processing Systems 26 , ed. CJC Burges, L Bottou, M Welling, Z Ghahramani, KQ Weinberger, pp. 2616–24. Red Hook, NY: Curran
- Rozo L, 2013, Proceedings of the Twenty-Seventh AAAI Conference on Artificial Intelligence, 1422
- 10.1109/IROS.2016.7759153 · doi:10.1109/iros.2016.7759153
- Dvijotham K, 2010, Proceedings of the Twenty-Seventh International Conference on Machine Learning, 335
- Levine S, Koltun V. 2012. Continuous inverse optimal control with locally optimal examples. arXiv:1206.4617 [cs.LG] · arXiv
- 10.1007/s10514-018-9757-y · doi:10.1007/s10514-018-9757-y
- 10.1109/ICRA.2018.8460190 · doi:10.1109/icra.2018.8460190
- 10.1109/HUMANOIDS.2015.7363584 · doi:10.1109/humanoids.2015.7363584
- 10.1109/IROS.2015.7353415 · doi:10.1109/iros.2015.7353415
- 10.1109/IROS.2010.5652268 · doi:10.1109/iros.2010.5652268
- Krishnan S, Garg A, Liaw R, Miller L, Pokorny FT, Goldberg K. 2016. HIRL: hierarchical inverse reinforcement learning for long-horizon tasks with delayed rewards. arXiv:1604.06508 [cs.RO] · arXiv
- Hirzinger G, Heindl J. 1983. Sensor programming, a new way for teaching a robot paths and forces torques simultaneously. In Proceedings of the 3rd International Conference on Robot Vision and Sensory Control , ed. B Rooks, pp. 549–58. Oxford, UK: Cotswold
- 10.1007/s41315-016-0006-2 · doi:10.1007/s41315-016-0006-2
- Meriçliç, Veloso M, 2010, Proceedings of the Twenty-Fourth AAAI Conference on Artificial Intelligence, 1594
- 10.1007/978-3-319-09584-4_25 · doi:10.1007/978-3-319-09584-4_25
- 10.1007/s10514-015-9502-8 · doi:10.1007/s10514-015-9502-8
- Sun W, Venkatraman A, Gordon GJ, Boots B, Bagnell JA. 2017. Deeply AggreVaTeD: differentiable imitation learning for sequential prediction. In Proceedings of the 34th International Conference on Machine Learning , ed. D Precup, YW Teh, pp. 3309–18. Proc. Mach. Learn. Res. Vol. 70. N.p.: PMLR
- Taylor ME, 2011, The 10th International Conference on Autonomous Agents and Multiagent Systems, 2, 617
- 10.1109/TASE.2016.2605707 · doi:10.1109/tase.2016.2605707
- Castro PS, Li S, Zhang D. 2019. Inverse reinforcement learning with multiple ranked experts. arXiv:1907.13411 [cs.LG] · arXiv
Cited by
Safe Learning in Robotics: From Learning-Based Control to Safe Reinforcement Learning
Brunke, L., Greeff, M., Hall, A. W., Yuan, Z., Zhou, S., Panerati, J., & Schoellig, A. P. (2022) · Annual Review of Control, Robotics, and Autonomous Systems · doi:10.1146/annurev-control-042920-020211 · Cited by 769
Outlook on human-centric manufacturing towards Industry 5.0
Lu, Y., Zheng, H., Chand, S., Xia, W., Liu, Z., Xu, X., Wang, L., Qin, Z., & Bao, J. (2022) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2022.02.001 · Cited by 671
Diffusion policy: Visuomotor policy learning via action diffusion
Chi, C., Xu, Z., Feng, S., Cousineau, E., Du, Y., Burchfiel, B., Tedrake, R., & Song, S. (2025) · The International Journal of Robotics Research · doi:10.1177/02783649241273668 · Cited by 613
“Creating capable robots without requiring explicit programming of behaviors is a longstanding challenge in the field [3, 2, 38].”
BackgroundDiffusion Policy: Visuomotor Policy Learning via Action Diffusion
Chi, C., Feng, S., Du, Y., Xu, Z., Cousineau, E., Burchfiel, B., & Song, S. (2023) · Robotics: Science and Systems XIX · doi:10.15607/rss.2023.xix.026 · Cited by 530
Voyager: An Open-Ended Embodied Agent with Large Language Models
Wang, G., Xie, Y., Jiang, Y., Mandlekar, A., Xiao, C., Zhu, Y., Fan, L., & Anandkumar, A. (2023) · arXiv · doi:10.48550/arxiv.2305.16291 · Cited by 222
“[77] Harish Ravichandar, Athanasios S Polydoros, Sonia Chernova, and Aude Billard.”
Background
Metadata
- Authors
- Ravichandar, H., Polydoros, A. S., Chernova, S., & Billard, A.
- Venue
- Annual Review of Control, Robotics, and Autonomous Systems
- Publisher
- Annual Reviews
- Published
- 2020-05-03
- Volume
- 3
- Issue
- 1
- Pages
- 297-330
- ISSN
- 2573-5144 (ISSN-L)
- OpenAlex
- W2994446013
- Cited by
- 752
- References
- 192
- FWCI
- 5.73
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Recent Advances in Robot Learning from Demonstration. https://app.cochat.ai/papers/10.1146/annurev-control-100819-063206
- The paper
- Ravichandar, H., Polydoros, A. S., Chernova, S., & Billard, A. (2020). Recent Advances in Robot Learning from Demonstration. Annual Review of Control, Robotics, and Autonomous Systems. https://doi.org/10.1146/annurev-control-100819-063206
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.