Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 752

The DOI matches its Crossref record; 192 of the 192 references it cites were found in a registry or an index.

Recent Advances in Robot Learning from Demonstration

Open access
Ravichandar, Harish, Polydoros, Athanasios S., Chernova, Sonia, Billard, Aude·2020·Annual Review of Control, Robotics, and Autonomous Systems

Abstract

In the context of robotics and automation, learning from demonstration (LfD) is the paradigm in which robots acquire new skills by learning to imitate an expert. The choice of LfD over other robot learning methods is compelling when ideal behavior can be neither easily scripted (as is done in traditional robot programming) nor easily defined as an optimization problem, but can be demonstrated. While there have been multiple surveys of this field in the past, there is a need for a new one given the considerable growth in the number of publications in recent years. This review aims to provide an overview of the collection of machine-learning methods used to enable a robot to learn from and imitate a teacher. We focus on recent advancements in the field and present an updated taxonomy and characterization of existing methods. We also discuss mature and emerging application areas for LfD and highlight the significant challenges that remain to be overcome both in theory and in practice.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1146/annurev-control-100819-063206

Cites

192 of 192 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 192 references

Research works printed but not linked: 30

  1. 10.1109/ROBOT.2003.1242017 · doi:10.1109/robot.2003.1242017
  2. Rosen E, Whitney D, Phillips E, Ullman D, Tellex S. 2018. Testing robot teleoperation using a virtual reality interface with ROS reality . Paper presented at the 1st International Workshop on Virtual, Augmented, and Mixed Reality for Human-Robot Interaction, Chicago, Mar. 5
  3. Whitney D, Rosen E, Tellex S. 2018. Learning from crowdsourced virtual reality demonstrations . Paper presented at the 1st International Workshop on Virtual, Augmented, and Mixed Reality for Human-Robot Interaction, Chicago, Mar. 5
  4. 10.1109/ICRA.2015.7139823 · doi:10.1109/icra.2015.7139823
  5. 10.1109/ICRA.2011.5979632 · doi:10.1109/icra.2011.5979632
  6. 10.1109/HRI.2019.8673287 · doi:10.1109/hri.2019.8673287
  7. 10.1145/3173386.3177066 · doi:10.1145/3173386.3177066
  8. 10.1109/ICRA.2018.8461012 · doi:10.1109/icra.2018.8461012
  9. Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, et al. 2014. Generative adversarial nets. In Advances in Neural Information Processing Systems 27 , ed. Z Ghahramani, M Welling, C Cortes, ND Lawrence, KQ Weinberger, pp. 2672–80. Red Hook, NY: Curran
  10. 10.1109/ICRA.2012.6225222 · doi:10.1109/icra.2012.6225222
  11. Paraschos A, Daniel C, Peters J, Neumann G. 2013. Probabilistic movement primitives. In Advances in Neural Information Processing Systems 26 , ed. CJC Burges, L Bottou, M Welling, Z Ghahramani, KQ Weinberger, pp. 2616–24. Red Hook, NY: Curran
  12. Rozo L, 2013, Proceedings of the Twenty-Seventh AAAI Conference on Artificial Intelligence, 1422
  13. 10.1109/IROS.2016.7759153 · doi:10.1109/iros.2016.7759153
  14. Dvijotham K, 2010, Proceedings of the Twenty-Seventh International Conference on Machine Learning, 335
  15. Levine S, Koltun V. 2012. Continuous inverse optimal control with locally optimal examples. arXiv:1206.4617 [cs.LG] · arXiv
  16. 10.1007/s10514-018-9757-y · doi:10.1007/s10514-018-9757-y
  17. 10.1109/ICRA.2018.8460190 · doi:10.1109/icra.2018.8460190
  18. 10.1109/HUMANOIDS.2015.7363584 · doi:10.1109/humanoids.2015.7363584
  19. 10.1109/IROS.2015.7353415 · doi:10.1109/iros.2015.7353415
  20. 10.1109/IROS.2010.5652268 · doi:10.1109/iros.2010.5652268
  21. Krishnan S, Garg A, Liaw R, Miller L, Pokorny FT, Goldberg K. 2016. HIRL: hierarchical inverse reinforcement learning for long-horizon tasks with delayed rewards. arXiv:1604.06508 [cs.RO] · arXiv
  22. Hirzinger G, Heindl J. 1983. Sensor programming, a new way for teaching a robot paths and forces torques simultaneously. In Proceedings of the 3rd International Conference on Robot Vision and Sensory Control , ed. B Rooks, pp. 549–58. Oxford, UK: Cotswold
  23. 10.1007/s41315-016-0006-2 · doi:10.1007/s41315-016-0006-2
  24. Meriçliç, Veloso M, 2010, Proceedings of the Twenty-Fourth AAAI Conference on Artificial Intelligence, 1594
  25. 10.1007/978-3-319-09584-4_25 · doi:10.1007/978-3-319-09584-4_25
  26. 10.1007/s10514-015-9502-8 · doi:10.1007/s10514-015-9502-8
  27. Sun W, Venkatraman A, Gordon GJ, Boots B, Bagnell JA. 2017. Deeply AggreVaTeD: differentiable imitation learning for sequential prediction. In Proceedings of the 34th International Conference on Machine Learning , ed. D Precup, YW Teh, pp. 3309–18. Proc. Mach. Learn. Res. Vol. 70. N.p.: PMLR
  28. Taylor ME, 2011, The 10th International Conference on Autonomous Agents and Multiagent Systems, 2, 617
  29. 10.1109/TASE.2016.2605707 · doi:10.1109/tase.2016.2605707
  30. Castro PS, Li S, Zhang D. 2019. Inverse reinforcement learning with multiple ranked experts. arXiv:1907.13411 [cs.LG] · arXiv

Cited by

See all 752

Metadata

Authors
Ravichandar, H., Polydoros, A. S., Chernova, S., & Billard, A.
Venue
Annual Review of Control, Robotics, and Autonomous Systems
Published
2020-05-03
Volume
3
Issue
1
Pages
297-330
ISSN
2573-5144 (ISSN-L)
OpenAlex
W2994446013
Cited by
752
References
192
FWCI
5.73
Type
journal article
Language
en
Open access
bronze

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Recent Advances in Robot Learning from Demonstration. https://app.cochat.ai/papers/10.1146/annurev-control-100819-063206
The paper
Ravichandar, H., Polydoros, A. S., Chernova, S., & Billard, A. (2020). Recent Advances in Robot Learning from Demonstration. Annual Review of Control, Robotics, and Autonomous Systems. https://doi.org/10.1146/annurev-control-100819-063206

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.