Student or educator? Sign up with your school email and get 6 months of Pro free.

The DOI matches its Crossref record; 260 of the 260 references it cites were found in a registry or an index.

Reinforcement learning in robotics: A survey

Open access
Kober, Jens, Bagnell, J. Andrew, Peters, Jan·2013·The International Journal of Robotics Research

Abstract

Reinforcement learning offers to robotics a framework and set of tools for the design of sophisticated and hard-to-engineer behaviors. Conversely, the challenges of robotic problems provide both inspiration, impact, and validation for developments in reinforcement learning. The relationship between disciplines has sufficient promise to be likened to that between physics and mathematics. In this article, we attempt to strengthen the links between the two research communities by providing a survey of work in reinforcement learning for behavior generation in robots. We highlight both key challenges in robot reinforcement learning as well as notable successes. We discuss how contributions tamed the complexity of the domain and study the role of algorithms, representations, and prior knowledge in achieving these successes. As a result, a particular focus of our paper lies on the choice between model-based and model-free as well as between value-function-based and policy-search methods. By analyzing a simple problem in some detail we demonstrate how reinforcement learning approaches may be profitably applied, and we note throughout open questions and the tremendous potential for future research.

Overview

Integrity signals

Registry

Crossref · 10.1177/0278364913495721

Cites

260 of 260 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 260 references

Research works printed but not linked: 42

  1. Atkeson CG, 1994, Advances in Neural Information Processing Systems (NIPS)
  2. Atkeson CG, 1997, AI Review, 11, 75
  3. Atkeson CG, 1997, International Conference on Machine Learning (ICML)
  4. Bagnell JA, 2003, Advances in Neural Information Processing Systems (NIPS)
  5. Bagnell JA, 2003, International Joint Conference on Artifical Intelligence (IJCAI)
  6. Birdwell N, 2007, Reinforcement learning in sensor-guided AIBO robots
  7. Bishop C, 2006, Pattern Recognition and Machine Learning
  8. Boyan JA, 1995, Advances in Neural Information Processing Systems (NIPS)
  9. Brafman RI, 2002, Journal of Machine Learning Research, 3, 213
  10. Donoho DL, 2000, American Mathematical Society Conference Math Challenges of the 21st Century
  11. Dorigo M, 1993, International Computer Science Institute
  12. Gordon GJ, 1999, School of Computer Science, Carnegie Mellon University
  13. Gräve K, 2010, Joint International Symposium on Robotics (ISR) and German Conference on Robotics (ROBOTIK)
  14. Greensmith E, 2004, Journal of Machine Learning Research, 5, 1471
  15. Ijspeert AJ, 2003, Advances in Neural Information Processing Systems (NIPS)
  16. Kaelbling LP, 1990, Stanford University, Stanford
  17. Kober J, 2010, Machine Learning, 84, 171
  18. Konidaris GD, 2011, AAAI Conference on Artificial Intelligence (AAAI)
  19. Konidaris GD, 2011, AAAI Conference on Artificial Intelligence (AAAI)
  20. Lizotte D, 2007, International Joint Conference on Artifical Intelligence (IJCAI)
  21. Moldovan TM, 2012, 29th International Conference on Machine Learning (ICML), 1711
  22. Muelling K, 2012, The International Journal of Robotics Research
  23. Park DH, 2008, IEEE International Conference on Humanoid Robots (HUMANOIDS)
  24. Perkins TJ, 2002, Journal of Machine Learning Research, 3, 803
  25. Peters J, 2010, National Conference on Artificial Intelligence (AAAI)
  26. Platt R, 2006, International Conference on Development and Learning
  27. Powell WB, 2012, Princeton University
  28. Randløv J, 1998, International Conference on Machine Learning (ICML), 463
  29. Ross S, 2012, International Conference on Machine Learning (ICML)
  30. Ross S, 2011, International Conference on Artifical Intelligence and Statistics (AISTATS)
  31. Rückstieß T, 2008, European Conference on Machine Learning (ECML)
  32. Schaal S (1996) Learning from demonstration. In: Advances in Neural Information Processing Systems (NIPS).
  33. Smart WD, 1998, National Conference on Artificial Intelligence/Innovative Applications of Artificial Intelligence (AAAI/IAAI)
  34. Soni V, 2006, International Conference on Development and Learning (ICDL)
  35. Strens M, 2001, International Conference on Machine Learning (ICML)
  36. Stulp F, 2012, International Conference on Machine Learning (ICML)
  37. Sutton RS, 1999, Advances in Neural Information Processing Systems (NIPS)
  38. Tedrake R, 2005, Yale Workshop on Adaptive and Learning Systems
  39. Tokic M, 2009, International Florida Artificial Intelligence Research Society Conference (FLAIRS)
  40. Toussaint M, 2010, Inference and Learning in Dynamic Models
  41. Youssef SM, 2005, ICGST International Conference on Automation, Robotics and Autonomous Systems (ARAS)
  42. Ziebart BD, 2008, AAAI Conference on Artificial Intelligence (AAAI)

Cited by

See all 3,160

Metadata

Authors
Kober, J., Bagnell, J. A., & Peters, J.
Affiliations
  • Bielefeld University (DE)
  • Carnegie Mellon University (US)
  • Technische Universität Darmstadt (DE)
Venue
The International Journal of Robotics Research
Published
2013-08-23
Volume
32
Issue
11
Pages
1238-1274
ISSN
  • 0278-3649 (ISSN-L)
  • 1741-3176
OpenAlex
W1977655452
Cited by
3,160
References
260
Citations by year
2026: 224 · 2025: 335 · 2024: 325 · 2023: 322 · 2022: 298 · 2021: 426 · 2020: 348 · 2019: 277 · 2018: 201 · 2017: 149 · 2016: 112 · 2015: 75 · 2014: 47 · 2013: 16
FWCI
91.99
Type
journal article
Language
en
Open access
Licence
  • cc-by
  • journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations
  • The International Journal of Robotics Research (publishedVersion)
  • KiltHub Repository (submittedVersion)
  • Max Planck Digital Library (submittedVersion)
  • Figshare (submittedVersion, cc-by)
  • PUB – Publications at Bielefeld University (Bielefeld University) (submittedVersion)
  • Publikationen an der Universität Bielefeld (Universität Bielefeld) (submittedVersion)
  • MPG.PuRe (Max Planck Society) (submittedVersion)
  • KiltHub Repository
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
  • Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
  • Physical Sciences › Engineering › Control and Systems Engineering › Adaptive Dynamic Programming Control
Keywords
reinforcement learning, robot behavior generation, policy search

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Reinforcement learning in robotics: A survey. https://app.cochat.ai/papers/10.1177/0278364913495721
The paper
Kober, J., Bagnell, J. A., & Peters, J. (2013). Reinforcement learning in robotics: A survey. The International Journal of Robotics Research. https://doi.org/10.1177/0278364913495721

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.