The DOI matches its Crossref record; 260 of the 260 references it cites were found in a registry or an index.
Reinforcement learning in robotics: A survey
Open accessAbstract
Reinforcement learning offers to robotics a framework and set of tools for the design of sophisticated and hard-to-engineer behaviors. Conversely, the challenges of robotic problems provide both inspiration, impact, and validation for developments in reinforcement learning. The relationship between disciplines has sufficient promise to be likened to that between physics and mathematics. In this article, we attempt to strengthen the links between the two research communities by providing a survey of work in reinforcement learning for behavior generation in robots. We highlight both key challenges in robot reinforcement learning as well as notable successes. We discuss how contributions tamed the complexity of the domain and study the role of algorithms, representations, and prior knowledge in achieving these successes. As a result, a particular focus of our paper lies on the choice between model-based and model-free as well as between value-function-based and policy-search methods. By analyzing a simple problem in some detail we demonstrate how reinforcement learning approaches may be profitably applied, and we note throughout open questions and the tremendous potential for future research.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Some of the most common applications for DRL in robotics are navigation and dexterous manipulation [1], [76].”
From Sim-to-Real Transfer in Deep Reinforcement Learning for Robotics: a Survey (2020) · cites this paper as [76]
In the citing paper
“An exception to this is, however, robotic tasks involving object manipulation [5], [6].”
From Sim-to-Real Transfer in Deep Reinforcement Learning for Robotics: a Survey (2020) · cites this paper as [5]
In the citing paper
“Robotic manipulation tasks that have been possible with DRL ranging from learning peg-in-hole tasks [40] to deformable object manipulation [6], and including more dexterous manipulation with multi-fingered hands [5], or learning force control policies [78].”
From Sim-to-Real Transfer in Deep Reinforcement Learning for Robotics: a Survey (2020) · cites this paper as [5]
In the citing paper
“Classical approaches employ reinforcement learning (RL) [6, 7] and imitation learning [8-10] that operate on primitive actions, which could be challenging for systematic exploration [11-15], interpretability [16-18], and generalization [19-21].”
From Voyager: An Open-Ended Embodied Agent with Large Language Models (2023) · cites this paper as [6]
In the citing paper
“These algorithms have achieved breakthrough performance in multiple domains including games [66], healthcare [14] and robotics [34].”
From Artificial Intelligence in Education (AIEd): a high-level academic and industry note 2021 (2022) · cites this paper as [34]
Citations
Cites
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
Goldberg, D. E., & Shakespeare, W. (2002) · Cited by 16,088
Bellman, R. E. (2010) · doi:10.1515/9781400835386 · Cited by 14,588
Bertsekas, D. P. (1997) · Journal of the Operational Research Society · doi:10.1038/sj.jors.2600425 · Cited by 11,726
Gaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705
(1995) · Cited by 10,558
Reinforcement Learning: A Survey
Kaelbling, L. P., Littman, M. L., & Moore, A. W. (1996) · Journal of Artificial Intelligence Research · doi:10.1613/jair.301 · Cited by 8,972
Decisions with Multiple Objectives: Preferences and Value Tradeoffs.
Tsoukias, A., Keeney, R. L., & Raiffa, H. (1994) · The Journal of the Operational Research Society · doi:10.2307/2584151 · Cited by 8,370
(2006) · Springer eBooks · Cited by 8,123
Markov decision processes: Discrete stochastic dynamic programming
Hazeghi, K., & Puterman, M. L. (1995) · Journal of the American Statistical Association · doi:10.2307/2291177 · Cited by 8,037
Research works printed but not linked: 42
- Atkeson CG, 1994, Advances in Neural Information Processing Systems (NIPS)
- Atkeson CG, 1997, AI Review, 11, 75
- Atkeson CG, 1997, International Conference on Machine Learning (ICML)
- Bagnell JA, 2003, Advances in Neural Information Processing Systems (NIPS)
- Bagnell JA, 2003, International Joint Conference on Artifical Intelligence (IJCAI)
- Birdwell N, 2007, Reinforcement learning in sensor-guided AIBO robots
- Bishop C, 2006, Pattern Recognition and Machine Learning
- Boyan JA, 1995, Advances in Neural Information Processing Systems (NIPS)
- Brafman RI, 2002, Journal of Machine Learning Research, 3, 213
- Donoho DL, 2000, American Mathematical Society Conference Math Challenges of the 21st Century
- Dorigo M, 1993, International Computer Science Institute
- Gordon GJ, 1999, School of Computer Science, Carnegie Mellon University
- Gräve K, 2010, Joint International Symposium on Robotics (ISR) and German Conference on Robotics (ROBOTIK)
- Greensmith E, 2004, Journal of Machine Learning Research, 5, 1471
- Ijspeert AJ, 2003, Advances in Neural Information Processing Systems (NIPS)
- Kaelbling LP, 1990, Stanford University, Stanford
- Kober J, 2010, Machine Learning, 84, 171
- Konidaris GD, 2011, AAAI Conference on Artificial Intelligence (AAAI)
- Konidaris GD, 2011, AAAI Conference on Artificial Intelligence (AAAI)
- Lizotte D, 2007, International Joint Conference on Artifical Intelligence (IJCAI)
- Moldovan TM, 2012, 29th International Conference on Machine Learning (ICML), 1711
- Muelling K, 2012, The International Journal of Robotics Research
- Park DH, 2008, IEEE International Conference on Humanoid Robots (HUMANOIDS)
- Perkins TJ, 2002, Journal of Machine Learning Research, 3, 803
- Peters J, 2010, National Conference on Artificial Intelligence (AAAI)
- Platt R, 2006, International Conference on Development and Learning
- Powell WB, 2012, Princeton University
- Randløv J, 1998, International Conference on Machine Learning (ICML), 463
- Ross S, 2012, International Conference on Machine Learning (ICML)
- Ross S, 2011, International Conference on Artifical Intelligence and Statistics (AISTATS)
- Rückstieß T, 2008, European Conference on Machine Learning (ECML)
- Schaal S (1996) Learning from demonstration. In: Advances in Neural Information Processing Systems (NIPS).
- Smart WD, 1998, National Conference on Artificial Intelligence/Innovative Applications of Artificial Intelligence (AAAI/IAAI)
- Soni V, 2006, International Conference on Development and Learning (ICDL)
- Strens M, 2001, International Conference on Machine Learning (ICML)
- Stulp F, 2012, International Conference on Machine Learning (ICML)
- Sutton RS, 1999, Advances in Neural Information Processing Systems (NIPS)
- Tedrake R, 2005, Yale Workshop on Adaptive and Learning Systems
- Tokic M, 2009, International Florida Artificial Intelligence Research Society Conference (FLAIRS)
- Toussaint M, 2010, Inference and Learning in Dynamic Models
- Youssef SM, 2005, ICGST International Conference on Automation, Robotics and Autonomous Systems (ARAS)
- Ziebart BD, 2008, AAAI Conference on Artificial Intelligence (AAAI)
Cited by
Mastering the game of Go without human knowledge
Silver, D., Schrittwieser, J., Simonyan, K., Antonoglou, I., Huang, A., Guez, A., Hubert, T., Baker, L., Lai, M., Bolton, A., et al. (2017) · Nature · doi:10.1038/nature24270 · Cited by 9,084
How artificial intelligence will change the future of marketing
Davenport, T., Guha, A., Grewal, D., & Bressgott, T. (2020) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-019-00696-0 · Cited by 2,875
AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehicles
Shah, S., Dey, D., Lovett, C., & Kapoor, A. (2018) · Springer Proceedings in Advanced Robotics · doi:10.1007/978-3-319-67361-5_40 · Cited by 2,254
End-to-End Training of Deep Visuomotor Policies
Levine, S., Finn, C., Darrell, T. J., & Abbeel, P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.00702 · Cited by 1,344
A State-of-the-Art Survey on Deep Learning Theory and Architectures
Alom, M. Z., Taha, T. M., Yakopcic, C., Westberg, S., Sidike, P., Nasrin, M. S., Hasan, M., Van Essen, B. C., Awwal, A. A. S., & Asari, V. K. (2019) · Electronics · doi:10.3390/electronics8030292 · Cited by 1,620
Metadata
- Authors
- Kober, J., Bagnell, J. A., & Peters, J.
- Affiliations
- Bielefeld University (DE)
- Carnegie Mellon University (US)
- Technische Universität Darmstadt (DE)
- Venue
- The International Journal of Robotics Research
- Publisher
- SAGE Publications
- Published
- 2013-08-23
- Volume
- 32
- Issue
- 11
- Pages
- 1238-1274
- ISSN
- 0278-3649 (ISSN-L)
- 1741-3176
- OpenAlex
- W1977655452
- Cited by
- 3,160
- References
- 260
- Citations by year
- 2026: 224 · 2025: 335 · 2024: 325 · 2023: 322 · 2022: 298 · 2021: 426 · 2020: 348 · 2019: 277 · 2018: 201 · 2017: 149 · 2016: 112 · 2015: 75 · 2014: 47 · 2013: 16
- FWCI
- 91.99
- Type
- journal article
- Language
- en
- Open access
- green
- figshare.com
- Licence
- cc-by
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- The International Journal of Robotics Research (publishedVersion)
- KiltHub Repository (submittedVersion)
- Max Planck Digital Library (submittedVersion)
- Figshare (submittedVersion, cc-by)
- PUB – Publications at Bielefeld University (Bielefeld University) (submittedVersion)
- Publikationen an der Universität Bielefeld (Universität Bielefeld) (submittedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- KiltHub Repository
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Physical Sciences › Engineering › Control and Systems Engineering › Adaptive Dynamic Programming Control
- Keywords
- reinforcement learning, robot behavior generation, policy search
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Reinforcement learning in robotics: A survey. https://app.cochat.ai/papers/10.1177/0278364913495721
- The paper
- Kober, J., Bagnell, J. A., & Peters, J. (2013). Reinforcement learning in robotics: A survey. The International Journal of Robotics Research. https://doi.org/10.1177/0278364913495721
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.