The DOI matches its Crossref record; 169 of the 169 references it cites were found in a registry or an index.
Reinforcement learning in robotic applications: a comprehensive survey
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
(1995) · Cited by 10,558
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Reinforcement Learning: A Survey
Kaelbling, L. P., Littman, M. L., & Moore, A. W. (1996) · Journal of Artificial Intelligence Research · doi:10.1613/jair.301 · Cited by 8,972
Markov decision processes: Discrete stochastic dynamic programming
Hazeghi, K., & Puterman, M. L. (1995) · Journal of the American Statistical Association · doi:10.2307/2291177 · Cited by 8,037
Watkins, C. (1989) · OpenGrey (Institut de l'Information Scientifique et Technique) · doi:10.17863/cam.132164 · Cited by 5,297
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148
(1999) · Cited by 5,147
Deep Reinforcement Learning: A Brief Survey
Arulkumaran, K., Deisenroth, M. P., Brundage, M., & Bharath, A. A. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2743240 · Cited by 4,733
A Brief Survey of Deep Reinforcement Learning
Arulkumaran, K., Deisenroth, M. P., Brundage, M., & Bharath, A. A. (2017) · arXiv · doi:10.48550/arxiv.1708.05866 · Cited by 4,733
Classical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449
Completely Derandomized Self-Adaptation in Evolution Strategies
Hansen, N., & Ostermeier, A. (2001) · Evolutionary Computation · doi:10.1162/106365601750190398 · Cited by 4,397
Wireless communications with unmanned aerial vehicles: opportunities and challenges
Zeng, Y., Zhang, R., & Lim, T. J. (2016) · IEEE Communications Magazine · doi:10.1109/mcom.2016.7470933 · Cited by 4,048
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1023/a:1022676722315 · Cited by 3,907
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 3,416
Deep Reinforcement Learning with Double Q-Learning
Van Hasselt, H., Guez, A., & Silver, D. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10295 · Cited by 3,318
Deterministic Policy Gradient Algorithms
Silver, D., Lever, G., Heess, N., Degris, T., Wierstra, D., & Riedmiller, M. (2014) · HAL · Cited by 3,275
Neuronlike adaptive elements that can solve difficult learning control problems
Barto, A. G., Sutton, R. S., & Anderson, C. W. (1983) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1983.6313077 · Cited by 3,233
Reinforcement learning in robotics: A survey
Kober, J., Bagnell, J. A., & Peters, J. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913495721 · Cited by 3,160
A Comprehensive Survey of Multiagent Reinforcement Learning
Busoniu, L., Babuska, R., & De Schutter, B. (2008) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2007.913919 · Cited by 2,235
Policy Invariance Under Reward Transformations: Theory and Application to Reward Shaping
Ng, A. Y., Harada, D., & Russell, S. (1999) · Cited by 1,744
Target-driven visual navigation in indoor scenes using deep reinforcement learning
Zhu, Y., Mottaghi, R., Kolve, E., Lim, J. J., Gupta, A., Fei-Fei, L., & Farhadi, A. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989381 · Cited by 1,533
On-line Q-learning Using Connectionist Systems
Rummery, G. A. (1994) · Cited by 1,477
Nguyen, T. T., Nguyen, N. D., & Nahavandi, S. (2020) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2020.2977374 · Cited by 1,306
Multiagent systems: A survey from a machine learning perspective
Stone, P., & Veloso, M. (2000) · Autonomous Robots · doi:10.1023/a:1008942012299 · Cited by 1,218
PILCO: A Model-Based and Data-Efficient Approach to Policy Search
Deisenroth, M. P., & Rasmussen, C. E. (2011) · Cambridge University Engineering Department Publications Database · Cited by 1,136
Deep Reinforcement Learning framework for Autonomous Driving
Sallab, A. E., Abdou, M., Perot, E., & Yogamani, S. (2017) · Electronic Imaging · doi:10.2352/issn.2470-1173.2017.19.avm-023 · Cited by 1,045
A Survey of Actor-Critic Reinforcement Learning: Standard and Natural Policy Gradients
Grondman, I., Busoniu, L., Lopes, G. A. D., & Babuska, R. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2012.2218595 · Cited by 1,042
Nash Q-Learning for General-Sum Stochastic Games
Hu, J., Wellman, M. P., & Boutilier, C. (2003) · Cited by 923
Residual Algorithms: Reinforcement Learning with Function Approximation
Baird, L. (1995) · Machine Learning Proceedings 1995 · doi:10.1016/b978-1-55860-377-6.50013-x · Cited by 918
Optimal and Autonomous Control Using Reinforcement Learning: A Survey
Kiumarsi, B., Vamvoudakis, K. G., Modares, H., & Lewis, F. L. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2773458 · Cited by 891
Reinforcement learning of motor skills with policy gradients
Peters, J., & Schaal, S. (2008) · Neural Networks · doi:10.1016/j.neunet.2008.02.003 · Cited by 831
A Survey on Policy Search for Robotics
Deisenroth, M. P. (2011) · Foundations and Trends in Robotics · doi:10.1561/2300000021 · Cited by 798
Multiagent learning using a variable learning rate
Bowling, M., & Veloso, M. (2002) · Artificial Intelligence · doi:10.1016/s0004-3702(02)00121-2 · Cited by 775
Reinforcement learning: The Good, The Bad and The Ugly
Dayan, P., & Niv, Y. (2008) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2008.08.003 · Cited by 704
Designing neural networks through neuroevolution
Stanley, K. O., Clune, J., Lehman, J., & Miikkulainen, R. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-018-0006-z · Cited by 689
Gaussian Processes for Data-Efficient Learning in Robotics and Control
Deisenroth, M. P., Fox, D., & Rasmussen, C. E. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.218 · Cited by 659
Control of a Quadrotor With Reinforcement Learning
Hwangbo, J., Sa, I., Siegwart, R., & Hutter, M. (2017) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2017.2720851 · Cited by 543
Such, F. P., Madhavan, V., Conti, E., Lehman, J., Stanley, K. O., & Clune, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.06567 · Cited by 525
Relative Entropy Policy Search
Peters, J., Mulling, K., & Altun, Y. (2010) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v24i1.7727 · Cited by 455
Stable Function Approximation in Dynamic Programming
Gordon, G. J. (1995) · Machine Learning Proceedings 1995 · doi:10.1016/b978-1-55860-377-6.50040-2 · Cited by 446
Wang, C., Wang, J., Shen, Y., & Zhang, X. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2018.2890773 · Cited by 443
Feature-based methods for large scale dynamic programming
Tsitsiklis, J. N., & van Roy, B. (1996) · Machine Learning · doi:10.1007/bf00114724 · Cited by 432
Policy search for motor primitives in robotics
Kober, J., & Peters, J. (2011) · Machine Learning · doi:10.1007/s10994-010-5223-6 · Cited by 427
Zhang, H., Jiang, H., Luo, Y., & Xiao, G. (2017) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2016.2542134 · Cited by 424
Teachable robots: Understanding human teaching behavior to build more effective robot learners
Thomaz, A. L., & Breazeal, C. (2008) · Artificial Intelligence · doi:10.1016/j.artint.2007.09.009 · Cited by 405
Adaptive linear quadratic control using policy iteration
Bradtke, S. J., Ydstie, B. E., & Barto, A. G. (2005) · Proceedings of 1994 American Control Conference - ACC '94 · doi:10.1109/acc.1994.735224 · Cited by 404
Greenwald, A., & Hall, K. (2003) · Cited by 380
Reinforcement learning improves behaviour from evaluative feedback
Littman, M. L. (2015) · Nature · doi:10.1038/nature14540 · Cited by 368
Reinforcement Learning: A Tutorial Survey and Recent Advances
Gosavi, A. (2009) · INFORMS Journal on Computing · doi:10.1287/ijoc.1080.0305 · Cited by 326
Peters, J., Vijayakumar, S., & Schaal, S. (2005) · Lecture Notes in Computer Science · doi:10.1007/11564096_29 · Cited by 307
A survey of human-centered intelligent robots: issues and challenges
He, W., Li, Z., & Chen, C. L. P. (2017) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2017.7510604 · Cited by 297
A stochastic reinforcement learning algorithm for learning real-valued functions
Gullapalli, V. (1990) · Neural Networks · doi:10.1016/0893-6080(90)90056-q · Cited by 295
Technical Update: Least-Squares Temporal Difference Learning
Boyan, J. A. (2002) · Machine Learning · doi:10.1023/a:1017936530646 · Cited by 294
A sensor-based navigation for a mobile robot using fuzzy logic and reinforcement learning
Beom, H. R., & Cho, H. S. (1995) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/21.364859 · Cited by 291
Rational and convergent learning in stochastic games
Bowling, M., & Veloso, M. (2001) · Cited by 285
A Generalized Path Integral Control Approach to Reinforcement Learning
TheodorouEvangelos, BuchliJonas, & SchaalStefan (2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1953033 · Cited by 280
Reinforcement learning in artificial and biological systems
Neftci, E. O., & Averbeck, B. B. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0025-4 · Cited by 268
Experience Replay for Real-Time Reinforcement Learning Control
Adam, S., Busoniu, L., & Babuska, R. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2011.2106494 · Cited by 255
Concise deep reinforcement learning obstacle avoidance for underactuated unmanned marine vessels
Cheng, Y., & Zhang, W. (2018) · Neurocomputing · doi:10.1016/j.neucom.2017.06.066 · Cited by 247
Reinforcement learning for clinical decision support in critical care: comprehensive review
Liu, S., See, K. C., Ngiam, K. Y., Celi, L. A., Sun, X., & Feng, M. (2020) · Journal of Medical Internet Research · doi:10.2196/18477 · Cited by 225
Optimized Assistive Human–Robot Interaction Using Reinforcement Learning
Modares, H., Ranatunga, I., Lewis, F. L., & Popa, D. O. (2016) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2015.2412554 · Cited by 220
Truong, X.-T., & Ngo, T. D. (2017) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2017.2731371 · Cited by 206
Li, Z., Zhao, T., Chen, F., Hu, Y., Su, C.-Y., & Fukuda, T. (2018) · IEEE/ASME Transactions on Mechatronics · doi:10.1109/tmech.2017.2717461 · Cited by 201
Hierarchical Deep Reinforcement Learning for Continuous Action Control
Yang, Z., Merrick, K., Jin, L., & Abbass, H. A. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2805379 · Cited by 197
A Q-Learning Approach to Flocking With UAVs in a Stochastic Environment
Hung, S.-M., & Givigi, S. N. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2015.2509646 · Cited by 196
Introduction: The Challenge of Reinforcement Learning
Sutton, R. S. (1992) · Machine Learning · doi:10.1007/bf00992695 · Cited by 195
Adaptive low-level control of autonomous underwater vehicles using deep reinforcement learning
Carlucho, I., De Paula, M., Wang, S., Petillot, Y., & Acosta, G. G. (2018) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2018.05.016 · Cited by 186
Reinforcement Ant Optimized Fuzzy Controller for Mobile-Robot Wall-Following Control
Juang, C., & Hsu, C.-H. (2009) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2009.2017557 · Cited by 185
Adaptive Impedance Control of Human–Robot Cooperation Using Reinforcement Learning
Li, Z., Liu, J., Huang, Z., Peng, Y., Pu, H., & Ding, L. (2017) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2017.2694391 · Cited by 182
An adaptive optimal controller for discrete-time Markov environments
Witten, I. H. (1977) · Information and Control · doi:10.1016/s0019-9958(77)90354-0 · Cited by 180
Motivational neural circuits underlying reinforcement learning
Averbeck, B. B., & Costa, V. D. (2017) · Nature Neuroscience · doi:10.1038/nn.4506 · Cited by 177
Event-Triggered Optimal Control With Performance Guarantees Using Adaptive Dynamic Programming
Luo, B., Yang, Y., Liu, D., & Wu, H.-N. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2899594 · Cited by 177
A New Q-Learning Algorithm Based on the Metropolis Criterion
Guo, M., Liu, Y., & Malec, J. (2004) · IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2004.832154 · Cited by 176
Low-Level Control of a Quadrotor With Deep Model-Based Reinforcement Learning
Lambert, N. O., Drew, D. S., Yaconelli, J., Levine, S., Calandra, R., & Pister, K. S. J. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2930489 · Cited by 174
UAV Autonomous Target Search Based on Deep Reinforcement Learning in Complex Disaster Scene
Wu, C., Ju, B., Wu, Y., Lin, X., Xiong, N. N., Xu, G., Li, H., & Liang, X. (2019) · IEEE Access · doi:10.1109/access.2019.2933002 · Cited by 168
User-Centric View of Unmanned Aerial Vehicle Transmission Against Smart Attacks
Xiao, L., Xie, C., Min, M., & Zhuang, W. (2018) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2017.2785414 · Cited by 166
Path Planning via an Improved DQN-Based Learning Policy
Lv, L., Zhang, S., Ding, D., & Wang, Y. (2019) · IEEE Access · doi:10.1109/access.2019.2918703 · Cited by 160
Feature-based aggregation and deep reinforcement learning: a survey and some new implementations
Bertsekas, D. P. (2018) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2018.7511249 · Cited by 159
A Concise Introduction to Multiagent Systems and Distributed Artificial Intelligence
Vlassis, N. A. (2007) · Synthesis lectures on artificial intelligence and machine learning · doi:10.2200/s00091ed1v01y200705aim002 · Cited by 158
Ye, C., Yung, N. H. C., & Wang, D. (2003) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2003.808179 · Cited by 156
A Hybrid Visual Servo Controller for Robust Grasping by Wheeled Mobile Robots
Wang, Y., Lang, H., & de Silva, C. W. (2009) · IEEE/ASME Transactions on Mechatronics · doi:10.1109/tmech.2009.2034740 · Cited by 148
Optimal Synchronization of Heterogeneous Nonlinear Systems With Unknown Dynamics
Modares, H., Lewis, F. L., Kang, W., & Davoudi, A. A. (2017) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2017.2713339 · Cited by 143
Adaptive $Q$ -Learning for Data-Based Optimal Output Regulation With Experience Replay
Luo, B., Yang, Y., & Liu, D. (2018) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2821369 · Cited by 143
Multirobot Cooperative Learning for Predator Avoidance
La, H. M., Lim, R. S., & Sheng, W. (2014) · IEEE Transactions on Control Systems Technology · doi:10.1109/tcst.2014.2312392 · Cited by 142
Multiagent Reinforcement Learning for Multi-Robot Systems: A Survey
Yang, E., & Gu, D. (2004) · Cited by 139
Human-Centered Reinforcement Learning: A Survey
Li, G., Gómez, R., Nakamura, K., & He, B. (2019) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2019.2912447 · Cited by 138
Integrating State Representation Learning Into Deep Reinforcement Learning
de Bruin, T., Kober, J., Tuyls, K., & Babuška, R. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2800101 · Cited by 137
Machine Learning Algorithms in Bipedal Robot Control
Wang, S., Chaovalitwongse, W. A., & Babuška, R. (2012) · IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews) · doi:10.1109/tsmcc.2012.2186565 · Cited by 136
An Approach to Tune Fuzzy Controllers Based on Reinforcement Learning for Autonomous Vehicle Control
Dai, X., Li, C. K., & Rad, A. B. (2005) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2005.853698 · Cited by 130
Huang, R., Cheng, H., Qiu, J., & Zhang, J. (2019) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2018.2886376 · Cited by 130
Yang, X., He, H., & Liu, D. (2017) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2017.2774602 · Cited by 129
Intelligent Trajectory Design in UAV-Aided Communications With Reinforcement Learning
Yin, S., Zhao, S., Zhao, Y., & Yu, F. R. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2923214 · Cited by 121
Coordination of Multiple Robotic Fish With Applications to Underwater Robot Competition
Yu, J., Wang, C., & Xie, G. (2015) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2015.2425359 · Cited by 120
Decoupled Visual Servoing With Fuzzy Q-Learning
Shi, H., Li, X., Hwang, K.-S., Pan, W., & Xu, G. (2016) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2016.2617464 · Cited by 119
Multiobjective Optimization for Stiffness and Position Control in a Soft Robot Arm Module
Ansari, Y. T., Manti, M., Falotico, E., Cianchetti, M., & Laschi, C. (2017) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2017.2734247 · Cited by 118
Hu, J., Zhang, H., & Song, L. (2018) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2876513 · Cited by 117
COLA2: A Control Architecture for AUVs
Palomeras, N., El-Fakdi, A., Carreras, M., & Ridao, P. (2012) · IEEE Journal of Oceanic Engineering · doi:10.1109/joe.2012.2205638 · Cited by 110
Learning table tennis with a Mixture of Motor Primitives
Muelling, K., Kober, J., & Peters, J. (2010) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/ichr.2010.5686298 · Cited by 110
VR-Goggles for Robots: Real-to-Sim Domain Adaptation for Visual Control
Zhang, J., Tai, L., Yun, P., Xiong, Y., Liu, M., Boedecker, J., & Burgard, W. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2894216 · Cited by 109
Doroodgar, B., Liu, Y., & Nejat, G. (2014) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2314294 · Cited by 109
Parameterized Batch Reinforcement Learning for Longitudinal Control of Autonomous Land Vehicles
Huang, Z., Xu, X., He, H., Tan, J. H., & Sun, Z. (2017) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2017.2712561 · Cited by 109
Obstacle Avoidance of a Mobile Robot Using Hybrid Learning Approach
Er, M. J., & Deng, C. (2005) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2005.847576 · Cited by 108
Incremental Q -learning strategy for adaptive PID control of mobile robots
Carlucho, I., Paula, M. D., Villar, S. A., & Acosta, G. G. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.03.002 · Cited by 107
Learning to Navigate Through Complex Dynamic Environment With Modular Deep Reinforcement Learning
Wang, Y., He, H., & Sun, C. (2018) · IEEE Transactions on Games · doi:10.1109/tg.2018.2849942 · Cited by 105
Impedance Learning for Robotic Contact Tasks Using Natural Actor-Critic Algorithm
Kim, B., Park, J., Park, S., & Kang, S. (2009) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2009.2026289 · Cited by 104
Multiagent reinforcement learning using function approximation
Abul, O., Polat, F., & Alhajj, R. (2000) · IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews) · doi:10.1109/5326.897075 · Cited by 102
Iterative Learning Procedure With Reinforcement for High-Accuracy Force Tracking in Robotized Tasks
Roveda, L., Pallucca, G., Pedrocchi, N., Braghin, F., & Tosatti, L. M. (2017) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2017.2748236 · Cited by 100
System Design Perspective for Human-Level Agents Using Deep Reinforcement Learning: A Survey
Nguyen, N. D., Nguyen, T., & Nahavandi, S. (2017) · IEEE Access · doi:10.1109/access.2017.2777827 · Cited by 100
Robust Quantum-Inspired Reinforcement Learning for Robot Navigation
Dong, D., Chen, C., Chu, J., & Tarn, T. (2010) · IEEE/ASME Transactions on Mechatronics · doi:10.1109/tmech.2010.2090896 · Cited by 97
Evaluation of Policy Gradient Methods and Variants on the Cart-Pole Benchmark
Riedmiller, M., Peters, J., & Schaal, S. (2007) · IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning · doi:10.1109/adprl.2007.368196 · Cited by 91
Barrier-Certified Adaptive Reinforcement Learning With Applications to Brushbot Navigation
Ohnishi, M., Wang, L., Notomista, G., & Egerstedt, M. (2019) · IEEE Transactions on Robotics · doi:10.1109/tro.2019.2920206 · Cited by 89
Training Agents With Interactive Reinforcement Learning and Contextual Affordances
Cruz, F., Magg, S., Weber, C., & Wermter, S. (2016) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2016.2543839 · Cited by 86
Dynamic Reward Shaping: Training a Robot by Voice
Tenorio-González, A. C., Morales, E. F., & Villaseñor-Pineda, L. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-16952-6_49 · Cited by 85
Ribeiro, C. H. C. (2002) · Artificial Intelligence Review · doi:10.1023/a:1015008417172 · Cited by 85
On Learning Navigation Behaviors for Small Mobile Robots With Reservoir Computing Architectures
Antonelo, E. A., & Schrauwen, B. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2014.2323247 · Cited by 84
Colomé, A., & Torras, C. (2018) · IEEE Transactions on Robotics · doi:10.1109/tro.2018.2808924 · Cited by 84
Böhmer, W., Springenberg, J. T., Boedecker, J., Riedmiller, M., & Obermayer, K. (2015) · Künstliche Intell. · doi:10.1007/s13218-015-0356-1 · Cited by 83
An intelligent mobile vehicle navigator based on fuzzy logic and reinforcement learning
Yung, N. H. C., & Ye, C. (1999) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/3477.752807 · Cited by 83
Idiotypic Immune Networks in Mobile-Robot Control
Whitbrook, A. M., Aickelin, U., & Garibaldi, J. M. (2007) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2007.907334 · Cited by 83
An incremental approach to developing intelligent neural network controllers for robots
Meeden, L. (1996) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/3477.499797 · Cited by 80
Target Search Control of AUV in Underwater Environment With Deep Reinforcement Learning
Cao, X. S., Sun, C., & Yan, M. (2019) · IEEE Access · doi:10.1109/access.2019.2929120 · Cited by 78
Plume Tracing via Model-Free Reinforcement Learning Method
Hu, H., Song, S., & Chen, C. L. P. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2885374 · Cited by 77
Self-Learning Cruise Control Using Kernel-Based Least Squares Policy Iteration
Wang, J., Xu, X., Liu, D., Sun, Z., & Chen, Q. (2013) · IEEE Transactions on Control Systems Technology · doi:10.1109/tcst.2013.2271276 · Cited by 76
Transfer of Experience Between Reinforcement Learning Environments with Progressive Difficulty
Madden, M. G., & Howley, T. (2004) · Artificial Intelligence Review · doi:10.1023/b:aire.0000036264.95672.64 · Cited by 75
Comparing Task Simplifications to Learn Closed-Loop Object Picking Using Deep Reinforcement Learning
Breyer, M., Furrer, F., Novković, T., Siegwart, R., & Nieto, J. I. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2896467 · Cited by 73
Model-Free Reinforcement Learning of Impedance Control in Stochastic Environments
Stulp, F., Buchli, J., Ellmer, A., Mistry, M., Theodorou, E. A., & Schaal, S. (2012) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2012.2205924 · Cited by 72
Bayesian Nonparametric Methods for Partially-Observable Reinforcement Learning
Doshi‐Velez, F., Pfau, D., Wood, F., & Roy, N. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.191 · Cited by 66
Real-World Reinforcement Learning via Multifidelity Simulators
Cutler, M., Walsh, T. J., & How, J. P. (2015) · IEEE Transactions on Robotics · doi:10.1109/tro.2015.2419431 · Cited by 64
Learning Parameterized SkillsPreprint
Da Silva, B., Konidaris, G., & Barto, A. G. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1206.6398 · Cited by 64
Adaptive behavior navigation of a mobile robot
Zalama, E., Gomez, J., Paul, M., & Perán, J. R. (2002) · IEEE Transactions on Systems Man and Cybernetics - Part A Systems and Humans · doi:10.1109/3468.995537 · Cited by 60
Multiagent Reinforcement Learning With Sparse Interactions by Negotiation and Knowledge Transfer
Zhou, L., Yang, P., Chen, C., & Gao, Y. (2016) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2543238 · Cited by 60
Multiagent Learning of Coordination in Loosely Coupled Multiagent Systems
Yu, C., Zhang, M., Ren, F., & Tan, G. (2015) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2387277 · Cited by 59
Grigorescu, S. M., Trăsnea, B., Marina, L., Vasilcoi, A., & Cocias, T. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2926224 · Cited by 57
Two-step gradient-based reinforcement learning for underwater robotics behavior learning
El-Fakdi, A., & Carreras, M. (2012) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2012.11.009 · Cited by 55
Khamassi, M., Velentzas, G., Tsitsimis, T., & Tzafestas, C. S. (2018) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2018.2843122 · Cited by 51
Reinforcement Learning in First Person Shooter Games
McPartland, M., & Gallagher, M. R. (2010) · IEEE Transactions on Computational Intelligence and AI in Games · doi:10.1109/tciaig.2010.2100395 · Cited by 50
Evolution Strategies for Direct Policy Search
Heidrich-Meisner, V., & Igel, C. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-87700-4_43 · Cited by 49
Adaptation Technique for Integrating Genetic Programming and Reinforcement Learning for Real Robots
Kamio, S., & Iba, H. (2005) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2005.850290 · Cited by 49
A Markov Game-Adaptive Fuzzy Controller for Robot Manipulators
Sharma, R., & Gopal, M. (2008) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2007.903323 · Cited by 46
Hierarchical Approximate Policy Iteration With Binary-Tree State Space Decomposition
Xu, X., Liu, C., Yang, S. X., & Hu, D. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2011.2168422 · Cited by 40
Gottipati, S. K., Seo, K., Bhatt, D., Mai, V., Jatavallabhula, K. M., & Paull, L. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2932575 · Cited by 40
Balance control of a biped robot on a rotating platform based on efficient reinforcement learning
Xi, A., Mudiyanselage, T. W., Tao, D., & Chen, C. (2019) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2019.1911567 · Cited by 39
Model-Plant Mismatch Compensation Using Reinforcement Learning
Koryakovskiy, I., Kudruss, M., Vallery, H., Babuška, R., & Caarls, W. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2800106 · Cited by 38
Combining Model-Based $Q$ -Learning With Structural Knowledge Transfer for Robot Skill Learning
Deng, Z., Guan, H., Huang, R., Liang, H., Zhang, L., & Zhang, J. (2017) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2017.2718938 · Cited by 37
On Policy Learning Robust to Irreversible Events: An Application to Robotic In-Hand Manipulation
Falco, P., Attawia, A., Saveriano, M., & Lee, D. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2800110 · Cited by 35
Reinforcement Learning and Synergistic Control of the ACT Hand
Rombokas, E., Malhotra, M., Theodorou, E. A., Todorov, E., & Matsuoka, Y. (2012) · IEEE/ASME Transactions on Mechatronics · doi:10.1109/tmech.2012.2219880 · Cited by 33
Learning to Navigate Endoscopic Capsule Robots
Turan, M., Almalıoğlu, Y., Gilbert, H. B., et al. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2924846 · Cited by 33
Chalvatzaki, G., Papageorgiou, X. S., Maragos, P. A., & Tzafestas, C. S. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2929996 · Cited by 33
Farahmand, A. M., Ahmadabadi, M. N., Lucas, C. L., & Araabi, B. N. (2009) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2009.2016216 · Cited by 31
A multi-agent reinforcement learning approach to robot soccer
Duan, Y. G., Cui, B. X., & Xu, X. H. (2011) · Artificial Intelligence Review · doi:10.1007/s10462-011-9244-8 · Cited by 30
Teaching with Rewards and Punishments: Reinforcement or Communication?
Ho, M. K., Littman, M. L., Cushman, F. A., & Austerweil, J. L. (2015) · eScholarship (California Digital Library) · Cited by 30
Deep Reinforcement Learning for Clinical Decision Support: A Brief SurveyPreprint
Liu, S., Ngiam, K. Y., & Feng, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.09475 · Cited by 30
An Optimization Framework for Task Sequencing in Curriculum Learning
Foglino, F., Christakou, C. C., & Leonetti, M. (2019) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/devlrn.2019.8850690 · Cited by 25
Autonomous Reinforcement Learning of Multiple Interrelated Tasks
Santucci, V. G., Baldassarre, G., & Cartoni, E. (2019) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/devlrn.2019.8850713 · Cited by 25
Robust Hybrid Visual Servoing Using Reinforcement Learning and Finite-Time Adaptive FOSMC
Sharma, R. S., Nair, R. R., Agrawal, P., Behera, L., & Subramanian, V. K. (2018) · IEEE Systems Journal · doi:10.1109/jsyst.2018.2875789 · Cited by 23
Fuzzy reinforcement learning control for compliance tasks of robotic manipulators
Tzafestaş, S. G., & Rigatos, G. G. (2002) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/3477.979965 · Cited by 21
Transferring Generalizable Motor Primitives From Simulation to Real World
Hazara, M., & Kyrki, V. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2900768 · Cited by 21
A Modular Agent Architecture for an Autonomous Robot
Hwang, K., Lo, C.-Y., & Liu, W. (2009) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2009.2016301 · Cited by 18
An approach to the design of reinforcement functions in real world, agent-based applications
Bonarini, A., Bonacina, C., & Matteucci, M. (2001) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/3477.931510 · Cited by 17
Parallel Online Temporal Difference Learning for Motor Control
Caarls, W., & Schuitema, E. (2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2442233 · Cited by 16
Learning to Serve: An Experimental Study for a New Learning From Demonstrations Framework
Koc, O., & Peters, J. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2896466 · Cited by 15
Zhu, J., Zhu, J., Wang, Z., Guo, S., & Xu, C. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2844466 · Cited by 14
On Policy Learning Robust to Irreversible Events: an Application to Robotic In-Hand Manipulation
Falco, P. ;. A. (2018) · mediaTUM – the media and publications repository of the Technical University Munich (Technical University Munich) · Cited by 13
Learning to serve: an experimental study for a new learning from demonstrations framework
Koc, O., & Peters, J. (2019) · MPG.PuRe (Max Planck Society) · Cited by 12
Research on task decomposition and state abstraction in reinforcement learning
Yu, L., Zhongbin, J., & Kang, L. (2011) · Artificial Intelligence Review · doi:10.1007/s10462-011-9243-9 · Cited by 7
Low-Dimensional Learning for Complex Robots
O’Flaherty, R., & Egerstedt, M. (2014) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2014.2349915 · Cited by 5
Episodic task learning in Markov decision processes
Lin, Y. H., Makedon, F. S., & Xu, Y. (2011) · Artificial Intelligence Review · doi:10.1007/s10462-011-9204-3 · Cited by 2
Cited by
Reinforcement learning algorithms: A brief survey
Shakya, A. K., Pillai, G., & Chakrabarty, S. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.120495 · Cited by 656
Esmaeilzadeh, P. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.102861 · Cited by 377
A Survey on Offline Reinforcement Learning: Taxonomy, Review, and Open Problems
Figueiredo Prudencio, R., Maximo, M. R. O. A., & Colombini, E. L. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3250269 · Cited by 361
Metadata
- Authors
- Singh, B., Kumar, R., & Singh, V. P.
- Venue
- Artificial Intelligence Review
- Published
- 2021-04-20
- Volume
- 55
- Issue
- 2
- Pages
- 945-990
- ISSN
- 0269-2821 (ISSN-L)
- 1573-7462
- OpenAlex
- W3152878473
- Cited by
- 392
- References
- 169
- FWCI
- 13.85
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.