The DOI matches its Crossref record; 168 of the 168 references it cites were found in a registry or an index.
Reinforcement learning for control: Performance, stability, and deep approximators
Open accessOverview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Artificial intelligence: a modern approach
(1995) · Choice Reviews Online · doi:10.5860/choice.33-1577 · Cited by 21,974
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 14,214
(2016) · Cited by 11,679
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Proximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625
(1995) · Cited by 10,558
Mastering the game of Go without human knowledge
Silver, D., Schrittwieser, J., Simonyan, K., Antonoglou, I., Huang, A., Guez, A., Hubert, T., Baker, L., Lai, M., Bolton, A., et al. (2017) · Nature · doi:10.1038/nature24270 · Cited by 9,084
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Reinforcement Learning: A Survey
Kaelbling, L. P., Littman, M. L., & Moore, A. W. (1996) · Journal of Artificial Intelligence Research · doi:10.1613/jair.301 · Cited by 8,972
Markov decision processes: Discrete stochastic dynamic programming
Hazeghi, K., & Puterman, M. L. (1995) · Journal of the American Statistical Association · doi:10.2307/2291177 · Cited by 8,037
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132
Approximation capabilities of multilayer feedforward networks
Hornik, K. (1991) · Neural Networks · doi:10.1016/0893-6080(91)90009-t · Cited by 6,091
Finite-time Analysis of the Multiarmed Bandit Problem
Auer, P., Cesa-Bianchi, N., & Fischer, P. (2002) · Machine Learning · doi:10.1023/a:1013689704352 · Cited by 6,033
Watkins, C. (1989) · OpenGrey (Institut de l'Information Scientifique et Technique) · doi:10.17863/cam.132164 · Cited by 5,297
(1999) · Cited by 5,147
Deep Reinforcement Learning: A Brief Survey
Arulkumaran, K., Deisenroth, M. P., Brundage, M., & Bharath, A. A. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2743240 · Cited by 4,733
A Brief Survey of Deep Reinforcement Learning
Arulkumaran, K., Deisenroth, M. P., Brundage, M., & Bharath, A. A. (2017) · arXiv · doi:10.48550/arxiv.1708.05866 · Cited by 4,733
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1023/a:1022676722315 · Cited by 3,907
Neural Information Processing Systems
(2018) · The Deep Learning Revolution · doi:10.7551/mitpress/11474.003.0014 · Cited by 3,730
(2012) · Encyclopedia of the Sciences of Learning · doi:10.1007/978-1-4419-1428-6_5086 · Cited by 3,515
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 3,416
Deep Reinforcement Learning with Double Q-Learning
Van Hasselt, H., Guez, A., & Silver, D. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10295 · Cited by 3,318
Deterministic Policy Gradient Algorithms
Silver, D., Lever, G., Heess, N., Degris, T., Wierstra, D., & Riedmiller, M. (2014) · HAL · Cited by 3,275
Neuronlike adaptive elements that can solve difficult learning control problems
Barto, A. G., Sutton, R. S., & Anderson, C. W. (1983) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1983.6313077 · Cited by 3,233
Digital control of dynamic systems
Franklin, G. F., Workman, M. L., & Powell, D. (1980) · International Linear Collider · Cited by 3,188
Reinforcement learning in robotics: A survey
Kober, J., Bagnell, J. A., & Peters, J. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913495721 · Cited by 3,160
Self-citationBandit Based Monte-Carlo Planning
Kocsis, L., & Szepesvári, C. (2006) · Lecture Notes in Computer Science · doi:10.1007/11871842_29 · Cited by 2,855
Understanding deep learning requires rethinking generalization
Zhang, C., Bengio, S., Hardt, M., Recht, B., & Vinyals, O. (2016) · arXiv · doi:10.48550/arxiv.1611.03530 · Cited by 2,838 · cited 1×
“The theoretical foundations are however still somewhat incomplete (Zhang et al., 2016).”
BackgroundApproximate Dynamic Programming: Solving the Curses of Dimensionality
Powell, W. B. (2011) · Wiley Series in Probability and Statistics · doi:10.1002/9781118029176 · Cited by 2,297
A Comprehensive Survey of Multiagent Reinforcement Learning
Busoniu, L., Babuska, R., & De Schutter, B. (2008) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2007.913919 · Cited by 2,235
High-Dimensional Continuous Control Using Generalized Advantage Estimation
Schulman, J., Moritz, P., Levine, S., Jordan, M., & Abbeel, P. (2015) · arXiv · doi:10.48550/arxiv.1506.02438 · Cited by 2,103
Digital control of dynamic systems
Koivo, H. N. (1983) · Automatica · doi:10.1016/0005-1098(83)90065-1 · Cited by 1,956
Artificial Intelligence: A Modern Approach
Ligeza, A. (1995) · Neurocomputing · doi:10.1016/0925-2312(95)90020-9 · Cited by 1,857
Rainbow: Combining Improvements in Deep Reinforcement Learning
Hessel, M., Modayil, J., Van Hasselt, H., Schaul, T., Ostrovski, G., Dabney, W., Horgan, D., Piot, B., Azar, M., & Silver, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11796 · Cited by 1,846
2011 International Joint Conference on Neural Networks
(2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2102870 · Cited by 1,767
Deep Reinforcement Learning That Matters
Henderson, P., Islam, R., Bachman, P., Pineau, J., Precup, D., & Meger, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11694 · Cited by 1,685
Stochastic optimal control : the discrete time case
Bertsekas, D. P., & Shreve, S. E. (2007) · Cited by 1,654
Self-improving reactive agents based on reinforcement learning, planning and teaching
Lin, L.-J. (1992) · Machine Learning · doi:10.1007/bf00992699 · Cited by 1,564
Reinforcement learning and adaptive dynamic programming for feedback control
Lewis, F. L., & Vrabie, D. (2009) · IEEE Circuits and Systems Magazine · doi:10.1109/mcas.2009.933854 · Cited by 1,558
On-line Q-learning Using Connectionist Systems
Rummery, G. A. (1994) · Cited by 1,477
Neuro-Dynamic Programming: NDP
Bertsekas, D. P. (2001) · Encyclopedia of Optimization · doi:10.1007/0-306-48332-7_333 · Cited by 1,466
Predictive Control for Linear and Hybrid Systems
Borrelli, F., Bemporad, A., & Morari, M. (2017) · Cambridge University Press eBooks · doi:10.1017/9781139061759 · Cited by 1,443
Regret Analysis of Stochastic and Nonstochastic Multi-armed Bandit Problems
Bubeck, S. (2012) · now publishers, Inc. eBooks · doi:10.1561/9781601986276 · Cited by 1,404
Andrychowicz, M., Wolski, F., Ray, A., Schneider, J., Fong, R., Welinder, P., McGrew, B., Tobin, J., Abbeel, P., & Zaremba, W. (2017) · arXiv · doi:10.48550/arxiv.1707.01495 · Cited by 1,355
Slow Feature Analysis: Unsupervised Learning of Invariances
Wiskott, L., & Sejnowski, T. J. (2002) · Neural Computation · doi:10.1162/089976602317318938 · Cited by 1,350
End-to-End Training of Deep Visuomotor Policies
Levine, S., Finn, C., Darrell, T. J., & Abbeel, P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.00702 · Cited by 1,344
Nonlinear Model Predictive Control
Grüne, L., & Pannek, J. (2011) · Communications and Control Engineering · doi:10.1007/978-0-85729-501-9 · Cited by 1,308
Regret Analysis of Stochastic and Nonstochastic Multi-armed Bandit Problems
Bubeck, S., & Cesa-Bianchi, N. (2012) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000024 · Cited by 1,295
Gradient Flow in Recurrent Nets: The Difficulty of Learning LongTerm Dependencies
(2009) · A Field Guide to Dynamical Recurrent Networks · doi:10.1109/9780470544037.ch14 · Cited by 1,246
Hogwild: A Lock-Free Approach to Parallelizing Stochastic Gradient Descent
Niu, F., Recht, B., Re, C., & Wright, S. J. (2011) · arXiv · doi:10.48550/arxiv.1106.5730 · Cited by 1,211
An analysis of temporal-difference learning with function approximation
Tsitsiklis, J. N., & Van Roy, B. (1997) · IEEE Transactions on Automatic Control · doi:10.1109/9.580874 · Cited by 1,194
Artificial intelligence and statistics
Wiggins, L. L. (1989) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(89)90027-6 · Cited by 1,117
(2012) · IEEE Control Systems · doi:10.1109/mcs.2012.2214134 · Cited by 1,105
Jiang, Y., & Jiang, Z.-P. (2012) · Automatica · doi:10.1016/j.automatica.2012.06.096 · Cited by 1,072
Algorithms for Reinforcement Learning
Szepesvári, C. (2010) · Synthesis Lectures on Artificial Intelligence and Machine Learning · doi:10.1007/978-3-031-01551-9 · Cited by 1,049
A Survey of Actor-Critic Reinforcement Learning: Standard and Natural Policy Gradients
Grondman, I., Busoniu, L., Lopes, G. A. D., & Babuska, R. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2012.2218595 · Cited by 1,042
Recent Advances in Hierarchical Reinforcement Learning
Barto, A. G., & Mahadevan, S. (2003) · Discrete Event Dynamic Systems · doi:10.1023/a:1022140919877 · Cited by 1,024
Reinforcement Learning and Dynamic Programming Using Function Approximators
Busoniu, L., Babuska, R., De Schutter, B., & Ernst, D. (2017) · CRC Press eBooks · doi:10.1201/9781439821091 · Cited by 919
Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks
Salimans, T., & Kingma, D. P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.07868 · Cited by 883
Olah, C., Mordvintsev, A., & Schubert, L. (2017) · Distill · doi:10.23915/distill.00007 · Cited by 880
Tree-Based Batch Mode Reinforcement Learning
Ernst, D., Geurts, P., & Wehenkel, L. A. (2005) · doi:10.5555/1046920.1088690 · Cited by 854
Prioritized sweeping: Reinforcement learning with less data and less time
Moore, A. W., & Atkeson, C. G. (1993) · Machine Learning · doi:10.1007/bf00993104 · Cited by 823
Real-time optimization by extremum-seeking control
(2004) · Choice Reviews Online · doi:10.5860/choice.41-4064 · Cited by 822
A Survey on Policy Search for Robotics
Deisenroth, M. P. (2011) · Foundations and Trends in Robotics · doi:10.1561/2300000021 · Cited by 798
Near-optimal Regret Bounds for Reinforcement Learning
Jaksch, T., Ortner, R., & Auer, P. L. (2010) · Cited by 784
Kakade, S. M. (2001) · ScholarlyCommons (University of Pennsylvania) · Cited by 775
On the Convergence of Stochastic Iterative Dynamic Programming Algorithms
Jaakkola, T., Jordan, M. I., & Singh, S. P. (1994) · Neural Computation · doi:10.1162/neco.1994.6.6.1185 · Cited by 770
Deep Reinforcement Learning: An Overview
Li, Y. (2017) · arXiv · doi:10.48550/arxiv.1701.07274 · Cited by 762
Riedmiller, M. (2005) · Lecture Notes in Computer Science · doi:10.1007/11564096_32 · Cited by 757
Peters, J., & Schaal, S. (2008) · Neurocomputing · doi:10.1016/j.neucom.2007.11.026 · Cited by 738
The Loss Surfaces of Multilayer Networks
Choromanska, A., Henaff, M., Mathieu, M., Arous, G. B., & LeCun, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.0233 · Cited by 733
Konda, V. R., & Tsitsiklis, J. N. (2003) · SIAM Journal on Control and Optimization · doi:10.1137/s0363012901385691 · Cited by 709
Universal Value Function Approximators
Schaul, T., Horgan, D., Gregor, K., & Silver, D. (2015) · Cited by 701
Improving generalization for temporal difference learning: The successor representation
Dayan, P. (1993) · Neural Computation · doi:10.1162/neco.1993.5.4.613 · Cited by 693
Reinforcement Learning: State-of-the-Art
(2012) · Adaptation, Learning, and Optimization · doi:10.1007/978-3-642-27645-3 · Cited by 691
The Linear Programming Approach to Approximate Dynamic Programming
de Farias, D. P., & Van Roy, B. (2003) · Operations Research · doi:10.1287/opre.51.6.850.24925 · Cited by 687
Approximate dynamic programming: solving the curses of dimensionality
Pardalos, P. M. (2009) · Optimization Methods and Software · doi:10.1080/10556780802583108 · Cited by 666
Zhang, H., Cui, L., Zhang, X., & Luo, Y. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2011.2168538 · Cited by 643
Tools for Semiglobal Stabilization by Partial State and Output Feedback
Teel, A., & Praly, L. (1995) · SIAM Journal on Control and Optimization · doi:10.1137/s0363012992241430 · Cited by 642
Approximately Optimal Approximate Reinforcement Learning
Kakade, S. M., & Langford, J. C. (2002) · Cited by 617
On the Expressive Power of Deep Neural NetworksPreprint
Raghu, M., Poole, B., Kleinberg, J. M., Ganguli, S., & Sohl‐Dickstein, J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.05336 · Cited by 611
Convergence Results for Single-Step On-Policy Reinforcement-Learning Algorithms
Singh, S., Jaakkola, T., Littman, M. L., & Szepesvári, C. (2000) · Machine Learning · doi:10.1023/a:1007678930559 · Cited by 609
Linear Least-Squares algorithms for temporal difference learning
Bradtke, S. J., & Barto, A. G. (1996) · Machine Learning · doi:10.1007/bf00114723 · Cited by 599
Levine, S., & Koltun, V. (2013) · Cited by 586
Reinforcement learning with replacing eligibility traces
Singh, S. P., & Sutton, R. S. (1996) · Machine Learning · doi:10.1007/bf00114726 · Cited by 575
Modares, H., Lewis, F. L., & Jiang, Z. (2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2441749 · Cited by 570
Natural actor–critic algorithms
Bhatnagar, S., Sutton, R. S., Ghavamzadeh, M., & Lee, M. (2009) · Automatica · doi:10.1016/j.automatica.2009.07.008 · Cited by 559
Nonlinear Model Predictive Control
Grüne, L., & Pannek, J. (2017) · Communications and Control Engineering · doi:10.1007/978-3-319-46024-6 · Cited by 527
Infinite-Horizon Policy-Gradient Estimation
Baxter, J., & Bartlett, P. L. (2001) · Cited by 525
A Lyapunov Function for Economic Optimizing Model Predictive Control
Diehl, M., Amrit, R., & Rawlings, J. B. (2010) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2010.2101291 · Cited by 513
Calculus of Variations and Optimal Control Theory: A Concise Introduction
Liberzon, D. (2012) · Cited by 483
Stable Function Approximation in Dynamic Programming
Gordon, G. J. (1995) · Machine Learning Proceedings 1995 · doi:10.1016/b978-1-55860-377-6.50040-2 · Cited by 446
Ba, J. L., Kiros, J., & Hinton, G. E. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.06450 · Cited by 440
Eligibility Traces for Off-Policy Policy Evaluation
Precup, D., Sutton, R. S., & Singh, S. P. (2000) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 439
Deep spatial autoencoders for visuomotor learning
Finn, C., Tan, X. Y., Duan, Y., Darrell, T., Levine, S., & Abbeel, P. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487173 · Cited by 430
Safe and Efficient Off-Policy Reinforcement LearningPreprint
Munos, R., Stepleton, T., Harutyunyan, A., & Bellemare, M. G. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.02647 · Cited by 395
Intrinsically Motivated Learning in Natural and Artificial Systems
(2013) · Springer eBooks · doi:10.1007/978-3-642-32375-1 · Cited by 379
FOR LEAST-SQUARES POLICY ITERATION
Schwab, D. (2016) · Cited by 372
Kernel-Based Reinforcement Learning
(2017) · Encyclopedia of Machine Learning and Data Mining · doi:10.1007/978-1-4899-7687-1_100235 · Cited by 367
Dynamic Programming and Suboptimal Control: A Survey from ADP to MPC*
Bertsekas, D. P. (2005) · European Journal of Control · doi:10.3166/ejc.11.310-334 · Cited by 366
Reinforcement Learning Algorithm for Partially Observable Markov Decision Problems
Jaakkola, T., Singh, S. P., & Jordan, M. I. (1994) · Cited by 361
Infinite-Horizon Policy-Gradient Estimation
Baxter, J., & Bartlett, P. L. (2001) · Journal of Artificial Intelligence Research · doi:10.1613/jair.806 · Cited by 343
Adaptive Control: Algorithms, Analysis and Applications
Landau, I. D., Lozano, R., M'Saad, M., & Karimi, A. (2011) · Communications and Control Engineering · doi:10.1007/978-0-85729-664-1 · Cited by 336
Reinforcement learning with Gaussian processes
Engel, Y., Mannor, S., & Meir, R. (2005) · Proceedings of the 22nd international conference on Machine learning - ICML '05 · doi:10.1145/1102351.1102377 · Cited by 335
Reinforcement Learning: A Tutorial Survey and Recent Advances
Gosavi, A. (2009) · INFORMS Journal on Computing · doi:10.1287/ijoc.1080.0305 · Cited by 326
Variable Resolution Discretization in Optimal Control
Munos, R., & Moore, A. (2002) · Machine Learning · doi:10.1023/a:1017992615625 · Cited by 321
Recent Advances in Hierarchical Reinforcement Learning
Barto, A. G., & Mahadevan, S. (2003) · Discrete Event Dynamic Systems · doi:10.1023/a:1025696116075 · Cited by 317
Successor Features for Transfer in Reinforcement Learning
Barreto, A. D. M. S., Dabney, W., Munos, R., Hunt, J. J., Schaul, T., Silver, D., & van Hasselt, H. P. (2016) · arXiv (Cornell University) · doi:10.13140/rg.2.2.35439.18085 · Cited by 305
Variance Reduction Techniques for Gradient Estimates in Reinforcement Learning
Greensmith, E., Bartlett, P. L., & Baxter, J. (2004) · doi:10.5555/1005332.1044710 · Cited by 300
Teel, A. R., & Praly, L. (2000) · ESAIM Control Optimisation and Calculus of Variations · doi:10.1051/cocv:2000113 · Cited by 298
Adaptive Control: Algorithms, Analysis and Applications
Landau, I. D., Lozano, R., M’Saad, M., & Karimi, A. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2406.07073 · Cited by 291
Function Optimization using Connectionist Reinforcement Learning Algorithms
WILLIAMS, R. J., & PENG, J. (1991) · Connection Science · doi:10.1080/09540099108946587 · Cited by 288
Deep reinforcement learning with successor features for navigation across similar environments
Zhang, J., Springenberg, J. T., Boedecker, J., & Burgard, W. (2017) · 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8206049 · Cited by 278
Unifying Count-Based Exploration and Intrinsic Motivation
Bellemare, M. G., Srinivasan, S., Ostrovski, G., Schaul, T., Saxton, D., & Munos, R. (2016) · arXiv · doi:10.48550/arxiv.1606.01868 · Cited by 264
Reinforcement Learning Methods for Continuous-Time Markov Decision Problems
Bradtke, S. J., & Duff, M. O. (1994) · Cited by 263
Model predictive control: for want of a local control Lyapunov function, all is not lost
Grimm, G., Messina, M. J., Tuna, S. E., & Teel, A. R. (2005) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2005.847055 · Cited by 262
Efficient Exploration in Reinforcement Learning
(2012) · SpringerReference · doi:10.1007/springerreference_178956 · Cited by 257
Kernel-Based Reinforcement Learning
Ormoneit, D., & Sen, Ś. (2002) · Machine Learning · doi:10.1023/a:1017928328829 · Cited by 255
Finite-Time Bounds for Fitted Value Iteration
Munos, R., & Szepesvári, C. (2008) · Cited by 234
Bayesian Reinforcement Learning: A Survey
Ghavamzadeh, M., Mannor, S., Pineau, J., & Tamar, A. (2015) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000049 · Cited by 234
Munos, R. (2014) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000038 · Cited by 233
Optimal Adaptive Policies for Markov Decision Processes
Burnetas, A. N., & Katehakis, M. N. (1997) · Mathematics of Operations Research · doi:10.1287/moor.22.1.222 · Cited by 232
Reinforcement learning in feedback control: Challenges and benchmarks from technical process control
Hafner, R., & Riedmiller, M. (2011) · Machine Learning · doi:10.1007/s10994-011-5235-x · Cited by 214
Reinforcement Learning Versus Model Predictive Control: A Comparison on a Power System Problem
Ernst, D., Glavic, M., Capitanescu, F., & Wehenkel, L. (2009) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2008.2007630 · Cited by 214
Intrinsic Motivation and Reinforcement Learning
Barto, A. G. (2013) · Intrinsically Motivated Learning in Natural and Artificial Systems · doi:10.1007/978-3-642-32375-1_2 · Cited by 211
Near-optimal Regret Bounds for Reinforcement Learning
(2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1859902 · Cited by 207
Autonomous reinforcement learning on raw visual input data in a real world application
Lange, S., Riedmiller, M., & Voigtlander, A. (2012) · The 2012 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2012.6252823 · Cited by 202
The Curse of Highly Variable Functions for Local Kernel Machines
Bengio, Y., Delalleau, O., & Roux, N. L. (2005) · Cited by 193
Sample Efficient Actor-Critic with Experience Replay
Wang, Z., Bapst, V., Heess, N., Mnih, V., Munos, R., Kavukcuoglu, K., & de Freitas, N. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01224 · Cited by 192
Reinforcement Learning: State-of-the-Art
Nowé, A., Vrancx, P., & Hauwere, Y.-M. D. (2012) · Cited by 189
Actor-Mimic: Deep Multitask and Transfer Reinforcement Learning
Parisotto, E., Ba, J. L., & Salakhutdinov, R. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.06342 · Cited by 186
Loss is its own Reward: Self-Supervision for Reinforcement LearningPreprint
Shelhamer, E., Mahmoudieh, P., Argus, M. J., & Darrell, T. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.07307 · Cited by 182
Learning state representations with robotic priors
Jonschkowski, R., & Brock, O. (2015) · Autonomous Robots · doi:10.1007/s10514-015-9459-7 · Cited by 158
Amari, S., & Douglas, S. C. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.1998.675489 · Cited by 157
The Mirage of Action-Dependent Baselines in Reinforcement LearningPreprint
Tucker, G., Bhupatiraju, S., Gu, S., Turner, R. E., Ghahramani, Z., & Levine, S. (2018) · International Conference on Machine Learning · doi:10.48550/arxiv.1802.10031 · Cited by 156
Surprise-Based Intrinsic Motivation for Deep Reinforcement Learning
Achiam, J., & Sastry, S. (2017) · arXiv · doi:10.48550/arxiv.1703.01732 · Cited by 139
Relations between Model Predictive Control and Reinforcement Learning
Görges, D. (2017) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2017.08.747 · Cited by 139
A Bayesian Approach for Learning and Planning in Partially Observable Markov Decision Processes
Ross, S., Pineau, J., Chaib-draa, B., & Kreitmann, P. (2011) · Journal of Machine Learning Research · doi:10.5555/1953048.2021055 · Cited by 132
Evolving large-scale neural networks for vision-based reinforcement learning
Koutník, J., Cuccu, G., Schmidhuber, J., & Gomez, F. (2013) · Proceedings of the 15th annual conference on Genetic and evolutionary computation · doi:10.1145/2463372.2463509 · Cited by 130
Integrating State Representation Learning Into Deep Reinforcement Learning
de Bruin, T., Kober, J., Tuyls, K., & Babuška, R. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2800101 · Cited by 122
Self-citationStability Analysis of Discrete-Time Infinite-Horizon Optimal Control With Discounted Cost
Postoyan, R., Buşoniu, L., Nešić, D., & Daafouz, J. (2016) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2016.2616644 · Cited by 116
Self-citationGu, S., Lillicrap, T., Zoubin Ghahramani, A., Turner, R. E., Schölkopf, B., & Levine, S. (2017) · Cambridge University Engineering Department Publications Database · doi:10.17863/cam.21291 · Cited by 111
Farahmand, A. M., Ghavamzadeh, M., Mannor, S., & Szepesvári, C. (2008) · Cited by 110
Convergence Results for Some Temporal Difference Methods Based on Least Squares
Yu, H., & Bertsekas, D. P. (2009) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2009.2022097 · Cited by 105
Learning values across many orders of magnitudePreprint
van Hasselt, H. P., Guez, A., Hessel, M., Mnih, V., & Silver, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.07714 · Cited by 104
Yang, X., Liu, D., & Wei, Q. (2014) · IET Control Theory and Applications · doi:10.1049/iet-cta.2014.0186 · Cited by 89
Reinforcement Learning Through Gradient Descent
Baird, L. C. (2018) · doi:10.1184/r1/6560651 · Cited by 85
Algorithmic Survey of Parametric Value Function Approximation
Geist, M., & Pietquin, O. (2013) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2247418 · Cited by 80
Robust reinforcement learning control with static and dynamic stability
Kretchmar, R. M., Young, P. M., Anderson, C. W., Hittle, D. C., Anderson, M. L., & Delnero, C. C. (2001) · International Journal of Robust and Nonlinear Control · doi:10.1002/rnc.670 · Cited by 70
Learning Visual Servoing with Deep Features and Fitted Q-IterationPreprint
Lee, A. X., Levine, S., & Abbeel, P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.11000 · Cited by 68
Bandit-Based Planning and Learning in Continuous-Action Markov Decision Processes
Weinstein, A., & Littman, M. L. (2012) · Proceedings of the International Conference on Automated Planning and Scheduling · doi:10.1609/icaps.v22i1.13507 · Cited by 67
Regularized policy iteration with nonparametric function spaces
Farahmand, A., Ghavamzadeh, M., Szepesvári, C., & Mannor, S. (2016) · PolyPublie (École Polytechnique de Montréal) · doi:10.5555/2946645.3007092 · Cited by 64
PVEs: Position-Velocity Encoders for Unsupervised Learning of Structured State RepresentationsPreprint
Jonschkowski, R., Hafner, R., Scholz, J., & Riedmiller, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.09805 · Cited by 62
Experience Selection in Deep Reinforcement Learning for Control
de Bruin, T., Kober, J., Tuyls, K., & Babuška, R. (2018) · Research Repository (Delft University of Technology) · doi:10.5555/3291125.3291134 · Cited by 56
Self-citationIncreasing the Action Gap: New Operators for Reinforcement Learning
Bellemare, M. G., Ostrovski, G., Guez, A., Thomas, P. S., & Munos, R. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10303 · Cited by 43
Approximate Value Iteration with Temporally Extended Actions
Mann, T., Mannor, S., & Precup, D. (2015) · Journal of Artificial Intelligence Research · doi:10.1613/jair.4676 · Cited by 33
Advancing systems and control research in the era of ML and AI
Khargonekar, P. P., & Dahleh, M. A. (2018) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2018.04.001 · Cited by 33
Optimal self-triggering for nonlinear systems via Approximate Dynamic Programming
Tolić, D., Fierro, R., & Ferrari, S. (2012) · The proceedings of the IEEE Conference on Control Applications/The proceedings of the ... IEEE Conference on Control Applications · doi:10.1109/cca.2012.6402727 · Cited by 21
Self-citationAdaptive Confidence And Adaptive Curiosity
Schmidhuber, J., & Informatik, M. T. U. (. I. F. (1991) · Cited by 18
Friedrich, S. R., & BUSS, M. J. (2017) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2017.7989382 · Cited by 14
Learning Suboptimal Broadcasting Intervals in Multi-Agent Systems
Tolić, D., & Palunko, I. (2017) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2017.08.802 · Cited by 4
Self-citation
Cited by
A review On reinforcement learning: Introduction and applications in industrial process control
Nian, R., Liu, J., & Huang, B. (2020) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2020.106886 · Cited by 711
Reinforcement learning algorithms: A brief survey
Shakya, A. K., Pillai, G., & Chakrabarty, S. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.120495 · Cited by 656
Model-Based Control of Soft Robots: A Survey of the State of the Art and Open Challenges
Della Santina, C., Duriez, C., & Rus, D. (2023) · IEEE Control Systems · doi:10.1109/mcs.2023.3253419 · Cited by 402
Reinforcement Learning – Overview of recent progress and implications for process control
Shin, J., Badgwell, T. A., Liu, K.-H., & Lee, J. H. (2019) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2019.05.029 · Cited by 310
Deep reinforcement learning for automated stock trading: an ensemble strategy
Yang, H., Liu, X.-Y., Zhong, S., & Walid, A. (2020) · Proceedings of the First ACM International Conference on AI in Finance · doi:10.1145/3383455.3422540 · Cited by 196
“In contrast with DQN that learns indirectly through Q-values tables and suffers the curse of dimensionality problem [40], DDPG learns directly from the observations through policy gradient.”
Metadata
- Authors
- Buşoniu, L., de Bruin, T., Tolić, D., Kober, J., & Palunko, I.
- Venue
- Annual Reviews in Control
- Publisher
- Elsevier BV
- Published
- 2018
- Volume
- 46
- Pages
- 8-28
- ISSN
- 1367-5788 (ISSN-L)
- OpenAlex
- W2897661175
- Cited by
- 463
- References
- 168
- FWCI
- 17.54
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.