Computational adaptive optimal control for continuous-time linear systems with completely unknown dynamics

Reinforcement Learning: An Introduction

Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225

Reinforcement Learning: An Introduction

(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496

Nonlinear and adaptive control design

Krstić, M., Kokotović, P. V., & Kanellakopoulos, I. (1995) · Cited by 10,421

Robust adaptive control

Ioannou, P., & Sun, J. (1995) · Medical Entomology and Zoology · doi:10.1109/acc.1984.4171550 · Cited by 5,663

Learning from Delayed Rewards

Watkins, C. (1989) · OpenGrey (Institut de l'Information Scientifique et Technique) · doi:10.17863/cam.132164 · Cited by 5,297

Optimal Control

Lewis, F. L. (1986) · Cited by 2,948

Beyond regression : new fools for prediction and analysis in the behavioral sciences

Werbos, P. J. (1974) · Medical Entomology and Zoology · Cited by 2,739

Online actor–critic algorithm to solve the continuous-time infinite horizon optimal control problem

Vamvoudakis, K. G., & Lewis, F. L. (2010) · Automatica · doi:10.1016/j.automatica.2010.02.018 · Cited by 1,703

Reinforcement learning and adaptive dynamic programming for feedback control

Lewis, F. L., & Vrabie, D. (2009) · IEEE Circuits and Systems Magazine · doi:10.1109/mcas.2009.933854 · Cited by 1,558

Adaptive Control Design and Analysis

Tao, G. (2003) · Wiley eBooks · doi:10.1002/0471459100 · Cited by 1,438

Small-gain theorem for ISS systems and applications

Jiang, Z. P., Teel, A. R., & Praly, L. (1994) · Mathematics of Control, Signals, and Systems · doi:10.1007/bf01211469 · Cited by 1,366

On an iterative technique for Riccati equation computations

Kleinman, D. (1968) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1968.1098829 · Cited by 1,210

Reinforcement Learning in Continuous Time and Space

Doya, K. (2000) · Neural Computation · doi:10.1162/089976600300015961 · Cited by 960

Adaptive optimal control for continuous-time linear systems based on policy iteration

Vrabie, D., Pastravanu, O., Abu-Khalaf, M., & Lewis, F. L. (2009) · Automatica · doi:10.1016/j.automatica.2008.08.017 · Cited by 949

Adaptive Dynamic Programming: An Introduction

Wang, F.-Y., Zhang, H., & Liu, D. (2009) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2009.932261 · Cited by 898

Adaptive dynamic programming

Murray, J. J., Cox, C. J., Lendaris, G. G., & Saeks, R. (2002) · IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2002.801727 · Cited by 677

Neural network approach to continuous-time direct adaptive optimal control for partially unknown nonlinear systems

Vrabie, D., & Lewis, F. (2009) · Neural Networks · doi:10.1016/j.neunet.2009.03.008 · Cited by 634

Adaptive Neural Network Control of Robotic Manipulators

Ge, S. S., Lee, T. H., & Harris, C. J. (1998) · World Scientific Series in Robotics and Intelligent Systems · doi:10.1142/3774 · Cited by 618

Model-free Q-learning designs for linear discrete-time zero-sum games with application to H-infinity control

Al-Tamimi, A., Lewis, F. L., & Abu-Khalaf, M. (2007) · Automatica · doi:10.1016/j.automatica.2006.09.019 · Cited by 611

Reinforcement Learning for Partially Observable Dynamic Processes: Adaptive Dynamic Programming Using Measured Output Data

Lewis, F. L., & Vamvoudakis, K. G. (2011) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2010.2043839 · Cited by 544

Multi-player non-zero-sum games: Online adaptive learning solution of coupled Hamilton–Jacobi equations

Vamvoudakis, K. G., & Lewis, F. L. (2011) · Automatica · doi:10.1016/j.automatica.2011.03.005 · Cited by 525

An iterative adaptive dynamic programming method for solving a class of nonlinear zero-sum differential games

Zhang, H., Wei, Q., & Liu, D. (2011) · Automatica · doi:10.1016/j.automatica.2010.10.033 · Cited by 409

Adaptive linear quadratic control using policy iteration

Bradtke, S. J., Ydstie, B. E., & Barto, A. G. (2005) · Proceedings of 1994 American Control Conference - ACC '94 · doi:10.1109/acc.1994.735224 · Cited by 404

Neural networks for control and system identification

Werbos, P. J. (2003) · Proceedings of the 28th IEEE Conference on Decision and Control · doi:10.1109/cdc.1989.70114 · Cited by 319

Stochastic optimal control of unknown linear networked control system in the presence of random delays and packet losses

Xu, H., Jagannathan, S., & Lewis, F. L. (2012) · Automatica · doi:10.1016/j.automatica.2012.03.007 · Cited by 230

Adaptive Systems

Mareels, I., & Polderman, J. W. (1996) · Birkhäuser Boston eBooks · doi:10.1007/978-0-8176-8142-5 · Cited by 189

Intelligence in the brain: A theory of how it works and how to build it

Werbos, P. J. (2009) · Neural Networks · doi:10.1016/j.neunet.2009.03.012 · Cited by 186

Reinforcement learning in continuous time: advantage updating

Baird, L. C. (1994) · Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94) · doi:10.1109/icnn.1994.374604 · Cited by 177

Model-free multiobjective approximate dynamic programming for discrete-time nonlinear systems with general performance index functions

Wei, Q., Zhang, H., & Dai, J. (2008) · Neurocomputing · doi:10.1016/j.neucom.2008.05.012 · Cited by 101

Stable adaptive control using new critic designs

Werbos, P. J. (1999) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.343068 · Cited by 69

Asymptotic tracking by a reinforcement learning-based adaptive critic controller

Bhasin, S., Sharma, N., Patre, P. M., & Dixon, W. E. (2011) · Journal of Control Theory and Applications · doi:10.1007/s11768-011-0170-8 · Cited by 50

Robust approximate dynamic programming and global stabilization with nonlinear dynamic uncertainties

Jiang, Y., & Jiang, Z. (2011) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2011.6160279 · Cited by 21

Formulas for Data-Driven Control: Stabilization, Optimality, and Robustness

De Persis, C., & Tesi, P. (2020) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2019.2959924 · Cited by 983

Optimal and Autonomous Control Using Reinforcement Learning: A Survey

Kiumarsi, B., Vamvoudakis, K. G., Modares, H., & Lewis, F. L. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2773458 · Cited by 891

Adaptive Dynamic Programming for Control: A Survey and Recent Advances

Liu, D., Xue, S., Zhao, B., Luo, B., & Wei, Q. (2021) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2020.3042876 · Cited by 708

Adaptive Optimal Control of Unknown Constrained-Input Systems Using Policy Iteration and Neural Networks

Modares, H., Lewis, F. L., & Naghibi-Sistani, M.-B. (2013) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2276571 · Cited by 462

Reinforcement-Learning-Based Robust Controller Design for Continuous-Time Uncertain Nonlinear Systems Subject to Input Constraints

Liu, D., Yang, X., Wang, D., & Wei, Q. (2015) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2015.2417170 · Cited by 440