The DOI matches its Crossref record; 176 of the 176 references it cites were found in a registry or an index.
Adaptive Critic Nonlinear Robust Control: A Survey
Open accessAbstract
Adaptive dynamic programming (ADP) and reinforcement learning are quite relevant to each other when performing intelligent optimization. They are both regarded as promising methods involving important components of evaluation and improvement, at the background of information technology, such as artificial intelligence, big data, and deep learning. Although great progresses have been achieved and surveyed when addressing nonlinear optimal control problems, the research on robustness of ADP-based control strategies under uncertain environment has not been fully summarized. Hence, this survey reviews the recent main results of adaptive-critic-based robust control design of continuous-time nonlinear systems. The ADP-based nonlinear optimal regulation is reviewed, followed by robust stabilization of nonlinear systems with matched uncertainties, guaranteed cost control design of unmatched plants, and decentralized stabilization of interconnected systems. Additionally, further comprehensive discussions are presented, including event-based robust control design, improvement of the critic learning rule, nonlinear H∞control design, and several notes on future perspectives. By applying the ADP-based optimal and robust control methods to a practical power system and an overhead crane plant, two typical examples are provided to verify the effectiveness of theoretical results. Overall, this survey is beneficial to promote the development of adaptive critic control methods with robustness guarantee and the construction of higher level intelligent systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Neural Networks: A Comprehensive Foundation
Haykin, S. (1998) · Cited by 30,070
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Bellman, R. E. (2010) · doi:10.1515/9781400835386 · Cited by 14,588
Nonlinear and adaptive control design
Krstić, M., Kokotović, P. V., & Kanellakopoulos, I. (1995) · Cited by 10,421
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Event-Triggered Real-Time Scheduling of Stabilizing Control Tasks
Tabuada, P. (2007) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2007.904277 · Cited by 4,702
(2012) · Encyclopedia of the Sciences of Learning · doi:10.1007/978-1-4419-1428-6_5086 · Cited by 3,515
Beyond regression : new fools for prediction and analysis in the behavioral sciences
Werbos, P. J. (1974) · Medical Entomology and Zoology · Cited by 2,739
Lewis, F. L., Vrabie, D. L., & Syrmos, V. L. (2012) · doi:10.1002/9781118122631 · Cited by 2,020
Neural Network Control Of Robot Manipulators And Non-Linear Systems
Lewis, F. W., Jagannathan, S., & Yesildirak, A. (2020) · CRC Press eBooks · doi:10.1201/9781003062714 · Cited by 1,867
Online actor–critic algorithm to solve the continuous-time infinite horizon optimal control problem
Vamvoudakis, K. G., & Lewis, F. L. (2010) · Automatica · doi:10.1016/j.automatica.2010.02.018 · Cited by 1,703
Reinforcement learning and adaptive dynamic programming for feedback control
Lewis, F. L., & Vrabie, D. (2009) · IEEE Circuits and Systems Magazine · doi:10.1109/mcas.2009.933854 · Cited by 1,558
From model-based control to data-driven control: Survey, classification and perspective
Hou, Z.-S., & Wang, Z. (2013) · Information Sciences · doi:10.1016/j.ins.2012.07.014 · Cited by 1,405
Small-gain theorem for ISS systems and applications
Jiang, Z. P., Teel, A. R., & Praly, L. (1994) · Mathematics of Control, Signals, and Systems · doi:10.1007/bf01211469 · Cited by 1,366
Abu-Khalaf, M., & Lewis, F. L. (2005) · Automatica · doi:10.1016/j.automatica.2004.11.034 · Cited by 1,349
Big data deep learning: Challenges and perspectives
Chen, X.-W., & Lin, X. (2014) · IEEE Access · doi:10.1109/access.2014.2325029 · Cited by 1,255
Prokhorov, D. V., & Wunsch, D. C. (1997) · IEEE Transactions on Neural Networks · doi:10.1109/72.623201 · Cited by 1,186
Deep Machine Learning - A New Frontier in Artificial Intelligence Research [Research Frontier]
Arel, I., Rose, D. C., & Karnowski, T. P. (2010) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2010.938364 · Cited by 1,121
(2012) · IEEE Control Systems · doi:10.1109/mcs.2012.2214134 · Cited by 1,105
Discrete-Time Nonlinear HJB Solution Using Approximate Dynamic Programming: Convergence Proof
Al-Tamimi, A., Lewis, F. L., & Abu-Khalaf, M. (2008) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2008.926614 · Cited by 1,075
Jiang, Y., & Jiang, Z.-P. (2012) · Automatica · doi:10.1016/j.automatica.2012.06.096 · Cited by 1,072
H/sup ∞/-0ptimal Control and Related Minimax Design Problems: A Dynamic Game Approach
Basar, T., & Bernhard, P. (1996) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1996.536519 · Cited by 1,047
H∞-Optimal Control and Related Minimax Design Problems
Başar, T., & Bernhard, P. (2008) · Birkhäuser Boston eBooks · doi:10.1007/978-0-8176-4757-5 · Cited by 1,043
Approximate dynamic programming for real-time control and neural modeling
Werbos, P. J. (1992) · Medical Entomology and Zoology · Cited by 971
(2011) · Encyclopedia of Machine Learning · doi:10.1007/978-0-387-30164-8_588 · Cited by 950
Reinforcement Learning and Dynamic Programming Using Function Approximators
Busoniu, L., Babuska, R., De Schutter, B., & Ernst, D. (2017) · CRC Press eBooks · doi:10.1201/9781439821091 · Cited by 919
Adaptive Dynamic Programming: An Introduction
Wang, F.-Y., Zhang, H., & Liu, D. (2009) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2009.932261 · Cited by 898
Self-citationA survey of machine learning for big data processing
Qiu, J., Wu, Q., Ding, G., Xu, Y., & Feng, S. (2016) · EURASIP Journal on Advances in Signal Processing · doi:10.1186/s13634-016-0355-x · Cited by 894
Handbook of Learning and Approximate Dynamic Programming
Si, J., Barto, A. G., Powell, W. B., & Wunsch, D. (2004) · Institute of Electrical and Electronics Engineers eBooks · doi:10.1109/9780470544785 · Cited by 856
Adaptive Neural Impedance Control of a Robotic Manipulator With Input Saturation
He, W., Dong, Y., & Sun, C. (2016) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2015.2429555 · Cited by 790
Online learning control by association and reinforcement
Si, J., & Wang, Y.-T. (2001) · IEEE Transactions on Neural Networks · doi:10.1109/72.914523 · Cited by 773
Modares, H., & Lewis, F. L. (2014) · Automatica · doi:10.1016/j.automatica.2014.05.011 · Cited by 701
Data-Driven Model-Free Adaptive Control for a Class of MIMO Nonlinear Discrete-Time Systems
Hou, Z., & Jin, S. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2011.2176141 · Cited by 685
Murray, J. J., Cox, C. J., Lendaris, G. G., & Saeks, R. (2002) · IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2002.801727 · Cited by 677 · cited 2×
“Among them, complex industrial systems, such as power systems [30], [44], [67], [84], [129]–[133], [158], [181]–[186], mechanical systems [32], [36], [41], [44], [71], [123], [125], [131], [187], [188], and intelligent transportation systems [189], [190] are the most common application areas.”
BackgroundGalerkin approximations of the generalized Hamilton-Jacobi-Bellman equation
Beard, R. W., Saridis, G. N., & Wen, J. T.-Y. (1997) · Automatica · doi:10.1016/s0005-1098(97)00128-3 · Cited by 667
Zhang, H., Luo, Y., & Liu, D. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2009.2027233 · Cited by 649
Self-citationZhang, H., Cui, L., Zhang, X., & Luo, Y. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2011.2168538 · Cited by 643
Bhasin, S., Kamalapurkar, R., Johnson, M., Vamvoudakis, K. G., Lewis, F. L., & Dixon, W. E. (2013) · Automatica · doi:10.1016/j.automatica.2012.09.019 · Cited by 642
Vrabie, D., & Lewis, F. (2009) · Neural Networks · doi:10.1016/j.neunet.2009.03.008 · Cited by 634
Pandey, S. K., Mohanty, S. R., & Kishor, N. (2013) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2013.04.029 · Cited by 561
Zhang, H., Zhang, J., Yang, G.-H., & Luo, Y. (2015) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2014.2310238 · Cited by 519
Adaptive Dynamic Programming with Applications in Optimal Control
Liu, D., Wei, Q., Wang, D., Yang, X., & Li, H. (2017) · Advances in industrial control · doi:10.1007/978-3-319-50815-3 · Cited by 491
Self-citationNeural Network Control of Nonlinear Discrete-Time Systems
Sarangapani, J. (2018) · CRC Press eBooks · doi:10.1201/9781420015454 · Cited by 464
Zhang, H., Cui, L., & Luo, Y. (2013) · IEEE Transactions on Cybernetics · doi:10.1109/tsmcb.2012.2203336 · Cited by 464
Modares, H., Lewis, F. L., & Naghibi-Sistani, M.-B. (2013) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2276571 · Cited by 462
Modares, H., & Lewis, F. L. (2014) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2014.2317301 · Cited by 449
Liu, D., Yang, X., Wang, D., & Wei, Q. (2015) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2015.2417170 · Cited by 440
Self-citationRobust Adaptive Dynamic Programming and Feedback Stabilization of Nonlinear Systems
Jiang, Y., & Jiang, Z.-P. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2294968 · Cited by 414
Adaptive Dynamic Programming and Adaptive Optimal Output Regulation of Linear Systems
Gao, W., & Jiang, Z.-P. (2016) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2016.2548662 · Cited by 413
Zhang, H., Wei, Q., & Liu, D. (2011) · Automatica · doi:10.1016/j.automatica.2010.10.033 · Cited by 409
Self-citationWang, D., Liu, D., Wei, Q., Zhao, D., & Jin, N. (2012) · Automatica · doi:10.1016/j.automatica.2012.05.049 · Cited by 394
Self-citationLoad frequency control of a realistic power system with multi-source power generation
Parmar, K. P. S., Majhi, S., & Kothari, D. P. (2012) · International Journal of Electrical Power & Energy Systems · doi:10.1016/j.ijepes.2012.04.040 · Cited by 364
Off-Policy Reinforcement Learning for $ H_\infty $ Control Design
Luo, B., Wu, H.-N., & Huang, T. (2015) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2319577 · Cited by 362
Lincoln, B., & Rantzer, A. (2006) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2006.878720 · Cited by 358
Liu, D., Wang, D., & Li, H. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2280013 · Cited by 352
Self-citationValue iteration and adaptive dynamic programming for data-driven adaptive optimal control design
Bian, T., & Jiang, Z.-P. (2016) · Automatica · doi:10.1016/j.automatica.2016.05.003 · Cited by 348 · cited 2×
“From the view of convergence and optimality, the generalized value iteration and policy iteration for discrete-time systems [60], [63], [96] as well as the generalized policy iteration and value iteration for continuous-time systems [84], [88], [96] should be given special attention.”
BackgroundWhere does AlphaGo go: from church-turing thesis to AlphaGo thesis and beyond
Wang, F.-Y., Zhang, J. J., Zheng, X., Wang, X., Yuan, Y., Dai, X., Zhang, J., & Yang, L. (2016) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2016.7471613 · Cited by 342
Zhang, H., Feng, T., Yang, G.-H., & Liang, H. (2015) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2350511 · Cited by 327
On Event Triggered Tracking for Nonlinear Systems
Tallapragada, P., & Chopra, N. (2013) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2013.2251794 · Cited by 316
Computational Intelligence in Urban Traffic Signal Control: A Survey
Zhao, D., Dai, Y., & Zhang, Z. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2011.2161577 · Cited by 314
Deep Machine Learning—A New Frontier in Artificial Intelligence Research
Arel, I., Rose, D. C., & Karnowski, T. P. (2010) · Cited by 314
Event-triggered optimal adaptive control algorithm for continuous-time nonlinear systems
Vamvoudakis, K. G. (2014) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2014.7004686 · Cited by 313
Liu, D., Wang, D., Wang, F.-Y., Li, H., & Yang, X. (2014) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2357896 · Cited by 310
Self-citationAir-Breathing Hypersonic Vehicle Tracking Control Based on Adaptive Dynamic Programming
Mu, C., Ni, Z., Sun, C., & He, H. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2516948 · Cited by 307
Self-citationWang, F.-Y., Jin, N., Liu, D., & Wei, Q. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2076370 · Cited by 294
Self-citationNeural Network-Based Event-Triggered State Feedback Control of Nonlinear Continuous-Time Systems
Sahoo, A., Xu, H., & Jagannathan, S. (2016) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2416259 · Cited by 292
Optimal Adaptive Control and Differential Games by Reinforcement Learning Principles
Vrabie, D., Vamvoudakis, K. G., & Lewis, F. L. (2012) · Institution of Engineering and Technology eBooks · doi:10.1049/pbce081e · Cited by 291
Data-based approximate policy iteration for affine nonlinear continuous-time optimal control design
Luo, B., Wu, H.-N., Huang, T., & Liu, D. (2014) · Automatica · doi:10.1016/j.automatica.2014.10.056 · Cited by 280
Self-citationQ-Learning-Based Vulnerability Analysis of Smart Grid Against Sequential Topology Attacks
Yan, J., He, H., Zhong, X., & Tang, Y. (2017) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2016.2607701 · Cited by 264
Self-citationAn Event-Triggered ADP Control Approach for Continuous-Time System With Unknown Internal States
Zhong, X., & He, H. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2523878 · Cited by 263
Self-citationReinforcement Learning Output Feedback NN Control Using Deterministic Learning Technique
Xu, B., Yang, C., & Shi, Z. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2292704 · Cited by 257
Werbos, P. (1987) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1987.289329 · Cited by 251
Adaptive Dynamic Programming for Control: Algorithms and Stability
Zhang, H., Liu, D., Luo, Y., & Wang, D. (2013) · Communications and Control Engineering · doi:10.1007/978-1-4471-4757-2 · Cited by 250
Self-citationFinite-Horizon Control-Constrained Nonlinear Optimal Control Using Single Network Adaptive Critics
Heydari, A., & Balakrishnan, S. N. (2013) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2012.2227339 · Cited by 246
Global Adaptive Dynamic Programming for Continuous-Time Nonlinear Systems
Jiang, Y., & Jiang, Z.-P. (2015) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2015.2414811 · Cited by 241
Mu, C., Tang, Y., & He, H. (2017) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2017.2694396 · Cited by 240
Self-citationOff-Policy Actor-Critic Structure for Optimal Control of Unknown Systems With Disturbances
Song, R., Lewis, F. L., Wei, Q., & Zhang, H. (2016) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2015.2421338 · Cited by 239
Value and Policy Iterations in Optimal Control and Adaptive Dynamic Programming
Bertsekas, D. P. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2503980 · Cited by 238
Wang, D., Liu, D., & Li, H. (2014) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2013.2296206 · Cited by 238
Self-citationOnline solution of nonlinear two‐player zero‐sum games using synchronous policy iteration
Vamvoudakis, K. G., & Lewis, F. L. (2011) · International Journal of Robust and Nonlinear Control · doi:10.1002/rnc.1760 · Cited by 238
1 Global Adaptive Dynamic Programming for Continuous-Time Nonlinear SystemsPreprint
Jiang, Y., Member, S., & Jiang, Z. (2016) · Cited by 235
Gao, W., Jiang, Y., Jiang, Z.-P., & Chai, T. (2016) · Automatica · doi:10.1016/j.automatica.2016.05.008 · Cited by 234 · cited 10×
“The robust ADP method [129]–[133] can be viewed as an important extension of classical ADP to linear and genuinely nonlinear systems with dynamical uncertainties.”
BackgroundMethodInfluentialXu, B. (2015) · Nonlinear Dynamics · doi:10.1007/s11071-015-1958-8 · Cited by 234
Zhang, H., Qin, C., & Luo, Y. (2014) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2014.2303139 · Cited by 234
Zhang, H., Qin, C., Jiang, B., & Luo, Y. (2014) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2313915 · Cited by 234
Liu, L., Wang, Z., & Zhang, H. (2017) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2016.2517155 · Cited by 232
Fan, Q.-Y., & Yang, G.-H. (2016) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2472974 · Cited by 230
Abu-Khalaf, M., Lewis, F. L., & Huang, J. (2006) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2006.884959 · Cited by 229
Zhu, Y., Zhao, D., He, H., & Ji, J. (2017) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2016.2597763 · Cited by 225
Self-citationWei, Q., & Liu, D. (2014) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2013.2284545 · Cited by 224
Self-citationEvent-Triggered $H_\infty $ Control for Continuous-Time Nonlinear System via Concurrent Learning
Zhang, Q., Zhao, D., & Zhu, Y. (2017) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2016.2531680 · Cited by 223
He, H., Ni, Z., & Fu, J. (2012) · Neurocomputing · doi:10.1016/j.neucom.2011.05.031 · Cited by 221
Self-citationLiu, D., Wang, D., Zhao, D., Wei, Q., & Jin, N. (2012) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2012.2198057 · Cited by 220
Self-citationData-Based Adaptive Critic Designs for Nonlinear Robust Optimal Control With Uncertain Dynamics
Wang, D., Liu, D., Zhang, Q., & Zhao, D. (2016) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2015.2492941 · Cited by 218
Self-citationPadhi, R., Unnikrishnan, N., Wang, X., & Balakrishnan, S. N. (2006) · Neural Networks · doi:10.1016/j.neunet.2006.08.010 · Cited by 216
Liu, Y.-J., Tong, S., Chen, C. L. P., & Li, D.-J. (2016) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2015.2388582 · Cited by 213
Vamvoudakis, K. G., Miranda, M. F., & Hespanha, J. P. (2016) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2487972 · Cited by 210
Model-based reinforcement learning for approximate optimal regulation
Kamalapurkar, R., Walters, P., & Dixon, W. E. (2016) · Automatica · doi:10.1016/j.automatica.2015.10.039 · Cited by 208
Event-Based Robust Control for Uncertain Nonlinear Systems Using Adaptive Dynamic Programming
Zhang, Q., Zhao, D., & Wang, D. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2614002 · Cited by 203
Self-citationNovel iterative neural dynamic programming for data-based approximate optimal control design
Mu, C., Wang, D., & He, H. (2017) · Automatica · doi:10.1016/j.automatica.2017.03.022 · Cited by 193
Self-citationLee, J. Y., Park, J. B., & Choi, Y. H. (2012) · Automatica · doi:10.1016/j.automatica.2012.06.008 · Cited by 188
Dierks, T., Thumati, B. T., & Jagannathan, S. (2009) · Neural Networks · doi:10.1016/j.neunet.2009.06.014 · Cited by 186
Intelligence in the brain: A theory of how it works and how to build it
Werbos, P. J. (2009) · Neural Networks · doi:10.1016/j.neunet.2009.03.012 · Cited by 186
Wei, Q., & Liu, D. (2014) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2014.2301770 · Cited by 179
Self-citationRobust adaptive dynamic programming for linear and nonlinear systems: An overview
Jiang, Z.-P., & Jiang, Y. (2013) · European Journal of Control · doi:10.1016/j.ejcon.2013.05.017 · Cited by 171
Power System Stability Control for a Wind Farm Based on Adaptive Dynamic Programming
Tang, Y., He, H., Wen, J., & Liu, J. (2015) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2014.2346740 · Cited by 168
Self-citationOn Mixed Data and Event Driven Design for Adaptive-Critic-Based Nonlinear $H_{\infty}$ Control
Wang, D., Mu, C., Liu, D., & Ma, H. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2642128 · Cited by 168
Self-citationOptimal Control of Nonlinear Continuous-Time Systems in Strict-Feedback Form
Zargarzadeh, H., Dierks, T., & Jagannathan, S. (2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2441712 · Cited by 166
Decentralized Adaptive Optimal Control of Large-Scale Systems With Application to Power Systems
Bian, T., Jiang, Y., & Jiang, Z.-P. (2015) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2014.2345343 · Cited by 165
Ma, H., Wang, Z., Wang, D., Liu, D., Yan, P., & Wei, Q. (2016) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2015.2470635 · Cited by 160
Self-citationWang, D., Liu, D., Li, H., & Ma, H. (2014) · Information Sciences · doi:10.1016/j.ins.2014.05.050 · Cited by 159
Self-citationWang, D., Liu, D., Li, H., Luo, B., & Ma, H. (2016) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2015.2466191 · Cited by 159
Self-citationEvent-Driven Adaptive Robust Control of Nonlinear Systems With Uncertainties Through NDP Strategy
Wang, D., Mu, C., He, H., & Liu, D. (2016) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2016.2592682 · Cited by 156
Self-citationJiang, Y., & Jiang, Z. (2012) · IEEE Transactions on Circuits & Systems II Express Briefs · doi:10.1109/tcsii.2012.2213353 · Cited by 154
Park, M.-S., Chwa, D., & Hong, S.-K. (2008) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2008.2004385 · Cited by 151
Infinite Horizon Self-Learning Optimal Control of Nonaffine Discrete-Time Nonlinear Systems
Wei, Q., Liu, D., & Yang, X. (2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2401334 · Cited by 142
Self-citationComplete stability analysis of a heuristic approximate dynamic programming control design
Sokolov, Y., Kozma, R., Werbos, L., & Werbos, P. J. (2015) · Automatica · doi:10.1016/j.automatica.2015.06.001 · Cited by 141
Na, J., & Herrmann, G. (2014) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2014.7004668 · Cited by 140
An Overview of Research on Adaptive Dynamic Programming
Zhang, H., Zhang, X., Luo, Y., & Jun, Y. A. N. G. (2013) · Acta Automatica Sinica · doi:10.1016/s1874-1029(13)60031-2 · Cited by 136
Revisiting Approximate Dynamic Programming and its Convergence
Heydari, A. (2014) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2314612 · Cited by 133
Computational Intelligence for the Smart Grid-History, Challenges, and Opportunities
Werbos, P. J. (2011) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2011.941587 · Cited by 129
Zhu, Y., Zhao, D., & Li, X. (2016) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2561300 · Cited by 129
Modares, H., Lewis, F. L., & Sistani, M. B. N. (2012) · International Journal of Adaptive Control and Signal Processing · doi:10.1002/acs.2348 · Cited by 128
Relaxed dynamic programming in switching systems
Rantzer, A. (2006) · IEE Proceedings - Control Theory and Applications · doi:10.1049/ip-cta:20050094 · Cited by 128
Lv, Y., Na, J., Yang, Q., Wu, X. F., & Guo, Y. (2015) · International Journal of Control · doi:10.1080/00207179.2015.1060362 · Cited by 127
Lee, J. Y., Park, J. B., & Choi, Y. H. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2014.2328590 · Cited by 127
Online Learning Control Using Adaptive Critic Designs With Sparse Kernel Machines
Xu, X., Hou, Z., Lian, C., & He, H. (2013) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2012.2236354 · Cited by 126
Self-citationContinuous-Time Adaptive Critics
Hanselmann, T., Noakes, L., & Zaknich, A. (2007) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2006.889499 · Cited by 124
Data-Driven $H_\infty$ Control for Nonlinear Distributed Parameter Systems
Luo, B., Huang, T., Wu, H., & Yang, X. (2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2461023 · Cited by 122
Wang, D., He, H., Mu, C., & Liu, D. (2017) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2017.2674633 · Cited by 105
Self-citationOptimal Adaptive Control and Differential Games by Reinforcement Learning Principles
Dixon, W. E. (2014) · Journal of Guidance Control and Dynamics · doi:10.2514/1.g000173 · Cited by 104
Liu, D., Yang, X., & Li, H. (2012) · Neural Computing and Applications · doi:10.1007/s00521-012-1249-y · Cited by 102
Self-citationPardalos, P. M. (2013) · Optimization methods & software · doi:10.1080/10556788.2013.858876 · Cited by 99
Adaptive Learning and Control for MIMO System Based on Adaptive Dynamic Programming
Fu, J. Y., He, H., & Zhou, X. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2011.2147797 · Cited by 97
Self-citationWerbos, P. J. (2008) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2008.924139 · Cited by 94
Event-Driven Nonlinear Discounted Optimal Regulation Involving a Power System Application
Wang, D., He, H., Zhong, X., & Liu, D. (2017) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2017.2698377 · Cited by 94
Self-citationMu, C., Wang, D., & He, H. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2017.2752845 · Cited by 91
Self-citationGrDHP: A General Utility Function Representation for Dual Heuristic Dynamic Programming
Ni, Z., He, H., Zhao, D., Xu, X., & Prokhorov, D. V. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2014.2329942 · Cited by 90
Self-citationModel-Free Optimal Control for Affine Nonlinear Systems With Convergence Analysis
Zhao, D., Xia, Z., & Wang, D. (2014) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2014.2348991 · Cited by 87
Self-citationYang, X., Liu, D., Luo, B., & Li, C. (2016) · Information Sciences · doi:10.1016/j.ins.2016.07.051 · Cited by 84
Self-citationUsing ADP to Understand and Replicate Brain Intelligence: The Next Level Design?
Werbos, P. J. (2007) · Springer eBooks · doi:10.1007/978-3-540-73267-9_6 · Cited by 78
Self-Learning Cruise Control Using Kernel-Based Least Squares Policy Iteration
Wang, J., Xu, X., Liu, D., Sun, Z., & Chen, Q. (2013) · IEEE Transactions on Control Systems Technology · doi:10.1109/tcst.2013.2271276 · Cited by 76
Self-citationSargent, T. J., & Stachurski, J. (2025) · Cambridge University Press eBooks · doi:10.1017/9781009540780.010 · Cited by 75
Parallel Control: A Method for Data-Driven and Computational Control
Wang, F. (2014) · Acta Automatica Sinica · doi:10.3724/sp.j.1004.2013.00293 · Cited by 75
Liu, D., Li, H., & Wang, D. (2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2402203 · Cited by 72
Self-citationWang, D., Li, C., Liu, D., & Mu, C. (2016) · Information Sciences · doi:10.1016/j.ins.2016.05.034 · Cited by 72
Self-citationYang, X., Liu, D., Ma, H., & Xu, Y. (2015) · Information Sciences · doi:10.1016/j.ins.2015.09.001 · Cited by 71
Self-citationA Theoretical Foundation of Goal Representation Heuristic Dynamic Programming
Zhong, X., Ni, Z., & He, H. (2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2490698 · Cited by 70
Self-citationA novel policy iteration based deterministic Q-learning for discrete-time nonlinear systems
Wei, Q., & Liu, D. (2015) · Science China Information Sciences · doi:10.1007/s11432-015-5462-z · Cited by 69
Self-citationLiu, D., Li, C., Li, H., Wang, D., & Ma, H. (2015) · Neurocomputing · doi:10.1016/j.neucom.2014.07.082 · Cited by 58
Self-citationXiao, G., Zhang, H., Luo, Y., & Jiang, H. (2016) · IET Control Theory and Applications · doi:10.1049/iet-cta.2015.0590 · Cited by 55
Feature selection and feature learning for high-dimensional batch reinforcement learning: A survey
Liu, D., Li, H., & Wang, D. (2015) · Machine Intelligence Research · doi:10.1007/s11633-015-0893-y · Cited by 53
Self-citationQin, C., Zhang, H., Wang, Y., & Luo, Y. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.08.120 · Cited by 50
Mu, C., Sun, C., Song, A., & Yu, H. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.06.059 · Cited by 50
A retrospective on Adaptive Dynamic Programming for control
Lendaris, G. G. (2009) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2009.5178716 · Cited by 48
Wu, H., Li, M., & Guo, L. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2014.2346233 · Cited by 47
Fuzzy-Based Goal Representation Adaptive Dynamic Programming
Tang, Y., He, H., Ni, Z., Zhong, X., Zhao, D., & Xu, X. (2015) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2015.2505327 · Cited by 46
Self-citationWang, D., Mu, C., Zhang, Q., & Liu, D. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.07.002 · Cited by 45
Self-citationOn integral generalized policy iteration for continuous-time linear quadratic regulations
Lee, J. Y., Park, J. B., & Choi, Y. H. (2014) · Automatica · doi:10.1016/j.automatica.2013.12.009 · Cited by 44
Mu, C., & Wang, D. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.03.047 · Cited by 41
Self-citationParallel Control: A Method for Data-Driven and Computational Control
Fei-yue, W. (2013) · Cited by 37
Robust controller design of continuous-time nonlinear system using neural network
Zhong, X., He, H., & Prokhorov, D. V. (2013) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2013.6707098 · Cited by 36
Self-citationDecentralized adaptive optimal stabilization of nonlinear systems with matched interconnections
Mu, C., Sun, C., Wang, D., Song, A., & Qian, C. (2017) · Soft Computing · doi:10.1007/s00500-017-2526-6 · Cited by 31
Self-citationAdaptive near‐optimal controllers for non‐linear decentralised feedback stabilisation problems
Wang, D., He, H., Zhao, B., & Liu, D. (2017) · IET Control Theory and Applications · doi:10.1049/iet-cta.2016.1383 · Cited by 30
Self-citationQin, C., Zhang, H., & Luo, Y. (2015) · Asian Journal of Control · doi:10.1002/asjc.1102 · Cited by 27
Developing nonlinear adaptive optimal regulators through an improved neural learning mechanism
Wang, D., & Mu, C. (2017) · Science China Information Sciences · doi:10.1007/s11432-016-9022-1 · Cited by 21
Self-citationWang, D., & Mu, C. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.05.051 · Cited by 18
Self-citationSong, R., Xiao, W., Wei, Q., & Sun, C. (2013) · Soft Computing · doi:10.1007/s00500-013-1170-z · Cited by 16
An OVerview on the Adaptive Dynamic Programming Based Urban City Traffic Signal Optimal Control
Zhao, D., Liu, D., & Yi, J. (2009) · Acta Automatica Sinica · doi:10.3724/sp.j.1004.2009.00676 · Cited by 13
Self-citationAdaptive-critic-based event-driven nonlinear robust state feedback
Wang, D., Mu, C., He, H., & Liu, D. (2016) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2016.7799163 · Cited by 10
Self-citation
Cited by
State-of-the-art in artificial neural network applications: A survey
Abiodun, O. I., Jantan, A., Omolara, A. E., Dada, K. V., Mohamed, N. A., & Arshad, H. (2018) · Heliyon · doi:10.1016/j.heliyon.2018.e00938 · Cited by 3,054
Adaptive Dynamic Programming for Control: A Survey and Recent Advances
Liu, D., Xue, S., Zhao, B., Luo, B., & Wei, Q. (2021) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2020.3042876 · Cited by 708
Self-citationWang, D., Gao, N., Liu, D., Li, J., & Lewis, F. L. (2024) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2023.123843 · Cited by 364
Self-citationAdaptive Tracking Control of Surface Vessel Using Optimized Backstepping Technique
Wen, G., Ge, S. S., Chen, C. L. P., Tu, F., & Wang, S. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2844177 · Cited by 262
Neural Network Control of a Two-Link Flexible Robotic Manipulator Using Assumed Mode Method
Gao, H., He, W., Zhou, C., & Sun, C. (2019) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2018.2818120 · Cited by 254
Metadata
- Authors
- Wang, D., He, H., & Liu, D.
- Venue
- IEEE Transactions on Cybernetics
- Published
- 2017-10
- Volume
- 47
- Issue
- 10
- Pages
- 3429-3451
- ISSN
- 2168-2267 (ISSN-L)
- 2168-2275
- OpenAlex
- W2727279496
- Cited by
- 374
- References
- 176
- FWCI
- 28.32
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.