The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Robust Adaptive Dynamic Programming and Feedback Stabilization of Nonlinear Systems
Abstract
This paper studies the robust optimal control design for a class of uncertain nonlinear systems from a perspective of robust adaptive dynamic programming (RADP). The objective is to fill up a gap in the past literature of adaptive dynamic programming (ADP) where dynamic uncertainties or unmodeled dynamics are not addressed. A key strategy is to integrate tools from modern nonlinear control theory, such as the robust redesign and the backstepping techniques as well as the nonlinear small-gain theorem, with the theory of ADP. The proposed RADP methodology can be viewed as an extension of ADP to uncertain nonlinear systems. Practical learning algorithms are developed in this paper, and have been applied to the controller design problems for a jet engine and a one-machine power system.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Power System Stability and Control
Kundur, P. (1994) · Cited by 19,639
Nonlinear and adaptive control design
Krstić, M., Kokotović, P. V., & Kanellakopoulos, I. (1995) · Cited by 10,421
Watkins, C. (1989) · OpenGrey (Institut de l'Information Scientifique et Technique) · doi:10.17863/cam.132164 · Cited by 5,297
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148
Dynamic Programming and Markov Processes.
Freimer, M., & Howard, R. A. (1961) · Journal of the American Statistical Association · doi:10.2307/2282268 · Cited by 3,378
Neuronlike adaptive elements that can solve difficult learning control problems
Barto, A. G., Sutton, R. S., & Anderson, C. W. (1983) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1983.6313077 · Cited by 3,233
Beyond Regression : "New Tools for Prediction and Analysis in the Behavioral Sciences
Werbos, P. J. (1974) · Medical Entomology and Zoology · Cited by 2,789
Smooth stabilization implies coprime factorization
Sontag, E. D. (1989) · IEEE Transactions on Automatic Control · doi:10.1109/9.28018 · Cited by 2,717
Lewis, F. L., Vrabie, D. L., & Syrmos, V. L. (2012) · doi:10.1002/9781118122631 · Cited by 2,020
On characterizations of the input-to-state stability property
Sontag, E. D., & Wang, Y. (1995) · Systems & Control Letters · doi:10.1016/0167-6911(94)00050-6 · Cited by 1,784
Steps toward Artificial Intelligence
Minsky, M. (1961) · Proceedings of the IRE · doi:10.1109/jrproc.1961.287775 · Cited by 1,675
Reinforcement learning and adaptive dynamic programming for feedback control
Lewis, F. L., & Vrabie, D. (2009) · IEEE Circuits and Systems Magazine · doi:10.1109/mcas.2009.933854 · Cited by 1,558
Small-gain theorem for ISS systems and applications
Jiang, Z. P., Teel, A. R., & Praly, L. (1994) · Mathematics of Control, Signals, and Systems · doi:10.1007/bf01211469 · Cited by 1,366
Self-citationJiang, Y., & Jiang, Z.-P. (2012) · Automatica · doi:10.1016/j.automatica.2012.06.096 · Cited by 1,072
Self-citationApproximate dynamic programming for real-time control and neural modeling
Werbos, P. J. (1992) · Medical Entomology and Zoology · Cited by 971
Reinforcement Learning in Continuous Time and Space
Doya, K. (2000) · Neural Computation · doi:10.1162/089976600300015961 · Cited by 960
(2011) · Encyclopedia of Machine Learning · doi:10.1007/978-0-387-30164-8_588 · Cited by 950
Adaptive optimal control for continuous-time linear systems based on policy iteration
Vrabie, D., Pastravanu, O., Abu-Khalaf, M., & Lewis, F. L. (2009) · Automatica · doi:10.1016/j.automatica.2008.08.017 · Cited by 949
Adaptive Dynamic Programming: An Introduction
Wang, F.-Y., Zhang, H., & Liu, D. (2009) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2009.932261 · Cited by 898
Approximation Theory and Methods
Powell, M. J. D. (1981) · Cambridge University Press eBooks · doi:10.1017/cbo9781139171502 · Cited by 771
Murray, J. J., Cox, C. J., Lendaris, G. G., & Saeks, R. (2002) · IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2002.801727 · Cited by 677
Galerkin approximations of the generalized Hamilton-Jacobi-Bellman equation
Beard, R. W., Saridis, G. N., & Wen, J. T.-Y. (1997) · Automatica · doi:10.1016/s0005-1098(97)00128-3 · Cited by 667
Tools for Semiglobal Stabilization by Partial State and Output Feedback
Teel, A., & Praly, L. (1995) · SIAM Journal on Control and Optimization · doi:10.1137/s0363012992241430 · Cited by 642
A Lyapunov formulation of the nonlinear small-gain theorem for interconnected ISS systems
Jiang, Z., Mareels, I., & Wang, Y. (1996) · Automatica · doi:10.1016/0005-1098(96)00051-9 · Cited by 640
Self-citationVrabie, D., & Lewis, F. (2009) · Neural Networks · doi:10.1016/j.neunet.2009.03.008 · Cited by 634
Al-Tamimi, A., Lewis, F. L., & Abu-Khalaf, M. (2007) · Automatica · doi:10.1016/j.automatica.2006.09.019 · Cited by 611
A Menu of Designs for Reinforcement Learning Over Time
Werbos, P. J. (1991) · Neural Networks for Control · doi:10.7551/mitpress/4939.003.0007 · Cited by 605
Lewis, F. L., & Vamvoudakis, K. G. (2011) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2010.2043839 · Cited by 544
Vamvoudakis, K. G., & Lewis, F. L. (2011) · Automatica · doi:10.1016/j.automatica.2011.03.005 · Cited by 525
Zhang, H., Wei, Q., & Liu, D. (2011) · Automatica · doi:10.1016/j.automatica.2010.10.033 · Cited by 409
Stability and Stabilization of Nonlinear Systems
Karafyllis, I., & Jiang, Z.-P. (2011) · Communications and Control Engineering · doi:10.1007/978-0-85729-513-2 · Cited by 393
Self-citationFurther facts about input to state stabilization
Sontag, E. D. (1990) · IEEE Transactions on Automatic Control · doi:10.1109/9.52307 · Cited by 389
An Approximation Theory of Optimal Control for Trainable Manipulators
Saridis, G. N., & Lee, C.-S. G. (1979) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1979.4310171 · Cited by 348
A small-gain control method for nonlinear cascaded systems with dynamic uncertainties
Jiang, Z.-P., & Marcels, I. M. Y. (1997) · IEEE Transactions on Automatic Control · doi:10.1109/9.557574 · Cited by 322
Self-citationNeural networks for control and system identification
Werbos, P. J. (2003) · Proceedings of the 28th IEEE Conference on Decision and Control · doi:10.1109/cdc.1989.70114 · Cited by 319
Praly, L., & Wang, Y. (1996) · Mathematics of Control, Signals, and Systems · doi:10.1007/bf01211516 · Cited by 276
Intelligence in the brain: A theory of how it works and how to build it
Werbos, P. J. (2009) · Neural Networks · doi:10.1016/j.neunet.2009.03.012 · Cited by 186
A heuristic approach to reinforcement learning control systems
Waltz, M. D., & Fu, K. (1965) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1965.1098193 · Cited by 180
Reinforcement learning in continuous time: advantage updating
Baird, L. C. (1994) · Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94) · doi:10.1109/icnn.1994.374604 · Cited by 177
Robust adaptive dynamic programming for linear and nonlinear systems: An overview
Jiang, Z.-P., & Jiang, Y. (2013) · European Journal of Control · doi:10.1016/j.ejcon.2013.05.017 · Cited by 171
Self-citationStable neural controller design for unknown nonlinear systems using backstepping
Jiang, Z.-P., Peng, P.-Y., & Zhang, Y. (2000) · IEEE Transactions on Neural Networks · doi:10.1109/72.883443 · Cited by 163
Self-citationRobust Adaptive Dynamic Programming
Jiang, Y., & Jiang, Z. (2017) · Wiley eBooks · doi:10.1002/9781119132677.ch5 · Cited by 138
Self-citationRobust Adaptive Dynamic Programming With an Application to Power Systems
Jiang, Y., & Jiang, Z. (2013) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2249668 · Cited by 110
Self-citationAdami, C. (2023) · Artificial Life · doi:10.1162/artl_a_00410 · Cited by 43
Robust Adaptive Dynamic Programming
Jiang, Y., & Jiang, Z. (2012) · Wiley eBooks · doi:10.1002/9781118453988.ch13 · Cited by 24
Self-citationRobust approximate dynamic programming and global stabilization with nonlinear dynamic uncertainties
Jiang, Y., & Jiang, Z. (2011) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2011.6160279 · Cited by 21
Self-citation
Cited by
Optimal and Autonomous Control Using Reinforcement Learning: A Survey
Kiumarsi, B., Vamvoudakis, K. G., Modares, H., & Lewis, F. L. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2773458 · Cited by 891
Value Iteration Adaptive Dynamic Programming for Optimal Control of Discrete-Time Nonlinear Systems
Wei, Q., Liu, D., & Lin, H. (2016) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2015.2492242 · Cited by 465
Liu, D., Yang, X., Wang, D., & Wei, Q. (2015) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2015.2417170 · Cited by 440
Adaptive Dynamic Programming and Adaptive Optimal Output Regulation of Linear Systems
Gao, W., & Jiang, Z.-P. (2016) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2016.2548662 · Cited by 413
Self-citationObserver-Based Adaptive Fuzzy Fault-Tolerant Optimal Control for SISO Nonlinear Systems
Li, Y., Sun, K., & Tong, S. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2017.2785801 · Cited by 378
Metadata
- Authors
- Jiang, Y., & Jiang, Z.-P.
- Venue
- IEEE Transactions on Neural Networks and Learning Systems
- Published
- 2014-05
- Volume
- 25
- Issue
- 5
- Pages
- 882-893
- ISSN
- 2162-237X (ISSN-L)
- 2162-2388
- OpenAlex
- W1972809999
- Cited by
- 414
- References
- 48
- FWCI
- 45.89
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.