The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Data-Driven Robust Approximate Optimal Tracking Control for Unknown General Nonlinear Systems Using Adaptive Dynamic Programming Method
Abstract
In this paper, a novel data-driven robust approximate optimal tracking control scheme is proposed for unknown general nonlinear systems by using the adaptive dynamic programming (ADP) method. In the design of the controller, only available input-output data is required instead of known system dynamics. A data-driven model is established by a recurrent neural network (NN) to reconstruct the unknown system dynamics using available input-output data. By adding a novel adjustable term related to the modeling error, the resultant modeling error is first guaranteed to converge to zero. Then, based on the obtained data-driven model, the ADP method is utilized to design the approximate optimal tracking controller, which consists of the steady-state controller and the optimal feedback controller. Further, a robustifying term is developed to compensate for the NN approximation errors introduced by implementing the ADP method. Based on Lyapunov approach, stability analysis of the closed-loop system is performed to show that the proposed controller guarantees the system state asymptotically tracking the desired trajectory. Additionally, the obtained control input is proven to be close to the optimal control input within a small bound. Finally, two numerical examples are used to demonstrate the effectiveness of the proposed control scheme.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Lewis, F. L. (1986) · Cited by 2,948
Online actor–critic algorithm to solve the continuous-time infinite horizon optimal control problem
Vamvoudakis, K. G., & Lewis, F. L. (2010) · Automatica · doi:10.1016/j.automatica.2010.02.018 · Cited by 1,703
Reinforcement learning and adaptive dynamic programming for feedback control
Lewis, F. L., & Vrabie, D. (2009) · IEEE Circuits and Systems Magazine · doi:10.1109/mcas.2009.933854 · Cited by 1,558
Abu-Khalaf, M., & Lewis, F. L. (2005) · Automatica · doi:10.1016/j.automatica.2004.11.034 · Cited by 1,349
Discrete-Time Nonlinear HJB Solution Using Approximate Dynamic Programming: Convergence Proof
Al-Tamimi, A., Lewis, F. L., & Abu-Khalaf, M. (2008) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2008.926614 · Cited by 1,075
Adaptive optimal control for continuous-time linear systems based on policy iteration
Vrabie, D., Pastravanu, O., Abu-Khalaf, M., & Lewis, F. L. (2009) · Automatica · doi:10.1016/j.automatica.2008.08.017 · Cited by 949
Adaptive Dynamic Programming: An Introduction
Wang, F.-Y., Zhang, H., & Liu, D. (2009) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2009.932261 · Cited by 898
Self-citationHandbook of Learning and Approximate Dynamic Programming
Si, J., Barto, A. G., Powell, W. B., & Wunsch, D. (2004) · Institute of Electrical and Electronics Engineers eBooks · doi:10.1109/9780470544785 · Cited by 856
Murray, J. J., Cox, C. J., Lendaris, G. G., & Saeks, R. (2002) · IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2002.801727 · Cited by 677
Galerkin approximations of the generalized Hamilton-Jacobi-Bellman equation
Beard, R. W., Saridis, G. N., & Wen, J. T.-Y. (1997) · Automatica · doi:10.1016/s0005-1098(97)00128-3 · Cited by 667
Zhang, H., Luo, Y., & Liu, D. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2009.2027233 · Cited by 649
Self-citationVrabie, D., & Lewis, F. (2009) · Neural Networks · doi:10.1016/j.neunet.2009.03.008 · Cited by 634
Al-Tamimi, A., Lewis, F. L., & Abu-Khalaf, M. (2007) · Automatica · doi:10.1016/j.automatica.2006.09.019 · Cited by 611
The unfalsified control concept and learning
Safonov, M. G., & Tsao, T.-C. (1997) · IEEE Transactions on Automatic Control · doi:10.1109/9.587340 · Cited by 595
Lewis, F. L., & Vamvoudakis, K. G. (2011) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2010.2043839 · Cited by 544
Zhang, H., Wei, Q., & Luo, Y. (2008) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2008.920269 · Cited by 489
Self-citationZhang, H., Wei, Q., & Liu, D. (2011) · Automatica · doi:10.1016/j.automatica.2010.10.033 · Cited by 409
Self-citationWang, F.-Y., Jin, N., Liu, D., & Wei, Q. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2076370 · Cited by 294
On Data-driven Control Theory: the State of the Art and Perspective
HOU, Z.-S., & XU, J.-X. (2009) · Acta Automatica Sinica · doi:10.3724/sp.j.1004.2009.00650 · Cited by 209
Dierks, T., Thumati, B. T., & Jagannathan, S. (2009) · Neural Networks · doi:10.1016/j.neunet.2009.06.014 · Cited by 186
An optimal tracking neuro-controller for nonlinear dynamic systems
Park, Y.-M., Choi, M.-S., & Lee, K. Y. (1996) · IEEE Transactions on Neural Networks · doi:10.1109/72.536307 · Cited by 160
Virtual reference feedback tuning for two degree of freedom controllers
Lecchini, A., Campi, M. C., & Savaresi, S. M. (2002) · International Journal of Adaptive Control and Signal Processing · doi:10.1002/acs.711 · Cited by 158
Lee, J. M., & Lee, J. H. (2005) · Automatica · doi:10.1016/j.automatica.2005.02.006 · Cited by 139
Continuous-Time Adaptive Critics
Hanselmann, T., Noakes, L., & Zaknich, A. (2007) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2006.889499 · Cited by 124
On Data-driven Control Theory:the State of the Art and Perspective
Zhong, H. (2009) · Acta Automatica Sinica · Cited by 105
Optimal tracking control of affine nonlinear discrete-time systems with unknown internal dynamics
Dierks, T., & Jagannathan, S. (2009) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2009.5399697 · Cited by 101
Nonlinear Adaptive Wavelet Control Using Constructive Wavelet Networks
Xu, J., & Tan, Y. (2007) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2006.886759 · Cited by 73
Aangenent, W., Kostic, D., de Jager, B., van de Molengraft, R., & Steinbuch, M. (2005) · Proceedings of the 2005, American Control Conference, 2005. · doi:10.1109/acc.2005.1470171 · Cited by 70
Robust/Optimal Temperature Profile Control of a High-Speed Aerospace Vehicle Using Neural Networks
Yadav, V. H., Padhi, R., & Balakrishnan, S. N. (2007) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2007.899229 · Cited by 66
Markov Data-Based LQG Control1
Shi, G., & Skelton, R. E. (1998) · Journal of Dynamic Systems Measurement and Control · doi:10.1115/1.1286868 · Cited by 49
Wei, Q., Zhang, H., & Cui, L. (2009) · Acta Automatica Sinica · doi:10.1016/s1874-1029(08)60091-9 · Cited by 32
Self-citationWei, Q., Zhang, H., & Cui, L. (2009) · Acta Automatica Sinica · doi:10.3724/sp.j.1004.2009.00682 · Cited by 22
Self-citationIdentification of a Multistep-Ahead Observer and Its Application to Predictive Control
Lim, R. K., & Phan, M. Q. (1997) · Journal of Guidance Control and Dynamics · doi:10.2514/2.4177 · Cited by 20
Suppressing non-periodically repeating disturbances in mechanical servo systems
Tousain, R. L., Boissy, J.-C., Norg, M. L., Steinbuch, M., & Bosgra, O. H. (2002) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.1998.757832 · Cited by 15
Cited by
Data-based techniques focused on modern industry: An overview
Yin, S., Li, X., Gao, H., & Kaynak, O. (2015) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2014.2308133 · Cited by 1,025
Policy Iteration Adaptive Dynamic Programming Algorithm for Discrete-Time Nonlinear Systems
Liu, D., & Wei, Q. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2281663 · Cited by 753
Modares, H., & Lewis, F. L. (2014) · Automatica · doi:10.1016/j.automatica.2014.05.011 · Cited by 701
Kiumarsi, B., Lewis, F. L., Modares, H., Karimpour, A., & Naghibi-Sistani, M.-B. (2014) · Automatica · doi:10.1016/j.automatica.2014.02.015 · Cited by 574
Tong, S., Sun, K., & Sui, S. (2018) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2017.2686373 · Cited by 551
Metadata
- Authors
- Zhang, H., Cui, L., Zhang, X., & Luo, Y.
- Venue
- IEEE Transactions on Neural Networks
- Published
- 2011-12
- Volume
- 22
- Issue
- 12
- Pages
- 2226-2236
- ISSN
- 1045-9227 (ISSN-L)
- 1941-0093
- OpenAlex
- W2052305027
- Cited by
- 643
- References
- 34
- FWCI
- 20.93
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.