The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Decentralized Stabilization for a Class of Continuous-Time Nonlinear Interconnected Systems Using Online Learning Optimal Control Approach
Abstract
In this paper, using a neural-network-based online learning optimal control approach, a novel decentralized control strategy is developed to stabilize a class of continuous-time nonlinear interconnected large-scale systems. First, optimal controllers of the isolated subsystems are designed with cost functions reflecting the bounds of interconnections. Then, it is proven that the decentralized control strategy of the overall system can be established by adding appropriate feedback gains to the optimal control policies of the isolated subsystems. Next, an online policy iteration algorithm is presented to solve the Hamilton-Jacobi-Bellman equations related to the optimal control problem. Through constructing a set of critic neural networks, the cost functions can be obtained approximately, followed by the control policies. Furthermore, the dynamics of the estimation errors of the critic networks are verified to be uniformly and ultimately bounded. Finally, a simulation example is provided to illustrate the effectiveness of the present decentralized control scheme.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Online actor–critic algorithm to solve the continuous-time infinite horizon optimal control problem
Vamvoudakis, K. G., & Lewis, F. L. (2010) · Automatica · doi:10.1016/j.automatica.2010.02.018 · Cited by 1,703
Reinforcement learning and adaptive dynamic programming for feedback control
Lewis, F. L., & Vrabie, D. (2009) · IEEE Circuits and Systems Magazine · doi:10.1109/mcas.2009.933854 · Cited by 1,558
Abu-Khalaf, M., & Lewis, F. L. (2005) · Automatica · doi:10.1016/j.automatica.2004.11.034 · Cited by 1,349
Prokhorov, D. V., & Wunsch, D. C. (1997) · IEEE Transactions on Neural Networks · doi:10.1109/72.623201 · Cited by 1,186
Discrete-Time Nonlinear HJB Solution Using Approximate Dynamic Programming: Convergence Proof
Al-Tamimi, A., Lewis, F. L., & Abu-Khalaf, M. (2008) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2008.926614 · Cited by 1,075
Jiang, Y., & Jiang, Z.-P. (2012) · Automatica · doi:10.1016/j.automatica.2012.06.096 · Cited by 1,072
Adaptive Dynamic Programming: An Introduction
Wang, F.-Y., Zhang, H., & Liu, D. (2009) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2009.932261 · Cited by 898
Self-citationOnline learning control by association and reinforcement
Si, J., & Wang, Y.-T. (2001) · IEEE Transactions on Neural Networks · doi:10.1109/72.914523 · Cited by 773
Handbook of Intelligent Control: Neural, Fuzzy, and Adaptive Approaches
White, D. A., & Sofge, D. (1992) · Medical Entomology and Zoology · Cited by 705
Neural Computing and Applications
(2013) · Neural Computing and Applications · doi:10.1007/521.1433-3058 · Cited by 679
Galerkin approximations of the generalized Hamilton-Jacobi-Bellman equation
Beard, R. W., Saridis, G. N., & Wen, J. T.-Y. (1997) · Automatica · doi:10.1016/s0005-1098(97)00128-3 · Cited by 667
Zhang, H., Luo, Y., & Liu, D. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2009.2027233 · Cited by 649
Self-citationBhasin, S., Kamalapurkar, R., Johnson, M., Vamvoudakis, K. G., Lewis, F. L., & Dixon, W. E. (2013) · Automatica · doi:10.1016/j.automatica.2012.09.019 · Cited by 642
Vrabie, D., & Lewis, F. (2009) · Neural Networks · doi:10.1016/j.neunet.2009.03.008 · Cited by 634
Decentralized control: An overview
Bakule, L. (2008) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2008.03.004 · Cited by 571
Zhang, H., Wei, Q., & Liu, D. (2011) · Automatica · doi:10.1016/j.automatica.2010.10.033 · Cited by 409
Self-citationWang, F.-Y., Jin, N., Liu, D., & Wei, Q. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2076370 · Cited by 294
Self-citationAdaptive Dynamic Programming for Control: Algorithms and Stability
Zhang, H., Liu, D., Luo, Y., & Wang, D. (2013) · Communications and Control Engineering · doi:10.1007/978-1-4471-4757-2 · Cited by 250
Self-citationFinite-Horizon Control-Constrained Nonlinear Optimal Control Using Single Network Adaptive Critics
Heydari, A., & Balakrishnan, S. N. (2013) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2012.2227339 · Cited by 246
Reinforcement learning and optimal adaptive control: An overview and implementation examples
Khan, S. G., Herrmann, G., Lewis, F. L., Pipe, T., & Melhuish, C. (2012) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2012.03.004 · Cited by 234
Xu, H., Jagannathan, S., & Lewis, F. L. (2012) · Automatica · doi:10.1016/j.automatica.2012.03.007 · Cited by 230
Wang, D., Liu, D., & Wei, Q. (2012) · Neurocomputing · doi:10.1016/j.neucom.2011.03.058 · Cited by 224
Self-citationLiu, D., Wang, D., Zhao, D., Wei, Q., & Jin, N. (2012) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2012.2198057 · Cited by 220
Self-citationWu, H., & Luo, B. (2012) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2012.2217349 · Cited by 208
Adaptive Learning in Tracking Control Based on the Dual Critic Network Design
Ni, Z., He, H., & Wen, J. (2013) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2247627 · Cited by 189
Jiang, Y., & Jiang, Z. (2012) · IEEE Transactions on Circuits & Systems II Express Briefs · doi:10.1109/tcsii.2012.2213353 · Cited by 154
Liu, D., Wang, D., & Yang, X. (2012) · Information Sciences · doi:10.1016/j.ins.2012.07.006 · Cited by 129
Self-citationOnline Learning Control Using Adaptive Critic Designs With Sparse Kernel Machines
Xu, X., Hou, Z., Lian, C., & He, H. (2013) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2012.2236354 · Cited by 126
Issues on Stability of ADP Feedback Controllers for Dynamical Systems
Balakrishnan, S. N., Ding, J., & Lewis, F. L. (2008) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2008.926599 · Cited by 108
Missile defense and interceptor allocation by neuro-dynamic programming
Bertsekas, D. P., Homer, M. L., Logan, D. A., Patek, S. D., & SANDELL, N. R. (2000) · IEEE Transactions on Systems Man and Cybernetics - Part A Systems and Humans · doi:10.1109/3468.823480 · Cited by 106
Adaptive Learning and Control for MIMO System Based on Adaptive Dynamic Programming
Fu, J. Y., He, H., & Zhou, X. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2011.2147797 · Cited by 97
Decentralized Implementation of Centralized Controllers for Interconnected Systems
Lavaei, J. (2011) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2011.2180089 · Cited by 49
On the gain margin of nonlinear and optimal regulators
Glad, S. T. (1984) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1984.1103594 · Cited by 45
A model-free robust policy iteration algorithm for optimal control of nonlinear systems
Bhasin, S., Johnson, M. L., & Dixon, W. E. (2010) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2010.5717295 · Cited by 27
Liu, D., Li, H., & Wang, D. (2012) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2012.6252790 · Cited by 6
Self-citation
Cited by
Adaptive Dynamic Programming for Control: A Survey and Recent Advances
Liu, D., Xue, S., Zhao, B., Luo, B., & Wei, Q. (2021) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2020.3042876 · Cited by 708
Self-citationLi, Y., Liu, Y., & Tong, S. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3051030 · Cited by 663
Tong, S., Sun, K., & Sui, S. (2018) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2017.2686373 · Cited by 551
He, W., Yin, Z., & Sun, C. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2554621 · Cited by 463
Li, H., Wu, Y., & Chen, M. (2021) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2020.2982168 · Cited by 422
Self-citation
Metadata
- Authors
- Liu, D., Wang, D., & Li, H.
- Venue
- IEEE Transactions on Neural Networks and Learning Systems
- Published
- 2014-02
- Volume
- 25
- Issue
- 2
- Pages
- 418-428
- ISSN
- 2162-237X (ISSN-L)
- 2162-2388
- OpenAlex
- W1999678919
- Cited by
- 352
- References
- 38
- FWCI
- 29.03
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.