The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Neural-Network-Based Online HJB Solution for Optimal Robust Guaranteed Cost Control of Continuous-Time Uncertain Nonlinear Systems
Abstract
In this paper, the infinite horizon optimal robust guaranteed cost control of continuous-time uncertain nonlinear systems is investigated using neural-network-based online solution of Hamilton-Jacobi-Bellman (HJB) equation. By establishing an appropriate bounded function and defining a modified cost function, the optimal robust guaranteed cost control problem is transformed into an optimal control problem. It can be observed that the optimal cost function of the nominal system is nothing but the optimal guaranteed cost of the original uncertain system. A critic neural network is constructed to facilitate the solution of the modified HJB equation corresponding to the nominal system. More importantly, an additional stabilizing term is introduced for helping to verify the stability, which reinforces the updating process of the weight vector and reduces the requirement of an initial stabilizing control. The uniform ultimate boundedness of the closed-loop system is analyzed by using the Lyapunov approach as well. Two simulation examples are provided to verify the effectiveness of the present control approach.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Neural Network Control Of Robot Manipulators And Non-Linear Systems
Lewis, F. W., Jagannathan, S., & Yesildirak, A. (2020) · CRC Press eBooks · doi:10.1201/9781003062714 · Cited by 1,867
Online actor–critic algorithm to solve the continuous-time infinite horizon optimal control problem
Vamvoudakis, K. G., & Lewis, F. L. (2010) · Automatica · doi:10.1016/j.automatica.2010.02.018 · Cited by 1,703
Reinforcement learning and adaptive dynamic programming for feedback control
Lewis, F. L., & Vrabie, D. (2009) · IEEE Circuits and Systems Magazine · doi:10.1109/mcas.2009.933854 · Cited by 1,558
Abu-Khalaf, M., & Lewis, F. L. (2005) · Automatica · doi:10.1016/j.automatica.2004.11.034 · Cited by 1,349
Prokhorov, D. V., & Wunsch, D. C. (1997) · IEEE Transactions on Neural Networks · doi:10.1109/72.623201 · Cited by 1,186
(2012) · IEEE Control Systems · doi:10.1109/mcs.2012.2214134 · Cited by 1,105
Discrete-Time Nonlinear HJB Solution Using Approximate Dynamic Programming: Convergence Proof
Al-Tamimi, A., Lewis, F. L., & Abu-Khalaf, M. (2008) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2008.926614 · Cited by 1,075
Approximate dynamic programming for real-time control and neural modeling
Werbos, P. J. (1992) · Medical Entomology and Zoology · Cited by 971
Adaptive Dynamic Programming: An Introduction
Wang, F.-Y., Zhang, H., & Liu, D. (2009) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2009.932261 · Cited by 898
Self-citationOnline learning control by association and reinforcement
Si, J., & Wang, Y.-T. (2001) · IEEE Transactions on Neural Networks · doi:10.1109/72.914523 · Cited by 773
Policy Iteration Adaptive Dynamic Programming Algorithm for Discrete-Time Nonlinear Systems
Liu, D., & Wei, Q. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2281663 · Cited by 753
Self-citationGalerkin approximations of the generalized Hamilton-Jacobi-Bellman equation
Beard, R. W., Saridis, G. N., & Wen, J. T.-Y. (1997) · Automatica · doi:10.1016/s0005-1098(97)00128-3 · Cited by 667
Zhang, H., Luo, Y., & Liu, D. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2009.2027233 · Cited by 649
Self-citationBhasin, S., Kamalapurkar, R., Johnson, M., Vamvoudakis, K. G., Lewis, F. L., & Dixon, W. E. (2013) · Automatica · doi:10.1016/j.automatica.2012.09.019 · Cited by 642
Vrabie, D., & Lewis, F. (2009) · Neural Networks · doi:10.1016/j.neunet.2009.03.008 · Cited by 634
Zhang, H., Cui, L., & Luo, Y. (2013) · IEEE Transactions on Cybernetics · doi:10.1109/tsmcb.2012.2203336 · Cited by 464
Modares, H., Lewis, F. L., & Naghibi-Sistani, M.-B. (2013) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2276571 · Cited by 462
Wang, D., Liu, D., Wei, Q., Zhao, D., & Jin, N. (2012) · Automatica · doi:10.1016/j.automatica.2012.05.049 · Cited by 394
Self-citationOff-Policy Reinforcement Learning for $ H_\infty $ Control Design
Luo, B., Wu, H.-N., & Huang, T. (2015) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2319577 · Cited by 362
Liu, D., Wang, D., & Li, H. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2280013 · Cited by 352
Self-citationInverse optimal design of input-to-state stabilizing nonlinear controllers
Krstic, M., & Li, Z.-H. (1998) · IEEE Transactions on Automatic Control · doi:10.1109/9.661589 · Cited by 345
Inverse optimal stabilization of a rigid spacecraft
Krstić, M., & Tsiotras, P. (1999) · IEEE Transactions on Automatic Control · doi:10.1109/9.763225 · Cited by 338
Finite-Approximation-Error-Based Optimal Control Approach for Discrete-Time Nonlinear Systems
Liu, D., & Wei, Q. (2013) · IEEE Transactions on Cybernetics · doi:10.1109/tsmcb.2012.2216523 · Cited by 304
Self-citationWang, F.-Y., Jin, N., Liu, D., & Wei, Q. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2076370 · Cited by 294
Self-citationLiu, D., Li, H., & Wang, D. (2014) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2013.2295351 · Cited by 263
Self-citationFinite-Horizon Control-Constrained Nonlinear Optimal Control Using Single Network Adaptive Critics
Heydari, A., & Balakrishnan, S. N. (2013) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2012.2227339 · Cited by 246
Wang, D., Liu, D., & Li, H. (2014) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2013.2296206 · Cited by 238
Self-citationLi, H., Liu, D., & Wang, D. (2014) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2014.2300532 · Cited by 231
Self-citationXu, H., Jagannathan, S., & Lewis, F. L. (2012) · Automatica · doi:10.1016/j.automatica.2012.03.007 · Cited by 230
Wang, D., Liu, D., & Wei, Q. (2012) · Neurocomputing · doi:10.1016/j.neucom.2011.03.058 · Cited by 224
Self-citationHe, H., Ni, Z., & Fu, J. (2012) · Neurocomputing · doi:10.1016/j.neucom.2011.05.031 · Cited by 221
Liu, D., Wang, D., Zhao, D., Wei, Q., & Jin, N. (2012) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2012.2198057 · Cited by 220
Self-citationWu, H., & Luo, B. (2012) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2012.2217349 · Cited by 208
Yang, X., Liu, D., & Wang, D. (2014) · International Journal of Control · doi:10.1080/00207179.2013.848292 · Cited by 203
Self-citationAdaptive Learning in Tracking Control Based on the Dual Critic Network Design
Ni, Z., He, H., & Wen, J. (2013) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2247627 · Cited by 189
Liu, D., Li, H., & Wang, D. (2013) · Neurocomputing · doi:10.1016/j.neucom.2012.11.021 · Cited by 188
Self-citationIntelligence in the brain: A theory of how it works and how to build it
Werbos, P. J. (2009) · Neural Networks · doi:10.1016/j.neunet.2009.03.012 · Cited by 186
Wei, Q., & Liu, D. (2014) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2014.2301770 · Cited by 179
Self-citationWang, D., Liu, D., Li, H., & Ma, H. (2014) · Information Sciences · doi:10.1016/j.ins.2014.05.050 · Cited by 159
Self-citationRakshit, P., Konar, A., Bhowmik, P., Goswami, I., Das, S., Jain, L. C., & Nagar, A. K. (2013) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmca.2012.2226024 · Cited by 157
Adaptive Critic Learning Techniques for Engine Torque and Air–Fuel Ratio Control
Liu, D., Javaherian, H., Kovalenko, O., & Huang, T. (2008) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2008.922019 · Cited by 154
Self-citationLiu, D., Huang, Y., Wang, D., & Wei, Q. (2013) · International Journal of Control · doi:10.1080/00207179.2013.790562 · Cited by 138
Self-citationAn Overview of Research on Adaptive Dynamic Programming
Zhang, H., Zhang, X., Luo, Y., & Jun, Y. A. N. G. (2013) · Acta Automatica Sinica · doi:10.1016/s1874-1029(13)60031-2 · Cited by 136
Optimal control for discrete-time affine non-linear systems using general value iteration
Li, H., & Liu, D. (2012) · IET Control Theory and Applications · doi:10.1049/iet-cta.2011.0783 · Cited by 133
Self-citationLiu, D., Wang, D., & Yang, X. (2012) · Information Sciences · doi:10.1016/j.ins.2012.07.006 · Cited by 129
Self-citationGoal Representation Heuristic Dynamic Programming on Maze Navigation
Ni, Z., He, H., Wen, J., & Xu, X. (2013) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2271454 · Cited by 106
Missile defense and interceptor allocation by neuro-dynamic programming
Bertsekas, D. P., Homer, M. L., Logan, D. A., Patek, S. D., & SANDELL, N. R. (2000) · IEEE Transactions on Systems Man and Cybernetics - Part A Systems and Humans · doi:10.1109/3468.823480 · Cited by 106
Liu, D., Yang, X., & Li, H. (2012) · Neural Computing and Applications · doi:10.1007/s00521-012-1249-y · Cited by 102
Self-citationWerbos, P. J. (2008) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2008.924139 · Cited by 94
Wei, Q., & Liu, D. (2012) · Neural Networks · doi:10.1016/j.neunet.2012.02.027 · Cited by 87
Self-citationXu, X., Lian, C., Zuo, L., & He, H. (2013) · IEEE Transactions on Control Systems Technology · doi:10.1109/tcst.2013.2246866 · Cited by 71
Neuro-optimal control for a class of unknown nonlinear dynamic systems using SN-DHP technique
Wang, D., & Liu, D. (2013) · Neurocomputing · doi:10.1016/j.neucom.2013.04.006 · Cited by 54
Self-citationWang, D., Liu, D., Zhao, D., Huang, Y., & Zhang, D. (2011) · Neural Computing and Applications · doi:10.1007/s00521-011-0707-2 · Cited by 33
Self-citation
Cited by
Adaptive Dynamic Programming for Control: A Survey and Recent Advances
Liu, D., Xue, S., Zhao, B., Luo, B., & Wei, Q. (2021) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2020.3042876 · Cited by 708
Self-citationTong, S., Sun, K., & Sui, S. (2018) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2017.2686373 · Cited by 551
Value Iteration Adaptive Dynamic Programming for Optimal Control of Discrete-Time Nonlinear Systems
Wei, Q., Liu, D., & Lin, H. (2016) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2015.2492242 · Cited by 465
Self-citationHe, W., Yin, Z., & Sun, C. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2554621 · Cited by 463
Adaptive Critic Nonlinear Robust Control: A Survey
Wang, D., He, H., & Liu, D. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2017.2712188 · Cited by 374
Self-citation
Metadata
- Authors
- Liu, D., Wang, D., Wang, F.-Y., Li, H., & Yang, X.
- Venue
- IEEE Transactions on Cybernetics
- Published
- 2014-12
- Volume
- 44
- Issue
- 12
- Pages
- 2834-2847
- ISSN
- 2168-2267 (ISSN-L)
- 2168-2275
- OpenAlex
- W1989855774
- Cited by
- 310
- References
- 53
- FWCI
- 26.12
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.