The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Fuzzy H∞Control of Discrete-Time Nonlinear Markov Jump Systems via a Novel Hybrid Reinforcement Q-Learning Method
Abstract
In this article, a novel hybrid reinforcement$Q$-learning control method is proposed to solve the adaptive fuzzy$H_{\infty }$control problem of discrete-time nonlinear Markov jump systems based on the Takagi–Sugeno fuzzy model. First, the core problem of adaptive fuzzy$H_{\infty }$control is converted to solving fuzzy game coupled algebraic Riccati equation, which can hardly be solved by mathematical methods directly. To solve this problem, an offline parallel hybrid learning algorithm is first designed, where system dynamics should be known as a prior. Furthermore, an online parallel$Q$-learning hybrid learning algorithm is developed. The main characteristics of the proposed online hybrid learning algorithms are threefold: 1) system dynamics are avoided during the learning process; 2) compared with the policy iteration method, the restriction of the initial stable control policy is removed; and 3) compared with the value iteration method, a faster convergence rate can be obtained. Finally, we provide a tunnel diode circuit system model to validate the effectiveness of the present learning algorithm.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Online actor–critic algorithm to solve the continuous-time infinite horizon optimal control problem
Vamvoudakis, K. G., & Lewis, F. L. (2010) · Automatica · doi:10.1016/j.automatica.2010.02.018 · Cited by 1,703
Reinforcement learning and adaptive dynamic programming for feedback control
Lewis, F. L., & Vrabie, D. (2009) · IEEE Circuits and Systems Magazine · doi:10.1109/mcas.2009.933854 · Cited by 1,558
Lancaster, P., & Rodman, L. (1995) · doi:10.1093/oso/9780198537953.001.0001 · Cited by 1,215
Jiang, Y., & Jiang, Z.-P. (2012) · Automatica · doi:10.1016/j.automatica.2012.06.096 · Cited by 1,072
Adaptive optimal control for continuous-time linear systems based on policy iteration
Vrabie, D., Pastravanu, O., Abu-Khalaf, M., & Lewis, F. L. (2009) · Automatica · doi:10.1016/j.automatica.2008.08.017 · Cited by 949
On Designing of Sliding-Mode Control for Stochastic Jump Systems
Shi, P., Xia, Y., Liu, G. P., & Rees, D. (2006) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2005.861716 · Cited by 649
Al-Tamimi, A., Lewis, F. L., & Abu-Khalaf, M. (2007) · Automatica · doi:10.1016/j.automatica.2006.09.019 · Cited by 611 · cited 2×
“…gain K ∗ i , a and the worst disturbance gain L ∗ i , a can be expressed by the elements of optimal kernel matrix H ∗ i , a as follows: Remark 5: From (23), there exists mj = 1 , j (cid:9)= i p ij P j , a in H 11 i , a , which is different from the Q -function designed in [30], [32], and [45].”
BackgroundAdaptive Dynamic Programming and Adaptive Optimal Output Regulation of Linear Systems
Gao, W., & Jiang, Z.-P. (2016) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2016.2548662 · Cited by 413
Wang, J., Yang, C., Xia, J., Wu, Z., & Shen, H. (2021) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2021.3070125 · Cited by 367
Self-citationHewer, G. (1971) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1971.1099755 · Cited by 326
Value and Policy Iterations in Optimal Control and Adaptive Dynamic Programming
Bertsekas, D. P. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2503980 · Cited by 238
Asynchronous Dissipative Control for Fuzzy Markov Jump Systems
Wu, Z.-G., Dong, S., Su, H., & Li, C. (2018) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2017.2739754 · Cited by 200
Cheng, P., He, S., Stojanovic, V., Luan, X., & Liu, F. (2022) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2021.3050209 · Cited by 183
Quantized Feedback Control of Fuzzy Markov Jump Systems
Zhang, M., Shi, P., Ma, L., Cai, J., & Su, H. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2842434 · Cited by 173
Finite-region asynchronous H ∞ control for 2D Markov jump systems
Cheng, P., He, S., Luan, X., & Liu, F. (2021) · Automatica · doi:10.1016/j.automatica.2021.109590 · Cited by 164
Zhong, X., He, H., Zhang, H., & Wang, Z. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2014.2305841 · Cited by 153
Policy Iteration Q -Learning for Data-Based Two-Player Zero-Sum Game of Linear Discrete-Time Systems
Luo, B., Yang, Y., & Liu, D. (2020) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2020.2970969 · Cited by 144
Zero-Sum Game-Based Optimal Secure Control Under Actuator Attacks
Wu, C., Li, X., Pan, W., Liu, J., & Wu, L. (2020) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2020.3029342 · Cited by 138
Output Feedback Q-Learning Control for the Discrete-Time Linear Quadratic Regulator Problem
Rizvi, S. A. A., & Lin, Z. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2870075 · Cited by 124
Optimal Tracking Control of Nonlinear Multiagent Systems Using Internal Reinforce Q-Learning
Peng, Z., Luo, R., Hu, J., Shi, K., Nguang, S. K., & Ghosh, B. K. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3055761 · Cited by 114
H ∞ Tracking Control for Linear Discrete-Time Systems: Model-Free Q-Learning Designs
Yang, Y., Wan, Y., Zhu, J., & Lewis, F. L. (2020) · IEEE Control Systems Letters · doi:10.1109/lcsys.2020.3001241 · Cited by 66
Fang, H., Tu, Y., Wang, H., He, S., Liu, F., Ding, Z., & Cheng, S. S. (2022) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2022.3171844 · Cited by 53
Jiang, H., Zhang, H., Luo, Y., & Wang, J. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.02.029 · Cited by 41
Self-citation
Metadata
- Authors
- Wang, J., Wu, J., Shen, H., Cao, J., & Rutkowski, L.
- Venue
- IEEE Transactions on Cybernetics
- Published
- 2023-11
- Volume
- 53
- Issue
- 11
- Pages
- 7380-7391
- ISSN
- 2168-2267 (ISSN-L)
- 2168-2275
- OpenAlex
- W4310329823
- Cited by
- 321
- References
- 23
- FWCI
- 25.09
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.