The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Adaptive Dynamic Programming and Adaptive Optimal Output Regulation of Linear Systems
Abstract
This note studies the adaptive optimal output regulation problem for continuous-time linear systems, which aims to achieve asymptotic tracking and disturbance rejection by minimizing some predefined costs. Reinforcement learning and adaptive dynamic programming techniques are employed to compute an approximated optimal controller using input/partial-state data despite unknown system dynamics and unmeasurable disturbance. Rigorous stability analysis shows that the proposed controller exponentially stabilizes the closed-loop system and the output of the plant asymptotically tracks the given reference signal. Simulation results on a LCL coupled inverter-based distributed generation system demonstrate the effectiveness of the proposed approach.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Boyd, S., & Vandenberghe, L. (2004) · doi:10.1017/cbo9780511804441 · Cited by 56,601
Nonlinear and adaptive control design
Krstić, M., Kokotović, P. V., & Kanellakopoulos, I. (1995) · Cited by 10,421
Introduction to Reinforcement Learning
Sutton, R. S., & Barto, A. G. (1998) · The MIT Press eBooks · Cited by 6,855
Beyond Regression : "New Tools for Prediction and Analysis in the Behavioral Sciences
Werbos, P. J. (1974) · Medical Entomology and Zoology · Cited by 2,789
Approximate Dynamic Programming: Solving the Curses of Dimensionality
Powell, W. B. (2011) · Wiley Series in Probability and Statistics · doi:10.1002/9781118029176 · Cited by 2,297
Lewis, F. L., Vrabie, D. L., & Syrmos, V. L. (2012) · doi:10.1002/9781118122631 · Cited by 2,020
Approximate Dynamic Programming: Solving the Curses of Dimensionality
Powell, W. B. (2007) · Wiley Series in Probability and Statistics · doi:10.1002/9780470182963 · Cited by 1,566
Reinforcement learning and adaptive dynamic programming for feedback control
Lewis, F. L., & Vrabie, D. (2009) · IEEE Circuits and Systems Magazine · doi:10.1109/mcas.2009.933854 · Cited by 1,558
Nonlinear Output Regulation: Theory and Applications
Huang, J. (2004) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9780898718683 · Cited by 1,425
On an iterative technique for Riccati equation computations
Kleinman, D. (1968) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1968.1098829 · Cited by 1,210
(2012) · IEEE Control Systems · doi:10.1109/mcs.2012.2214134 · Cited by 1,105
The Linear Multivariable Regulator Problem
Francis, B. A. (1977) · SIAM Journal on Control and Optimization · doi:10.1137/0315033 · Cited by 1,092
Jiang, Y., & Jiang, Z.-P. (2012) · Automatica · doi:10.1016/j.automatica.2012.06.096 · Cited by 1,072
Self-citationIoannou, P., & Fidan, B. (2006) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9780898718652 · Cited by 972
(2011) · Encyclopedia of Machine Learning · doi:10.1007/978-0-387-30164-8_588 · Cited by 950
Zhang, H., Cui, L., Zhang, X., & Luo, Y. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2011.2168538 · Cited by 643
Al-Tamimi, A., Lewis, F. L., & Abu-Khalaf, M. (2007) · Automatica · doi:10.1016/j.automatica.2006.09.019 · Cited by 611 · cited 1×
“Examples of such noise are random noise [3] and sinusoidal signal [19].”
BackgroundZhang, H., Wei, Q., & Luo, Y. (2008) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2008.920269 · Cited by 489
Modares, H., & Lewis, F. L. (2014) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2014.2317301 · Cited by 449
Robust Adaptive Dynamic Programming and Feedback Stabilization of Nonlinear Systems
Jiang, Y., & Jiang, Z.-P. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2294968 · Cited by 414
Self-citationAdaptive linear quadratic control using policy iteration
Bradtke, S. J., Ydstie, B. E., & Barto, A. G. (2005) · Proceedings of 1994 American Control Conference - ACC '94 · doi:10.1109/acc.1994.735224 · Cited by 404
Global Adaptive Dynamic Programming for Continuous-Time Nonlinear Systems
Jiang, Y., & Jiang, Z.-P. (2015) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2015.2414811 · Cited by 241
Self-citation1 Global Adaptive Dynamic Programming for Continuous-Time Nonlinear SystemsPreprint
Jiang, Y., Member, S., & Jiang, Z. (2016) · Cited by 235
Self-citationApproximate optimal trajectory tracking for continuous-time nonlinear systems
Kamalapurkar, R., Dinh, H., Bhasin, S., & Dixon, W. E. (2015) · Automatica · doi:10.1016/j.automatica.2014.10.103 · Cited by 232
Adaptive dynamic programming and optimal control of nonlinear nonaffine systems
Bian, T., Jiang, Y., & Jiang, Z.-P. (2014) · Automatica · doi:10.1016/j.automatica.2014.08.023 · Cited by 220
Self-citationModel-based reinforcement learning for approximate optimal regulation
Kamalapurkar, R., Walters, P., & Dixon, W. E. (2016) · Automatica · doi:10.1016/j.automatica.2015.10.039 · Cited by 208
Robust adaptive dynamic programming for linear and nonlinear systems: An overview
Jiang, Z.-P., & Jiang, Y. (2013) · European Journal of Control · doi:10.1016/j.ejcon.2013.05.017 · Cited by 171
Self-citationAdaptation and regulation with signal detection implies internal model
Sontag, E. D. (2003) · Systems & Control Letters · doi:10.1016/s0167-6911(03)00136-1 · Cited by 145
The Construction of Optimal Linear and Nonlinear Regulators
Krener, A. J. (1992) · Birkhäuser Boston eBooks · doi:10.1007/978-1-4757-2204-8_21 · Cited by 130
Q-learning and Pontryagin's Minimum Principle
Mehta, P. G., & Meyn, S. (2009) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2009.5399753 · Cited by 127
Qin, C., Zhang, H., & Luo, Y. (2013) · International Journal of Control · doi:10.1080/00207179.2013.863432 · Cited by 112
Output Regulation of Uncertain Nonlinear Systems With Nonlinear Exosystems
Ding, Z. (2006) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2005.864199 · Cited by 107
Huang, Y., & Liu, D. (2013) · Neurocomputing · doi:10.1016/j.neucom.2012.07.047 · Cited by 98
Nonlinear Control of Dynamic Networks
Liu, T., Jiang, Z., & Hill, D. J. (2014) · CRC Press eBooks · doi:10.1201/b16759 · Cited by 93
Self-citationConvergence analysis of adaptive critic based optimal control
Liu, X., & Balakrishnan, S. N. (2000) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.1109/acc.2000.879538 · Cited by 80
An adaptive critic global controller
Ferrari, S., & Stengel, R. F. (2002) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.1109/acc.2002.1025189 · Cited by 66
On optimal output regulation for linear systems
Saberi, A., Stoorvogel, A. A., Sannuti, P., & Shi, G. (2003) · International Journal of Control · doi:10.1080/0020717031000073054 · Cited by 51
Asymptotic tracking by a reinforcement learning-based adaptive critic controller
Bhasin, S., Sharma, N., Patre, P. M., & Dixon, W. E. (2011) · Journal of Control Theory and Applications · doi:10.1007/s11768-011-0170-8 · Cited by 50
Adaptive dynamic programming as a theory of sensorimotor control
Jiang, Y., & Jiang, Z. (2014) · Biological Cybernetics · doi:10.1007/s00422-014-0613-7 · Cited by 40
Self-citationA robust adaptive dynamic programming principle for sensorimotor control with signal-dependent noise
Jiang, Y., & Jiang, Z. (2015) · Journal of Systems Science and Complexity · doi:10.1007/s11424-015-3310-2 · Cited by 17
Self-citationGao, W., & Jiang, Z. (2015) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2015.09.278 · Cited by 17
Self-citation
Cited by
Adaptive Dynamic Programming for Control: A Survey and Recent Advances
Liu, D., Xue, S., Zhao, B., Luo, B., & Wei, Q. (2021) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2020.3042876 · Cited by 708
Adaptive Critic Nonlinear Robust Control: A Survey
Wang, D., He, H., & Liu, D. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2017.2712188 · Cited by 374
Wang, D., Gao, N., Liu, D., Li, J., & Lewis, F. L. (2024) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2023.123843 · Cited by 364
Wang, J., Wu, J., Shen, H., Cao, J., & Rutkowski, L. (2023) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2022.3220537 · Cited by 321
Gao, W., Jiang, Y., Jiang, Z.-P., & Chai, T. (2016) · Automatica · doi:10.1016/j.automatica.2016.05.008 · Cited by 234
Self-citation
Metadata
- Authors
- Gao, W., & Jiang, Z.-P.
- Venue
- IEEE Transactions on Automatic Control
- Published
- 2016-12
- Volume
- 61
- Issue
- 12
- Pages
- 4164-4169
- ISSN
- 0018-9286 (ISSN-L)
- 1558-2523
- OpenAlex
- W2333120204
- Cited by
- 413
- References
- 42
- FWCI
- 34.83
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.