The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Online actor–critic algorithm to solve the continuous-time infinite horizon optimal control problem
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
(2012) · Encyclopedia of the Sciences of Learning · doi:10.1007/978-1-4419-1428-6_5086 · Cited by 3,515
Dynamic Programming and Markov Processes.
Freimer, M., & Howard, R. A. (1961) · Journal of the American Statistical Association · doi:10.2307/2282268 · Cited by 3,378
Aircraft Control and Simulation
Stevens, B., & Lewis, F. L. (2004) · Aircraft Engineering and Aerospace Technology · doi:10.1108/aeat.2004.12776eae.001 · Cited by 3,167
Self-citationLewis, F. L. (1986) · Cited by 2,948
Self-citationBeyond Regression : "New Tools for Prediction and Analysis in the Behavioral Sciences
Werbos, P. J. (1974) · Medical Entomology and Zoology · Cited by 2,789
Hornik, K., Stinchcombe, M., & White, H. (1990) · Neural Networks · doi:10.1016/0893-6080(90)90005-6 · Cited by 2,111
The Method of Weighted Residuals and Variational Principles
Finlayson, B. A. (2013) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611973242 · Cited by 1,945
Neural Network Control Of Robot Manipulators And Non-Linear Systems
Lewis, F. W., Jagannathan, S., & Yesildirak, A. (2020) · CRC Press eBooks · doi:10.1201/9781003062714 · Cited by 1,867
Self-citation
Cited by
(2012) · IEEE Control Systems · doi:10.1109/mcs.2012.2214134 · Cited by 1,105
Jiang, Y., & Jiang, Z.-P. (2012) · Automatica · doi:10.1016/j.automatica.2012.06.096 · Cited by 1,072
A Survey of Actor-Critic Reinforcement Learning: Standard and Natural Policy Gradients
Grondman, I., Busoniu, L., Lopes, G. A. D., & Babuska, R. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2012.2218595 · Cited by 1,042
Formulas for Data-Driven Control: Stabilization, Optimality, and Robustness
De Persis, C., & Tesi, P. (2020) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2019.2959924 · Cited by 983
Optimal and Autonomous Control Using Reinforcement Learning: A Survey
Kiumarsi, B., Vamvoudakis, K. G., Modares, H., & Lewis, F. L. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2773458 · Cited by 891
Self-citationVamvoudakis, K. G., Lewis, F. L., & Hudas, G. R. (2012) · Automatica · doi:10.1016/j.automatica.2012.05.074 · Cited by 571
Self-citationTong, S., Sun, K., & Sui, S. (2018) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2017.2686373 · Cited by 551
Lewis, F. L., & Vamvoudakis, K. G. (2011) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2010.2043839 · Cited by 544
Self-citationVamvoudakis, K. G., & Lewis, F. L. (2011) · Automatica · doi:10.1016/j.automatica.2011.03.005 · Cited by 525
Self-citationZhang, H., Cui, L., & Luo, Y. (2013) · IEEE Transactions on Cybernetics · doi:10.1109/tsmcb.2012.2203336 · Cited by 464
Modares, H., Lewis, F. L., & Naghibi-Sistani, M.-B. (2013) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2276571 · Cited by 462
Self-citationLiu, D., Yang, X., Wang, D., & Wei, Q. (2015) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2015.2417170 · Cited by 440
Off-Policy Reinforcement Learning for $ H_\infty $ Control Design
Luo, B., Wu, H.-N., & Huang, T. (2015) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2319577 · Cited by 362
Liu, D., Wang, D., & Li, H. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2280013 · Cited by 352
Optimized Backstepping for Tracking Control of Strict-Feedback Systems
Wen, G., Ge, S. S., & Tu, F. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2803726 · Cited by 332
Reinforcement learning-based optimal tracking control of an unknown unmanned surface vehicle
Wang, N., Gao, Y., Zhao, H., & Ahn, C. K. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3009214 · Cited by 322
Liu, D., Wang, D., Wang, F.-Y., Li, H., & Yang, X. (2014) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2357896 · Cited by 310
Wei, Y., Yu, F. R., Song, M., & Han, Z. (2018) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2017.2769644 · Cited by 301
Reinforcement Learning Control of a Flexible Two-Link Manipulator: An Experimental Investigation
He, W., Gao, H., Zhou, C., Yang, C., & Li, Z. (2021) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2020.2975232 · Cited by 284
Data-Driven Performance-Prescribed Reinforcement Learning Control of an Unmanned Surface Vehicle
Wang, N., Gao, Y., & Zhang, X. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3056444 · Cited by 282
An Event-Triggered ADP Control Approach for Continuous-Time System With Unknown Internal States
Zhong, X., & He, H. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2523878 · Cited by 263
Cao, S., Sun, L., Jiang, J., & Zuo, Z. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3116713 · Cited by 221
Learning-Based Adaptive Optimal Tracking Control of Strict-Feedback Nonlinear Systems
Gao, W., & Jiang, Z.-P. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2761718 · Cited by 176
Network planning with deep reinforcement learning
Zhu, H., Gupta, V., Ahuja, S. S., Tian, Y., Zhang, Y., & Jin, X. (2021) · Proceedings of the 2021 ACM SIGCOMM 2021 Conference · doi:10.1145/3452296.3472902 · Cited by 112
Neural Operators for Bypassing Gain and Control Computations in PDE Backstepping
Bhan, L., Shi, Y., & Krstic, M. (2024) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2023.3347499 · Cited by 58
Metadata
- Authors
- Vamvoudakis, K. G., & Lewis, F. L.
- Venue
- Automatica
- Publisher
- Elsevier BV
- Published
- 2010-05
- Volume
- 46
- Issue
- 5
- Pages
- 878-888
- ISSN
- 0005-1098 (ISSN-L)
- OpenAlex
- W1983523797
- Cited by
- 1,703
- References
- 31
- FWCI
- 39.51
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.