The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Handbook of Learning and Approximate Dynamic Programming
Abstract
. A complete resource to Approximate Dynamic Programming (ADP), including on-line simulation code. Provides a tutorial that readers can use to start implementing the learning algorithms provided in the book. Includes ideas, directions, and recent results on current research issues and addresses applications where ADP has been successfully implemented. The contributors are leading researchers in the field
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Bellman, R. E. (2010) · doi:10.1515/9781400835386 · Cited by 14,588
Reinforcement Learning: A Survey
Kaelbling, L. P., Littman, M. L., & Moore, A. W. (1996) · Journal of Artificial Intelligence Research · doi:10.1613/jair.301 · Cited by 8,972
(2012) · Encyclopedia of the Sciences of Learning · doi:10.1007/978-1-4419-1428-6_5086 · Cited by 3,515
A Course in Fuzzy Systems and Control
Wang, L.-X. (1996) · Medical Entomology and Zoology · Cited by 3,160
Fuzzy Logic: Intelligence, Control, and Information
Yen, J., & Langari, R. (1998) · Medical Entomology and Zoology · Cited by 1,337
Prokhorov, D. V., & Wunsch, D. C. (1997) · IEEE Transactions on Neural Networks · doi:10.1109/72.623201 · Cited by 1,186
Self-citation(2012) · SpringerReference · doi:10.1007/springerreference_117344 · Cited by 1,047
Murray, J. J., Cox, C. J., Lendaris, G. G., & Saeks, R. (2002) · IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2002.801727 · Cited by 677
Automatic Discovery of Subgoals in Reinforcement Learning using Diverse Density
McGovern, A., & Barto, A. G. (2001) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 418
Self-citationPunish/Reward: Learning with a Critic in Adaptive Threshold Systems
Widrow, B., Gupta, N. K., & Maitra, S. (1973) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1973.4309272 · Cited by 280
Adaptive critic designs: A case study for neurocontrol
Prokhorov, D. V., Santiago, R. A., & Wunsch, D. C. (1995) · Neural Networks · doi:10.1016/0893-6080(95)00042-9 · Cited by 199
Self-citationAdaptive control of nonlinear multivariable systems using neural networks
Narendra, K. S., & Mukhopadhyay, S. (1994) · Neural Networks · doi:10.1016/0893-6080(94)90096-5 · Cited by 172
Lyapunov design for safe reinforcement learning
Perkins, T. J., & Barto, A. G. (2003) · doi:10.5555/944919.944955 · Cited by 148
Self-citationStability analysis of discrete-time recurrent neural networks
Barabanov, N., & Prokhorov, D. V. (2002) · IEEE Transactions on Neural Networks · doi:10.1109/72.991416 · Cited by 125
Training strategies for critic and action neural networks in dual heuristic programming method
Lendaris, G. G., & Paintz, C. (2002) · IEEE International Conference on Neural Networks/IEEE ... International Conference on Neural Networks · doi:10.1109/icnn.1997.616109 · Cited by 82
Convergence analysis of adaptive critic based optimal control
Liu, X., & Balakrishnan, S. N. (2000) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.1109/acc.2000.879538 · Cited by 80
Robust reinforcement learning control with static and dynamic stability
Kretchmar, R. M., Young, P. M., Anderson, C. W., Hittle, D. C., Anderson, M. L., & Delnero, C. C. (2001) · International Journal of Robust and Nonlinear Control · doi:10.1002/rnc.670 · Cited by 75
Haykin, S. (1994) · Springer eBooks · doi:10.1007/978-94-011-1056-3_1 · Cited by 73
Neurocontroller alternatives for "fuzzy" ball-and-beam systems with nonuniform nonlinear friction
Eaton, P. H., Prokhorov, D. V., & Wunsch, D. C. (2000) · IEEE Transactions on Neural Networks · doi:10.1109/72.839012 · Cited by 71
Self-citationReinforcement Learning is Direct Adaptive Optimal Control
Sutton, R. S., Barto, A. G., & Williams, R. J. (1991) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.23919/acc.1991.4791776 · Cited by 68
Self-citationAdaptive critic design for intelligent steering and speed control of a 2-axle vehicle
Lendaris, G. G., Schultz, L., & Shannon, T. T. (2000) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2000.861283 · Cited by 42
Control of a nonlinear multivariable system with adaptive critic designs
Visnevski, N. A. (1997) · ThinkTech (Texas Tech University) · Cited by 24
Proposed framework for applying adaptive critics in real-time realm
Lendaris, G. G., Santiago, R. A., & Carroll, M. S. (2003) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2002.1007791 · Cited by 8
Cited by
Online actor–critic algorithm to solve the continuous-time infinite horizon optimal control problem
Vamvoudakis, K. G., & Lewis, F. L. (2010) · Automatica · doi:10.1016/j.automatica.2010.02.018 · Cited by 1,703
Reinforcement learning and adaptive dynamic programming for feedback control
Lewis, F. L., & Vrabie, D. (2009) · IEEE Circuits and Systems Magazine · doi:10.1109/mcas.2009.933854 · Cited by 1,558
(2012) · IEEE Control Systems · doi:10.1109/mcs.2012.2214134 · Cited by 1,105
Discrete-Time Nonlinear HJB Solution Using Approximate Dynamic Programming: Convergence Proof
Al-Tamimi, A., Lewis, F. L., & Abu-Khalaf, M. (2008) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2008.926614 · Cited by 1,075
Adaptive Dynamic Programming: An Introduction
Wang, F.-Y., Zhang, H., & Liu, D. (2009) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2009.932261 · Cited by 898
Metadata
- Authors
- Si, J., Barto, A. G., Powell, W. B., & Wunsch, D.
- Venue
- Institute of Electrical and Electronics Engineers eBooks
- Publisher
- IEEE
- Published
- 2004
- OpenAlex
- W1854776945
- Cited by
- 856
- References
- 24
- FWCI
- 10.01
- Type
- book
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.