Reinforcement Learning and Approximate Dynamic Programming for Feedback Control
The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Abstract
In this chapter, we extend the ADP algorithm, dual heuristic programming (DHP), to include a “bootstrapping” parameter λ, analogous to that used in the reinforcement learning algorithm TD(λ). The resulting algorithm, which we call VGL(λ) for value-gradient learning, is proven to produce a weight update that can be equivalent to backpropagation through time (BPTT) applied to a greedy policy on a critic function. This provides a surprising connection between the two alternate methods of BPTT and DHP. Under certain smoothness conditions, VGL(λ=1) with a greedy policy acquires the strong convergence conditions of BPTT, while using a general function approximator for the critic. We show that this can lead to increased stability in the learning of control problems by a neural network
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“ADP represents a kind of data-based control technique which can guarantee the stability of the feedback control system [9].”
From Data-driven control of hydraulic servo actuator: An event-triggered adaptive dynamic programming approach (2023) · cites this paper as [9]
In the citing paper
“Even if an approximated model of the HSA can be developed, the dynamic uncertainty, produced by the mismatch between the approximated model and the true HSA model, will degrade the control performance of the traditionally designed optimal controller [9,12].”
From Data-driven control of hydraulic servo actuator: An event-triggered adaptive dynamic programming approach (2023) · cites this paper as [9]
In the citing paper
“Adaptive dynamic programming (ADP) ensures an e ective way to achieve high performance of the optimal controller which relies on adaptive control, optimal control and reinforcement learning [9, 23-26].”
From Data-driven control of hydraulic servo actuator: An event-triggered adaptive dynamic programming approach (2023) · cites this paper as [9]
Citations
Cites
Neural Networks for Pattern Recognition
Bishop, C. M. (1995) · doi:10.1093/oso/9780198538493.001.0001 · Cited by 12,287
Watkins, C. (1989) · OpenGrey (Institut de l'Information Scientifique et Technique) · doi:10.17863/cam.132164 · Cited by 5,297
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148
Backpropagation through time: what it does and how to do it
Werbos, P. J. (1990) · Proceedings of the IEEE · doi:10.1109/5.58337 · Cited by 4,879
Online actor–critic algorithm to solve the continuous-time infinite horizon optimal control problem
Vamvoudakis, K. G., & Lewis, F. L. (2010) · Automatica · doi:10.1016/j.automatica.2010.02.018 · Cited by 1,703
Approximate dynamic programming for real-time control and neural modeling
Werbos, P. J. (1992) · Cited by 1,427
An analysis of temporal-difference learning with function approximation
Tsitsiklis, J. N., & Van Roy, B. (1997) · IEEE Transactions on Automatic Control · doi:10.1109/9.580874 · Cited by 1,194
Prokhorov, D. V., & Wunsch, D. C. (1997) · IEEE Transactions on Neural Networks · doi:10.1109/72.623201 · Cited by 1,186
Self-citationDiscrete-Time Nonlinear HJB Solution Using Approximate Dynamic Programming: Convergence Proof
Al-Tamimi, A., Lewis, F. L., & Abu-Khalaf, M. (2008) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2008.926614 · Cited by 1,075
Approximate dynamic programming for real-time control and neural modeling
Werbos, P. J. (1992) · Medical Entomology and Zoology · Cited by 971
Cited by
Items 501–584 of 584
Multi-agent Networked Systems with Adversarial Elements
Başar, T. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10696-0_2
MULTIFACETED ATTACK ANALYSIS ON POWER GRIDS
Zhu, Y. (2014) · Digital Commons - URI (University of Rhode Island) · doi:10.23860/diss-zhu-yihai-2014
“Recently, the hybrid model, called the extended model, is proposed to investigate the vulnerability of power grids [11, 28].”
BackgroundMethodInfluentialNeural Control and Approximate Dynamic Programming
Lewis, F. L. (2014) · Springer eBooks · doi:10.1007/978-1-4471-5102-9_224-1
Goal Representation Adaptive Dynamic Programming for Machine Intelligence
Ni, Z. (2015) · Digital Commons - URI (University of Rhode Island) · doi:10.23860/diss-ni-zhen-2015
Neuro-optimal learning control scheme for gasification process with unknown system model
Wei, Q., & Liu, D. (2013) · International Conference on Advanced Computational Intelligence (ICACI) · doi:10.1109/icaci.2013.6748530
Approximation of Agent Dynamics Using Reinforcement Learning
Kirkpatrick, K., & Valasek, J. (2013) · AIAA Aerospace Sciences Meeting · doi:10.2514/6.2013-875
Evolutionary Function Approximation for Gait Generation on Legged Robots
Silva, O. A., & Solís, M. A. (2015) · Studies in systems, decision and control · doi:10.1007/978-3-319-26230-7_10
Cooperative Learning for Robust Connectivity in Multirobot Heterogeneous Networks
Cruz, P. J., Fierro, R., & Abdallah, C. T. (2016) · Elsevier eBooks · doi:10.1016/b978-0-12-805246-4.00015-x
Data-based robust control for unknown nonlinear systems
Yang, X., Liu, D., & Wei, Q. (2016) · Chinese Control Conference (CCC) · doi:10.1109/chicc.2016.7553838
“During past several decades, reinforcement learning (RL) has received considerable attention [1–4].”
BackgroundLu, P., Liu, X., & Bian, T. (2016) · Chinese Control Conference (CCC) · doi:10.1109/chicc.2016.7553750
“The convergence proof of Algorithm 1 is similar to the proof in [37], and thus is omitted.”
MethodJoint Routing and Bitrate Adjustment for DASH Video via Neuro-Dynamic Programming in SDN
Zhu, K., Jiang, J., Yang, B., Cai, W., & Yang, J. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46687-3_46
Optimal switching of DC-DC voltage converters using approximate dynamic programming
Heydari, A. (2016) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2016.7727756
“Interested readers are referred to the chapters in Ref.”
BackgroundManifold regularization based approximate value iteration for learning control
Li, H., He, M., Zhang, X., & Ren, C. (2016) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2016.7727678
Li, C., Wang, D., & Liu, D. (2016) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2016.7727795
“Lewis and Vrabie [9], and Lewis and Liu [10] stated that the ADP technique is closely related to the filed of RL. Recently, the researches on ADP and RL have gained much attention from various scholars [11], [12], [13], [14], [15], [16], [17], [18], [19], [20], [21].”
BackgroundDecentralized Control of Continuous-Time Interconnected Nonlinear Systems
Liu, D., Wei, Q., Wang, D., Yang, X., & Li, H. (2017) · Advances in industrial control · doi:10.1007/978-3-319-50815-3_10
On-Line Adaptive Dynamic Programming for Feedback Control
Zhong, X. (2017) · Digital Commons - URI (University of Rhode Island) · doi:10.23860/diss-zhong-xiangnan-2017
“Recently, neural-network-based event-triggered optimal control approaches were proposed and demonstrated with the promising performance in [8], [9], [10].”
BackgroundInfluentialAn Adaptive Dynamic Programming Control Scheme Using Tunable Radial Basis Function
Bi, J., Luo, X., & Wang, W. (2017) · Lecture notes in electrical engineering · doi:10.1007/978-981-10-6445-6_50
Model-Free Optimal Control: A Critical Analysis
Chellaboina, V.-S. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-72413-3_14
Two-Person Zero-Sum Differential Games and H $$\infty $$ ∞ Control
Szuster, M., & Hendzel, Z. (2017) · Studies in systems, decision and control · doi:10.1007/978-3-319-68826-8_9
Applying expectation-maximization evaluation on approximate optimal control
Zhang, S., & Dubay, R. (2018) · IEEE International Systems Conference (SysCon) · doi:10.1109/syscon.2018.8369536
Robust Optimal Control of Nonlinear Systems with Matched Uncertainties
Wang, D., & Mu, C. (2018) · Studies in systems, decision and control · doi:10.1007/978-981-13-1253-3_2
A Learning Controller Design Approach for A 3-DOF Helicopter System with Online Optimal Control
Sousa, G. B. D., R.Lima, J. V., Rêgo, P. H. M., Souza, A. G., & FonsecaNeto, J. V. (2019) · doi:10.5121/csit.2019.90502
Research on Online Reinforcement Learning Method Based on Experience-Replay
Hu, N., Ge, Z., Chen, X., Ding, C., & Shi, H. (2018) · IEEE International Conference on Information and Automation (ICIA) · doi:10.1109/icinfa.2018.8812454
“Approximate Expression of Reinforcement Learning In practice, when the state-action space is large, it is difficult to define all the state action pairs accurately, so approximate representation should be used [15].”
BackgroundClosed-loop Model Selection for Kernel-based Models using Bayesian Optimization
Beckers, T. L., Bansal, S., Tomlin, C. J., & Hirche, S. (2019) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc40024.2019.9029690
“ever, these approaches are mostly limited to linear systems and controllers or assume at least a parametric system model. Recently, learning-based controller tuning mechanisms have also been proposed [14], [15], but such methods might be highly data-inefficient for general nonlinear systems as they typically completely…”
BackgroundLewis, F. L., & Vamvoudakis, K. G. (2020) · Springer eBooks · doi:10.1007/978-1-4471-5102-9_224-3
Constrained Optimal Tracking Control of Unknown Systems: A Multi-Step Linear Programming Approach
Tanzanakis, A., & Lygeros, J. (2020) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc42340.2020.9304315
“Reinforcement Learning (RL) [1] is currently in the spotlight of the modern control engineering community.”
BackgroundModeling for Dynamic Programming
Brandimarte, P. (2021) · EURO advanced tutorials on operational research · doi:10.1007/978-3-030-61867-4_3
Adaptive Dynamic Programming in the Hamiltonian-Driven Framework
Yang, Y., Wunsch, D. C., & Yin, Y. (2021) · Studies in systems, decision and control · doi:10.1007/978-3-030-60990-0_7
Value iteration with deep neural networks for optimal control of input-affine nonlinear systems
Beppu, H., Maruta, I., & Fujimoto, K. (2021) · SICE Journal of Control Measurement and System Integration · doi:10.1080/18824889.2021.1936817
“process control [6] and vehicle routing problems [7].”
BackgroundMi, P., Wu, Q., & Wang, Y. (2021) · Research Square · doi:10.21203/rs.3.rs-1122865/v1
“The dynamic systems are often required to be globally Lipschitz continuous [11], and the NSHVs’ longitudinal dynamic systems satisfy this condition.”
BackgroundLin, M., Zhao, B., Liu, D., Liu, X., & Luo, F. (2021) · Chinese Control and Decision Conference (CCDC) · doi:10.1109/ccdc52312.2021.9601467
“In the field of intelligent control, RL always refers to approximate/adaptive dynamic programming (ADP) [5, 6, 7], neuro-dynamic programming (NDP) [8] or adaptive critic designs (ACD) [9].”
BackgroundAn Intelligent and Secure Control Approach for Nonlinear Systems under Attacks
Zhong, X., & Ni, Z. (2021) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci50451.2021.9659857
Mi, P., Wu, Q., & Wang, Y. (2022) · Research Square · doi:10.21203/rs.3.rs-1122865/v2
Mi, P., Wu, Q., & Wang, Y. (2022) · Research Square · doi:10.21203/rs.3.rs-1122865/v3
Jiang, Y., & Jiang, Z. (2017) · Wiley eBooks · doi:10.1002/9781119132677.ch1
Lewis, F. L., & Vamvoudakis, K. G. (2021) · Springer eBooks · doi:10.1007/978-3-030-44184-5_224
Reinforcement Learning for Approximate Optimal Control
Dixon, W. E. (2020) · Springer eBooks · doi:10.1007/978-1-4471-5102-9_100063-1
Global Linear Convergence of Online Reinforcement Learning for Partially Observable Systems
Hirai, T., & Sadamoto, T. (2022) · European Control Conference (ECC) · doi:10.23919/ecc55457.2022.9838197
Structured Online Learning‐Based Control of Continuous‐Time Nonlinear Systems
Liu, J., & Farsi, M. (2022) · Wiley eBooks · doi:10.1002/9781119808602.ch5
Optimal Event-Triggered $H_{\infty}$ Control for Nonlinear Systems with Completely Unknown Dynamics
Chu, K., Peng, Z., Zhang, Z., Huang, R., Shi, K., & Cheng, H. (2022) · Chinese Control Conference (CCC) · doi:10.23919/ccc55666.2022.9902398
“Therefore, motivated by the works in [3, 6], we will develop a new online ADP methods which involves simultaneous tuning of the identifier and critic NNs to learn online in real-time the solution to Equation (8).”
MethodEvent-Triggered Control of Nonlinear Systems with Functional Gain
Zhang, X. (2023) · Intelligent control and learning systems · doi:10.1007/978-981-19-8334-4_4
On the Critic Intelligence for Discrete-Time Advanced Optimal Control Design
Wang, D., Ha, M., & Zhao, M. (2023) · Intelligent control and learning systems · doi:10.1007/978-981-19-7291-1_1
Learning Adaptive Optimal Controllers for Linear Time-Delay Systems *
Cui, L., Pang, B., & Jiang, Z. (2023) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.23919/acc55779.2023.10156108 · Cited by 1
“As in the literature of ADP-based data-driven control [3], [4], one can fulfill it by means of added exploration noise, such as sinusoidal signals and random noise.”
BackgroundMethodSupplemental Control of Hydraulic Systems with Adaptive/Approximate Dynamic Programming
Yao, Z., Jiang, G., Xu, F., & Yao, J. (2023) · Chinese Control Conference (CCC) · doi:10.23919/ccc58697.2023.10240766
Optimal Event-Triggered Control of Constrained Nonlinear Systems
Zheng, W., Xu, M., & Yang, X. (2023) · Chinese Control Conference (CCC) · doi:10.23919/ccc58697.2023.10240743
“RL and ADP combining the merits of approximation and dynamic programming are considered as useful tools to handle optimal control issues.”
BackgroundInfluentialHuang, Y., & Zhang, Z. (2023) · Entropy · doi:10.3390/e25121570
“…˙˜ W c = − ˙ˆ W c and incorporating (51) into (49), we obtain Next, the main stability theorem is presented, but before that, one basic common assumption for the critic NN is introduced [16], and the other assumption for the sliding-mode dynamics is also needed, which has been used in [34,38].”
BackgroundMethodInfluentialAdaptive critic control for spacecraft attitude tracking with appointed-time convergence
Shi, X., & Zhou, Z. (2023) · Chinese Control and Decision Conference (CCDC) · doi:10.1109/ccdc58219.2023.10326633
“Among them, the ADP as one of reinforcement learning schemes is utilized extensively to solve the optimal control problem [13], in which some intelligent technologies (such as the neural network and fuzzy systems) are used to approximate the iterative performance index function and control policy.”
MethodBahrami, V., Masouleh, M. T., & Kalhor, A. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4673809
Influenza a infections in the host : modeling and control approaches
Mejía, G. H. (2023) · Publication Server of Goethe University Frankfurt am Main (Goethe University Frankfurt) · doi:10.21248/gups.81763
Optimal Adaptive Control of Power Converters Using Reinforcement LearningPreprint
Zandi, O., & Poshtan, J. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4758756
Frequency Synchronization in Isolated AC Micro-Grids by Cooperative Distributed Q-Learning
Lin, S.-W., Chu, C., & Tung, C.-F. (2024) · IEEE/IAS Industrial and Commercial Power Systems Technical Conference · doi:10.1109/icps60943.2024.10563376
“Consequently, the concept of multi-agent RL (MARL) has emerged recently to confront sequential decision-making problems where more than one learning agent is engaged [11]–[13].”
BackgroundOnline Finite-Horizon ADP Algorithm for Solving Non-Cooperative Differential Games
Gao, Y., & Ma, K. (2024) · Chinese Control and Decision Conference (CCDC) · doi:10.1109/ccdc62350.2024.10587453
“Among the existing learning techniques for feedback control, adaptive dynamic programming (ADP) is a powerful tool to address the curse of dimension in dynamic programming (DP) [3]–[5].”
BackgroundReinforcement Learning Integrated Nonlinear Controller for Guaranteed Stability
Nan, S., & Qian, C. (2024) · International Conference on System of Systems Engineering · doi:10.1109/sose62659.2024.10620953
Robust Optimal Tracking Control Using Adaptive Disturbance Observer for Wheeled Mobile Robot
Nguyen, N. D., & Nguyen, N. H. (2024) · Lecture notes in networks and systems · doi:10.1007/978-3-031-62235-9_40
Reactive Current Proportional Coefficient Adjustment Based on Reinforcement Learning
Mengqi, Q., Da, H., Xiyue, W., Guoli, H., Liu, Y., & Deping, K. (2025) · Lecture notes in electrical engineering · doi:10.1007/978-981-96-1671-8_21
Wu, Y., Zhang, J., & Jin, L. (2024) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc56724.2024.10886356
“However, existing theory on RL mostly, to the best of our knowledge, considers MDPs with finite or bounded state spaces [10], [11], [12]; the theory on infinite/unbounded state spaces is limited to very special problems (e.g., linear-quadratic regulation [13]).”
On-Policy and Off-Policy Value Iteration Algorithms for Stochastic Zero-Sum Dynamic Games
Guo, L., Wang, B., & Zhang, J. (2025) · Journal of Systems Science and Complexity · doi:10.1007/s11424-025-4572-y
“For ADP, the iterative procedure involves two parts: The policy evaluation and the policy improvement [9] .”
Singh, A., Kaur, S., & Goel, K. (2025) · Lecture notes in networks and systems · doi:10.1007/978-981-96-3352-4_30
Disturbance-resilient learning and control for dirigible airships with imprecise system dynamics
Boase, D., Miah, S., & Gueaieb, W. (2025) · International Journal of Intelligent Robotics and Applications · doi:10.1007/s41315-025-00480-0
Geiger, M., & Jagannathan, S. (2025) · IEEE Conference on Control Technology and Applications (CCTA) · doi:10.1109/ccta53793.2025.11151392
Online Safety-Embedded Critic Learning for Uncertain Systems With Self-Triggered Mechanism
Shangguan, Z., Yang, B., Li, Q., Xiao, W., & Guan, X. (2026) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2026.3660580
“Leveraging this structure, Lyapunov-based RL utilizes stability-driven adaptation laws to obtain online, computationally efficient update rules that bypass the iterative policy-improvement procedures common in conventional RL [3].”
Reduced-Order Online Robust Control for Linear Systems Over Stochastic MIMO Vehicular Channels
Tang, M., Feng, C., Min, G., & Quek, T. Q. S. (2026) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2026.3668012
In-Situ Learning in Drones: Rethinking Embodied Intelligence Without Sim-to-Real
Chen, A. S., Meng, S. S., & Li, Z. (2026) · IOP Conference Series Materials Science and Engineering · doi:10.1088/1757-899x/1343/1/012015
“Closed-form solutions of (9) are intractable for nonlinear systems, motivating approximate dynamic programming (ADP) and reinforcement learning Sutton and Barto [2018], Vrabie and Lewis [2009], Lewis and Liu [2012].”
Stabilization and control of dynamic systems : from classical methods to reinforcement learning
Lichtlé, N. (2024) · theses.fr (ABES) · doi:10.70675/608e2470z5716z4788z91f2z286ac766f15b
Contributions to Safe Reinforcement Learning and Degradation Tolerant Control Design
Kanso, S. (2024) · theses.fr (ABES) · doi:10.70675/0384b444z74d1z45bdz9163z40c88b99bc22
Geiger, M., & Jagannathan, S. (2026) · IEEE Transactions on Control Systems Technology · doi:10.1109/tcst.2026.3682792
Approximate Optimal Control for Morphing Aircraft via Attention Meta-Learning and Continual Learning
Che, H., & Wu, H. (2026) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2026.3687995
“RL addresses this via approximate dynamic programming (ADP), providing numerical approximations to the HJB and yielding stabilizing, near-optimal controllers [19], [20], [21].”
Liu, S., Davari, M., Gao, W., Qasem, O., & Chai, T. (2026) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2026.3679825
“It is a data-driven reinforcement learning approach that does not require prior knowledge of system dynamics and is being applied to different applications, see [2], [3], [4], [5], [6], [7], [8], [9], [10], [11], [12], [13], and [14].”
Poznyak, A., & Chaírez, I. (2026) · Mathematics · doi:10.3390/math14112024
Designing An Optimal Control System For Active Suspension
Hoang, V. N., & Thi, H. N. (2026) · International Journal Of Engineering And Computer Science · doi:10.18535/ijecs/v15i06.5538
Decentralized Dynamic Event-Driven H ∞ Tracking Control of Cascade Interconnected CSTR Systems
Yang, X., & Meng, J. (2026) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2026.3711181
“…also referred to as reinforcement learning (RL) [5], has emerged as an e ffi cient tool to acquire numerical solutions of HJIEs ( note : According to [5], the two terms ADP and RL are often used interchangeably, as they share identical underlying principles and similar implementation frameworks for…”
Delay-Aware Dynamics Modeling and Data-Driven Optimal Control of Mixed Vehicle Platoons
Shi, Q., Wang, Q., & Peng, L. (2026) · IEEE Internet of Things Journal · doi:10.1109/jiot.2026.3714915
“Recalling the classical model-based value iteration algo-rithm [20], the Riccati solution P ∗ can be obtained by iterating starting from any initial P (0) ∈ R n z × n z (cid:31) 0.”
InfluentialRehan, A., Chehadeh, M. S., Boiko, I. M., & Zweiri, Y. (2026) · IEEE Transactions on Control Systems Technology · doi:10.1109/tcst.2026.3713360
“While RL as a methodology was first introduced in the 1980s into the main-stream, followed by several influential textbooks, [9], [10], we point to more recent survey papers, such as [4], and [8], which summarize the fundamental principles and the current challenges in the field.”
AI-driven control for dynamical systems: Taxonomy, guarantees, and applications
Liu, J., Ren, Y., Qian, S., Jin, X., & Li, F. (2026) · Discrete and Continuous Dynamical Systems - I Intelligence · doi:10.3934/dcdsi.r260301
Time-Varying RISE-Based Reinforcement Learning for Tracking Control of a Mecanum Robot
Đông, N. M., & Nguyễn, H. B. (2026) · IEEE Access · doi:10.1109/access.2026.3735351
Stojanović, V., Pršić, D., Dubonjić, L., Defoort, M., Song, X., & Song, S. (2026) · IEEE Lasers and Electro-Optics Society Annual Meeting (LEOS) · doi:10.46793/et26.d04s
Event-triggered output-feedback ADP for single-joint robotic manipulators with unknown dynamics
Prodanović, S., Bernardi, E., Luan, X., Stojanović, V., & Paszke, W. (2026) · IEEE Lasers and Electro-Optics Society Annual Meeting (LEOS) · doi:10.46793/et26.d05p
Hybrid Data-Event Mechanism for Optimal Control of Constrained Overhead Crane Systems
Yang, X., & Zhou, Y. (2026) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2026.3741464
“According to [6] and [7], several terms are used as synonyms for RL, including adaptive / approximate dynamic programming (ADP), adaptive critic designs (ACDs), and Q-learning.”
Aksikas, I., Mabrok, M. A., Hamdi, A., & Belhouari, S. B. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7593268
Đông, N. M., & Pham, D. P. (2026) · Research Square · doi:10.21203/rs.3.rs-10922716/v1
Fernandez‐Gauna, B., Ansoategui, I., Etxeberria‐Agiriano, I., & Graña, M. (2013) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-01854-6_11
Metadata
- Authors
- Fairbank, M., Prokhorov, D., & Alonso, E.
- Affiliations
- The University of Texas at Arlington (US)
- University of Illinois Chicago (US)
- Venue
- Wiley eBooks
- Publisher
- Wiley
- Published
- 2012-12-17
- OpenAlex
- W560518094
- Cited by
- 577
- References
- 33
- Citations by year
- 2026: 15 · 2025: 27 · 2024: 38 · 2023: 48 · 2022: 38 · 2021: 50 · 2020: 44 · 2019: 64 · 2018: 35 · 2017: 54 · 2016: 43 · 2015: 39 · 2014: 48 · 2013: 27 · 2012: 7
- FWCI
- 6.42
- Type
- book
- Language
- en
- Open access
- closed
- Licence
- doi.wiley.com/10.1002/tdm_license_1.1 (tdm)
- Locations
- Wiley eBooks (publishedVersion)
- City Research Online (City University London) (acceptedVersion)
- Topics
- Physical Sciences › Engineering › Control and Systems Engineering › Adaptive Dynamic Programming Control
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Engineering › Control and Systems Engineering › Advanced Control Systems Optimization
- Keywords
- reinforcement learning, approximate dynamic programming, feedback control, adaptive dynamic programming, multiplayer games, decision-making, robot control, industrial process control, economic decision-making
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.