Cited by 677Adaptive Dynamic Programming ControlAdvanced Control Systems OptimizationReinforcement Learning in Robotics

The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.

Adaptive dynamic programming

Murray, J.J., Cox, C.J., Lendaris, G.G., Saeks, R.·2002·IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews)

DOI 10.1109/tsmcc.2002.801727

Open this paper in CoChat — free account

Abstract

Unlike the many soft computing applications where it suffices to achieve a "good approximation most of the time," a control system must be stable all of the time. As such, if one desires to learn a control law in real-time, a fusion of soft computing techniques to learn the appropriate control law with hard computing techniques to maintain the stability constraint and guarantee convergence is required. The objective of the paper is to describe an adaptive dynamic programming algorithm (ADPA) which fuses soft computing techniques to learn the optimal cost (or return) functional for a stabilizable nonlinear system with unknown dynamics and hard computing techniques to verify the stability and convergence of the algorithm. Specifically, the algorithm is initialized with a (stabilizing) cost functional and the system is run with the corresponding control law (defined by the Hamilton-Jacobi-Bellman equation), with the resultant state trajectories used to update the cost functional in a soft computing mode. Hard computing techniques are then used to show that this process is globally convergent with stepwise stability to the optimal cost functional/control law pair for an (unknown) input affine system with an input quadratic performance measure (modulo the appropriate technical conditions). Three specific implementations of the ADPA are developed for 1) the linear case, 2) for the nonlinear case using a locally quadratic approximation to the cost functional, and 3) the nonlinear case using a radial basis function approximation of the cost functional; illustrated by applications to flight control.

Integrity signals

Registry

Crossref · 10.1109/tsmcc.2002.801727

Cites

32 of 32 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Dynamic Programming
Bellman, R. E. (2010) · doi:10.1515/9781400835386 · Cited by 14,588
Linear Optimal Control Systems
Kwakernaak, H., Sivan, R., & Tyreus, B. N. D. (1974) · Journal of Dynamic Systems Measurement and Control · doi:10.1115/1.3426828 · Cited by 5,010
Neuronlike adaptive elements that can solve difficult learning control problems
Barto, A. G., Sutton, R. S., & Anderson, C. W. (1983) · IEEE Transactions on Systems Man and Cybernetics · doi:10.1109/tsmc.1983.6313077 · Cited by 3,325
Stable adaptive fuzzy control of nonlinear systems
Wang, L.-X. (1993) · IEEE Transactions on Fuzzy Systems · doi:10.1109/91.227383 · Cited by 1,622
Dynamic Programming: Deterministic and Stochastic Models
Bertsekas, D. P. (1987) · Medical Entomology and Zoology · Cited by 1,348
Introduction to dynamic systems: theory, models and applications
(1981) · Mathematics and Computers in Simulation · doi:10.1016/0378-4754(81)90069-0 · Cited by 1,136
Gaussian Networks for Direct Adaptive Control
Sanner, R. M., & Slotine, J.-J. E. (1991) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.23919/acc.1991.4791778 · Cited by 1,079
Approximate dynamic programming for real-time control and neural modeling
Werbos, P. J. (1992) · Medical Entomology and Zoology · Cited by 971
Introduction to dynamic systems
Williams, M. (2016) · Structural Dynamics · doi:10.1201/9781315375311-5 · Cited by 568
Adaptive neural network control of nonlinear systems by state and output feedback
Ge, S. S., Hang, C. C., & Zhang, T. (1999) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/3477.809035 · Cited by 419

Flagged first, then by citations

Show all 32 references

Research works printed but not linked: 4

2001, Jour of Spacecraft and Rockets Special Section on Hyper-X, 38, 801
sitz, 1998, HYPER-X Hypersonic experimental research vehicle
wang, 1996, stable adaptive fuzzy control of nonlinear systems, IEEE Trans Syst Man Cybern B Cybern, 26, 677
barnett, 1971, The Matrices of Control Theory

Sorted by citations

Items 401–500 of 677

Optimal Adaptive Reinforcement Learning Control for a Convection‐Reaction Distributed Parameter System
Binid, A., & Aksikas, I. (2025) · Optimal Control Applications and Methods · doi:10.1002/oca.70003 · Cited by 5
Adaptive Predefined-Time Optimal Tracking Control of Flexible-Joint Robots
Shen, H., Cui, G., Li, Z., & Chang, Q. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3616620 · Cited by 5
When Optimal Control Meets Neural Network: A Comprehensive Survey
Wang, X., Dou, Y., Yi, X., Zhang, Y., Li, X., Li, B., Peng, H., Wang, L., & Teo, K. L. (2026) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-026-10499-6 · Cited by 5
Optimal consensus control for double‐integrator multiagent systems with unknown dynamics using adaptive dynamic programming
Zhang, Q., Yang, Y., Xue, S., Xie, X., Zhu, N., & Liu, Z. (2023) · Optimal Control Applications and Methods · doi:10.1002/oca.3014 · Cited by 6
A model-free learning approach for active damping of a rotating cylindrical shell using ADP control with rotating-frame state reconstruction technique
Hongphan, T., Brand, Z., & Cole, M. O. T. (2024) · Journal of Sound and Vibration · doi:10.1016/j.jsv.2024.118917 · Cited by 5
Optimal Control for a Class of Unknown Nonlinear Systems via the Iterative GDHP Algorithm
Wang, D., & Liu, D. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-21090-7_72 · Cited by 5
Approximate optimal tracking control for a class of discrete-time non-affine systems based on GDHP algorithm
Luo, Y., & Liang, M. (2011) · International Conference on Advanced Computational Intelligence (ICACI) · doi:10.1109/iwaci.2011.6159991 · Cited by 5
Approximate optimal adaptive control for weakly coupled nonlinear systems: A neuro‐inspired approach
Carrillo, L. R. G., Vamvoudakis, K. G., & Hespanha, J. P. (2015) · International Journal of Adaptive Control and Signal Processing · doi:10.1002/acs.2631 · Cited by 5
Integral temporal difference learning for continuous-time linear quadratic regulations
Chun, T. Y., Lee, J. Y., Park, J. B., & Choi, Y. H. (2017) · International Journal of Control Automation and Systems · doi:10.1007/s12555-015-0319-1 · Cited by 5
Optimal trajectory tracking control based on reinforcement learning for the deployment process of space tether system
Feng, Y., Wang, C., & Li, A. (2020) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2020.06.113 · Cited by 5
Integral Reinforcement Learning for Tracking in a Class of Partially Unknown Linear Systems With Output Constraints and External Disturbances
Qin, C., Wang, J., Qiao, X., Zhu, H., Zhang, D., & Yan, Y. (2022) · IEEE Access · doi:10.1109/access.2022.3175828 · Cited by 5
Optimal Consensus of Attenuated Negative Pressure Waves for Pipeline Small Leakage Localization
Wang, T., Zhang, H., Hu, X., & Ma, D. (2024) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2024.3470251 · Cited by 5
A recurrent neural fuzzy controller based on self‐organizing improved particle swarm optimization for a magnetic levitation system
Lin, C., & Chen, C. (2014) · International Journal of Adaptive Control and Signal Processing · doi:10.1002/acs.2489 · Cited by 5
The derivation of iterative convergence calculation for a nonlinear MIMO approximate dynamic programming approach
Huang, Z., Ma, J., & Huang, H. (2012) · Applied Mathematics and Computation · doi:10.1016/j.amc.2012.10.054 · Cited by 5
Adaptive dynamic programming for discrete-time systems with infinite horizon and ∈-error bound in the performance cost
Liu, D., & Jin, N. (2009) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2009.5178681 · Cited by 5
Off-policy neuro-optimal control for unknown complex-valued nonlinear systems based on policy iteration
Song, R., Wei, Q., & Xiao, W. (2016) · Neural Computing and Applications · doi:10.1007/s00521-015-2144-0 · Cited by 5
Efficient Actor-Critic Algorithm with Hierarchical Model Learning and Planning
Zhong, S., Liu, Q., & Fu, Q. (2016) · Computational Intelligence and Neuroscience · doi:10.1155/2016/4824072 · Cited by 5
An Automatic Scene Recognition Using TD-Learning for Mobile Robot Localization in an Outdoor Environment
Wang, X., Wang, X., & Wilkes, D. M. (2019) · Springer eBooks · doi:10.1007/978-981-13-9217-7_15 · Cited by 5
Earth pressure balance control for shield tunneling machine based on adaptive dynamic programming
Liu, X., Xu, S., & Zhang, K. (2020) · Transactions of the Institute of Measurement and Control · doi:10.1177/0142331220913742 · Cited by 5
A Novel Policy Iteration-Based Deterministic Q-Learning for Discrete-Time Nonlinear Systems
Wei, Q., Song, R., Li, B., & Lin, X. (2017) · Studies in systems, decision and control · doi:10.1007/978-981-10-4080-1_4 · Cited by 5
An approach to solving optimal control problems of nonlinear systems by introducing detail-reward mechanism in deep reinforcement learning
Yao, S., Liu, X., Zhang, Y., & Cui, Z. (2022) · Mathematical Biosciences & Engineering · doi:10.3934/mbe.2022430 · Cited by 5
A neural network-based approach for solving quantized discrete-time H∞ optimal control with input constraint over finite-horizon
Liang, Y., Zhang, H., Cai, Y., & Sun, S. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.12.031 · Cited by 5
Discrete-time control algorithms and adaptive intelligent systems designs
Lewis, F. L., & Al-Tamimi, A. (2007) · Cited by 5
Adaptive optimal control for linear stochastic systems with additive noise
Bian, T., & Zhong-Ping, J. (2015) · Chinese Control Conference (CCC) · doi:10.1109/chicc.2015.7260102 · Cited by 5
Damping Control by Fusion of Reinforcement Learning and Control Lyapunov Functions
Glavić, M., Ernst, D., & Wehenkel, L. A. (2006) · North American Power Symposium (NAPS) · doi:10.1109/naps.2006.359598 · Cited by 5
Data-based approximate policy iteration for nonlinear continuous-time optimal control designPreprint
Luo, B., Wu, H., Huang, T., & Liu, D. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1311.0396 · Cited by 5
Multi-Agent Area Coverage Control Using Reinforcement Learning Techniques
Adepegba, A. A. (2016) · uO Research (University of Ottawa) · doi:10.20381/ruor-5715 · Cited by 5
Variance-Integrated Policy Optimization: A Maximum Entropy Approach for Localization in Energy Interconnection Systems
Wang, T., Zhang, H., Zhang, L., & Ma, D. (2025) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2025.3593915 · Cited by 4
Solution for optimal control of general nonlinear systems using generating functions
Shi, W., Wang, Y., Liang, Q., & Chen, Y. (2022) · Asian Journal of Control · doi:10.1002/asjc.2818 · Cited by 4
Finite‐Horizon ε ‐Optimal Tracking Control of Discrete‐Time Linear Systems Using Iterative Approximate Dynamic Programming
Tan, F., Luo, B., & Guan, X. (2014) · Asian Journal of Control · doi:10.1002/asjc.832 · Cited by 4
Value iteration and adaptive optimal control for linear continuous-time systems
Bian, T., & Jiang, Z. (2015) · IEEE Conference on Cybernetics and Intelligent Systems · doi:10.1109/iccis.2015.7274547 · Cited by 4
Generalized adaptive dynamic programming algorithm for discrete-time nonlinear systems: Convergence and stability analysis
Liu, D., & Wei, Q. (2013) · IEEE International Conference on Information Science and Technology (ICIST) · doi:10.1109/icist.2013.6747522 · Cited by 4
Robust adaptive dynamic programming for continuous-time linear stochastic systems
Bian, T., & Jiang, Z. (2014) · The proceedings of the IEEE Conference on Control Applications/The proceedings of the ... IEEE Conference on Control Applications · doi:10.1109/isic.2014.6967601 · Cited by 4
Online near optimal control of unknown nonaffine systems with application to HCCI engines
Zargarzadeh, H., Jagannathan, S., & Drallmeier, J. A. (2011) · IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning · doi:10.1109/adprl.2011.5967382 · Cited by 4
Approximate dynamic programming based controller design for interconnected AGC scheme
Kumar, N., Tyagi, B., & Kumar, V. (2015) · IEEE Region 10 Conference (TENCON) · doi:10.1109/tencon.2015.7372872 · Cited by 4
Learning Control of Dynamical Systems Based on Markov Decision Processes:Research Frontiers and Outlooks
Gao, Y. (2012) · Acta Automatica Sinica · Cited by 4
Value Iteration ADP for Discrete-Time Nonlinear Systems
Liu, D., Wei, Q., Wang, D., Yang, X., & Li, H. (2017) · Advances in industrial control · doi:10.1007/978-3-319-50815-3_2 · Cited by 4
Shared Linear Quadratic Regulation Control: A Reinforcement Learning Approach
Abu-Khalaf, M., Karaman, S., & Rus, D. L. (2019) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc40024.2019.9029617 · Cited by 4
Computational Guidance Law Based on Data- Driven Online Adaptive Critic Designs
Wang, Q., Liao, Z., & Yan, F. (2021) · China Automation Congress (CAC) · doi:10.1109/cac53003.2021.9727477 · Cited by 4
Min–Max Dynamic Programming Control for Systems with Uncertain Mathematical Models via Differential Neural Network Bellman’s Function Approximation
Poznyak, A. S., Noriega-Marquez, S., Hernández-Sánchez, A., Ballesteros, M., & Chaírez, I. (2023) · Mathematics · doi:10.3390/math11051211 · Cited by 6
Finite‐horizon optimal trajectory control of near space hypersonic vehicle with multi‐constraints
Xia, R., Bu, C., Yan, X., & Zhou, T. (2023) · Optimal Control Applications and Methods · doi:10.1002/oca.3058 · Cited by 4
Data-Driven Direct Adaptive Risk-Sensitive Control of Stochastic Systems
Qiao, N., & Li, T. (2024) · Journal of Systems Science and Complexity · doi:10.1007/s11424-024-2421-z · Cited by 4
Piecewise polynomial policy iterations for synthesis of optimal control laws in input-saturated systems
Baldi, S., Valmórbida, G., Papachristodoulou, A., & Kosmatopoulos, E. B. (2015) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.1109/acc.2015.7171167 · Cited by 4
Robust asymptotic tracking of a class of nonlinear systems using an adaptive critic based controller
Bhasin, S., Sharma, N., Patre, P. M., & Dixon, W. E. (2010) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.1109/acc.2010.5530744 · Cited by 4
Adaptive Optimal Control of Nonlinear Inverted Pendulum System Using Policy Iteration Technique
Prasad, L. B., Gupta, H. O., & Tyagi, B. (2014) · IFAC Proceedings Volumes · doi:10.3182/20140313-3-in-3024.00144 · Cited by 4
Optimal tracking control for a class of continuous time complex-valued systems based on adaptive dynamic programming algorithm
Song, R., Lewis, F. L., Wei, Q., & Xiao, W. (2014) · Chinese Control Conference (CCC) · doi:10.1109/chicc.2014.6896511 · Cited by 4
Policy Gradient SMDP for Resource Allocation and Routing in Integrated Services Networks
Việt, N. H., Vien, N. A., & Chung, T. (2008) · IEEE International Conference on Networking, Sensing and Control (ICNSC) · doi:10.1109/icnsc.2008.4525466 · Cited by 3
A kind of utility function in adaptive dynamic programming for inverted pendulum control
Wang, Z., Dai, Y., Li, Y., & Yao, Y. (2010) · International Conference on Machine Learning and Cybernetics · doi:10.1109/icmlc.2010.5580816 · Cited by 4
Finite horizon optimal control of discrete-time nonlinear systems with unfixed initial state using adaptive dynamic programming
Wei, Q., & Liu, D. (2011) · Journal of Control Theory and Applications · doi:10.1007/s11768-011-0181-5 · Cited by 4
Reinforcement Learning based Output-Feedback Controller for Complex Nonlinear Discrete-time Systems
Shih, P., & Jagannathan, S. (2007) · The proceedings of the IEEE Conference on Control Applications/The proceedings of the ... IEEE Conference on Control Applications · doi:10.1109/isic.2007.4450920 · Cited by 4
A Minimal “Functionally Sentient” Organism Trained With Backpropagation Through Time
Var, M. P., Fairbank, M., & Samothrakis, S. (2023) · Adaptive Behavior · doi:10.1177/10597123231166416 · Cited by 3
Online optimal adaptive output and state feedback controllers design for partially unknown continuous bilinear systems based on policy iteration
rahbar, S. N. M., Ramezani-al, M. R., Pariz, N., & Heydari, A. (2025) · International Journal of Control · doi:10.1080/00207179.2025.2470349 · Cited by 3
Localization for Energy Interconnection Systems With Uncertainties via Maximum Entropy Adaptive Dynamic Programming
Wang, T., Zhang, H., Guo, X., & Ma, D. (2025) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2025.3565241 · Cited by 3
Event-Triggered ADP for Multiplayer Zero-Sum Game of Partially Unknown Nonlinear System With Constraints on Dead Zone Inputs
Liu, D., Liu, Y.-J., Liu, L., & Chen, Y. (2025) · IEEE Transactions on Control of Network Systems · doi:10.1109/tcns.2025.3600870 · Cited by 3
Policy iteration approximate dynamic programming using Volterra series based actor
Guo, W., Si, J., Liu, F., & Mei, S. (2014) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2014.6889865 · Cited by 3
Adaptive dynamic programming as a theory of sensorimotor control
Jiang, Y., & Jiang, Z. (2012) · IEEE Signal Processing in Medicine and Biology Symposium · doi:10.1109/spmb.2012.6469455 · Cited by 3
Finite Approximation Error-Based Value Iteration ADP
Liu, D., Wei, Q., Wang, D., Yang, X., & Li, H. (2017) · Advances in industrial control · doi:10.1007/978-3-319-50815-3_3 · Cited by 3
Iterative Q-learning-based nonlinear optimal tracking control
Wei, Q., Song, R., Xu, Y., & Liu, D. (2016) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci.2016.7849841 · Cited by 3
Optimal synchronization control of multiple euler-lagrange systems via event-triggered reinforcement learning
Xu, Y., Jin, X., Wang, S., & Tang, Y. S. (2020) · Discrete and Continuous Dynamical Systems - S · doi:10.3934/dcdss.2020377 · Cited by 3
Policy Gradient Reinforcement Learning for Parameterized Continuous-Time Optimal Control
Yang, X., Zhang, H., & Wang, Z. (2021) · Chinese Control and Decision Conference (CCDC) · doi:10.1109/ccdc52312.2021.9602755 · Cited by 3
Optimal fuzzy output feedback tracking control for unmanned surface vehicles systems
Song, W., Zuo, Y., & Tong, S. (2024) · Ocean Engineering · doi:10.1016/j.oceaneng.2024.117034 · Cited by 3
Dual Optimization-Based Distributed Tracking Control Under Completely Unknown Dynamics
Mei, D., Sun, J. Q., Xu, Y., & Dou, L. (2024) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2024.3377894 · Cited by 3
Differential neural network robust constrained controller using approximate dynamic programming
Noriega-Marquez, S., Poznyak, A. S., Hernández-Sánchez, A., & Chaírez, I. (2024) · European Journal of Control · doi:10.1016/j.ejcon.2024.101003 · Cited by 3
Stochastic Adaptive Dynamic Programming for Robust Optimal Control Design
Bian, T., & Jiang, Z. (2016) · Elsevier eBooks · doi:10.1016/b978-0-12-805246-4.00007-0 · Cited by 3
Optimal adaptive tracking control for a class of MIMO uncertain nonlinear systems with actuator failures
Wu, X., Zhang, S., & Shuang, W. (2017) · Chinese Control Conference (CCC) · doi:10.23919/chicc.2017.8028456 · Cited by 3
Temperature Control in Water-Gas Shift Reaction with Adaptive Dynamic Programming
Huang, Y., Liu, D., & Wei, Q. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-31362-2_53 · Cited by 3
Adaptive Critic Design Using Policy Iteration Technique for LTI Systems: A Comprehensive Performance Analysis
Prasad, L. B., Tyagi, B., & Gupta, H. O. (2015) · Journal of Control Automation and Electrical Systems · doi:10.1007/s40313-015-0167-5 · Cited by 3
Near-optimal control laws based on Heuristic Dynamic Programming iteration algorithm
Song, R., Yang, D., & Zhang, H. (2010) · IEEE International Conference on Networking, Sensing and Control (ICNSC) · doi:10.1109/icnsc.2010.5461489 · Cited by 3
Learning with Eligibility Traces in Adaptive Critic Designs
Xu, J. M., Liang, F.-M., & Yu, W. (2006) · IEEE International Conference on Vehicular Electronics and Safety (ICVES) · doi:10.1109/icves.2006.371605 · Cited by 3
Optimal control design for nonlinear systems: Adaptive dynamic programming based on fuzzy critic estimator
Zhang, J., Zhang, H., Luo, Y., & Liang, H. (2012) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2012.6252523 · Cited by 3
A new optimal control method for discrete-time nonlinear systems with approximation error
Wei, Q., & Liu, D. (2012) · World Congress on Intelligent Control and Automation · doi:10.1109/wcica.2012.6357864 · Cited by 3
Adaptive critic design based robust neural network control for a class of continuous-time nonaffine nonlinear system
Cui, L., Luo, Y., & Zhang, H. (2011) · International Conference on Modelling, Identification and Control · doi:10.1109/icmic.2011.5973712 · Cited by 3
DHP algorithm based multi-variable optimal control for cement calcination process
Yang, B., & Ma, X. (2010) · Chinese Control and Decision Conference (CCDC) · doi:10.1109/ccdc.2010.5498522 · Cited by 3
Discrete-Time /spl epsilon/-Adaptive Dynamic Programming Algorithm Using Neural Networks
Jin, N., & Liu, D. (2008) · The proceedings of the IEEE Conference on Control Applications/The proceedings of the ... IEEE Conference on Control Applications · doi:10.1109/isic.2008.4635953 · Cited by 3
Discrete-Time Optimal Control of Nonlinear Systems via Value Iteration-Based $$ Q $$ -Learning
Wei, Q., Song, R., Li, B., & Lin, X. (2017) · Studies in systems, decision and control · doi:10.1007/978-981-10-4080-1_3 · Cited by 3
Adaptive Critics Design with Support Vector Machine for Spacecraft Finite-Horizon Optimal Control
Kim, Y., Kim, Y., & Park, C. (2018) · Journal of Aerospace Engineering · doi:10.1061/(asce)as.1943-5525.0000941 · Cited by 3
Optimal Tracking Strategies for Uncertain Ensembles of Thermostatically Controlled Loads
Anand, S. C., & Baldi, S. (2020) · International Conference on Control and Automation · doi:10.1109/icca51439.2020.9264495 · Cited by 3
Introduction to Fusion of Soft Computing and Hard Computing
Ovaska, S. J. (2004) · doi:10.1002/9780471683407.ch1 · Cited by 3
Neural Network-based Control of Nonlinear Discrete-Time Svstems in Non-Strict Form
He, P., Chen, Z., & Jagannathan, S. (2006) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2005.1582551 · Cited by 3
ORGaNICs: A Theory of Working Memory in Brains and MachinesPreprint
Heeger, D. J., & Mackey, W. E. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.06288 · Cited by 4
Maximum Entropy Adaptive Dynamic Programming for Weak Leakage Localization in Energy Interconnection Systems
Wang, T., Zhang, H., Yue, X., & Ma, D. (2025) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2025.3579087 · Cited by 2
Adaptive prescribed-time output feedback control via integral reinforcement learning for uncertain MIMO multi-agent systems
Tian, X., & Zhang, T. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.132441 · Cited by 2
Neurocontrol of single shaft heavy-duty gas turbine using adaptive dynamic programming
Huang, Y., & Jiang, H. (2015) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2015.7280659 · Cited by 2
Discrete-time local dynamic programming
Berniker, M., & Kording, K. P. (2011) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.1109/acc.2011.5990808 · Cited by 2
Optimal control of earth pressure balance of shield tunneling machine based on dual‐heuristic dynamic programming
Liu, X., Xu, S., & Shao, C. (2020) · Optimal Control Applications and Methods · doi:10.1002/oca.2612 · Cited by 2
Finite-horizon Approximate Optimal Consensus Control for Discrete-time Nonlinear Multi-Agent Systems with Unknown Dynamics
Gao, L., Mu, N., Bingyan, Z., Wang, A., & Dong, T. (2020) · International Conference on Information, Cybernetics, and Computational Social Systems (ICCSS) · doi:10.1109/iccss52145.2020.9336943 · Cited by 2
Optimal Tracking Control of the Boiler-turbine System Based on Adaptive Dynamic Programming
Liu, Y., Gao, A., & Wei, Q. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9534415 · Cited by 2
Kernel-Based Hamilton-Jacobi Equations for Data-Driven Optimal Control: The General Case
Ito, Y., & Fujimoto, K. (2021) · IEICE Transactions on Fundamentals of Electronics Communications and Computer Sciences · doi:10.1587/transfun.2021eai0002 · Cited by 2
Finite-time adaptive dynamic programming control for nonlinear systems based on novel complementary terminal sliding mode surface
Jia, C., Li, X., Liu, X., & Shangguan, X. (2024) · Proceedings of the Institution of Mechanical Engineers Part I Journal of Systems and Control Engineering · doi:10.1177/09596518241272750 · Cited by 2
Tracking control for nonlinear multi-agent systems: a first-order DPG framework with initial admissible control policy method
Rao, J., Wang, J., Xu, J., & Zhong, Y. (2025) · Nonlinear Dynamics · doi:10.1007/s11071-025-11097-0 · Cited by 2
Prescribed‐Time Optimal Adaptive Tracking Control via Command Filters for Uncertain Multiagent Systems
Tian, X., & Zhang, T. (2025) · International Journal of Robust and Nonlinear Control · doi:10.1002/rnc.8042 · Cited by 2
Supervised optimal control in complex continuous systems with trajectory imitation and reinforcement learning
Liu, Y., Liu, F., & Huang, R. (2025) · Scientific Reports · doi:10.1038/s41598-025-04417-2 · Cited by 2
Online and model-free supplementary learning control based on approximate dynamic programming
Guo, W., Liu, F., Si, J., & Mei, S. (2014) · Chinese Control and Decision Conference (CCDC) · doi:10.1109/ccdc.2014.6852370 · Cited by 2
Temporal Difference Learning of Area Coverage Control with Multi-Agent Systems
Soleymani, F., Miah, S., & Spinello, D. (2022) · IEEE International Symposium on Robotic and Sensors Environments · doi:10.1109/rose56499.2022.9977412 · Cited by 2
The Optimal Control of Discrete-Time Delay Nonlinear System with Dual Heuristic Dynamic Programming
Wang, B., & Zhao, D. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-34475-6_80 · Cited by 2
Horizontally opposed pressure loaded computer generated artificial feel control column for a motion base flight simulation system using fused hard & amp; soft computing
Raza, S. M., & Zeir, B. (2005) · International Conference on Emerging Technologies · doi:10.1109/icet.2005.1558927 · Cited by 2
Optimal control of a wind generator system using non-squares estimators
Queiroz, J. A., Barros, A. K., Neto, J. V. D. F., & Santana, E. É. C. (2015) · IEEE International Symposium on Industrial Electronics (ISIE) · doi:10.1109/isie.2015.7281687 · Cited by 2
Error bound analysis of policy iteration based approximate dynamic programming for deterministic discrete-time nonlinear systems
Guo, W., Liu, F., Si, J., Mei, S., & Li, R. (2015) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2015.7280783 · Cited by 2
A Kalman filter-based actor-critic learning approach
Wang, B., & Zhao, D. (2014) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2014.6889527 · Cited by 2
Temperature Control in Precalcinator with Dual Heuristic Dynamic Programming
Lin, X., Zhang, Z., & Liu, D. (2007) · IEEE International Conference on Neural Networks/IEEE ... International Conference on Neural Networks · doi:10.1109/ijcnn.2007.4370980 · Cited by 2

Authors: Murray, J. J., Cox, C. J., Lendaris, G. G., & Saeks, R.
Affiliations: Stony Brook University (US)
Accurate Automation (United States) (US)
Portland State University (US)
ORCID: Murray, J.J.
Venue: IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews)
Publisher: Institute of Electrical and Electronics Engineers (IEEE)
Published: 2002-05
Volume: 32
Issue: 2
Pages: 140-153
ISSN: 1094-6977 (ISSN-L)
DOI: 10.1109/tsmcc.2002.801727
OpenAlex: W2160561608
Cited by: 677
References: 32
Citations by year: 2026: 16 · 2025: 36 · 2024: 31 · 2023: 26 · 2022: 34 · 2021: 34 · 2020: 39 · 2019: 28 · 2018: 27 · 2017: 42 · 2016: 36 · 2015: 40 · 2014: 42 · 2013: 43 · 2012: 45
FWCI: 4.99
Type: journal article
Language: en
Open access: closed
Licence: ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html (vor)
Locations: IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews) (publishedVersion)
PDXScholar (Portland State University) (submittedVersion)
Topics: Physical Sciences › Engineering › Control and Systems Engineering › Adaptive Dynamic Programming Control
Physical Sciences › Engineering › Control and Systems Engineering › Advanced Control Systems Optimization
Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
Keywords: adaptive dynamic programming, optimal control, Hamilton-Jacobi-Bellman equation, stability analysis, convergence analysis, unknown dynamics, nonlinear systems, input-affine systems, radial basis function approximation, flight control, soft computing

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Adaptive dynamic programming

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks