Reinforcement Learning for Partially Observable Dynamic Processes: Adaptive Dynamic Programming Using Measured Output Data

Reinforcement Learning: An Introduction

Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,268

A neural substrate of prediction and reward

Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388

Learning from Delayed Rewards

Watkins, C. (1989) · OpenGrey (Institut de l'Information Scientifique et Technique) · doi:10.17863/cam.132164 · Cited by 5,674

Neuro-dynamic Programming

(2012) · Springer eBooks · doi:10.1007/978-1-4419-1428-6_5086 · Cited by 3,601

Optimal Control

Lewis, F. L. (1986) · Cited by 2,957

Beyond regression : new fools for prediction and analysis in the behavioral sciences

Werbos, P. J. (1974) · Medical Entomology and Zoology · Cited by 2,739

Approximate Dynamic Programming

Powell, W. B. (2011) · Wiley series in probability and statistics · doi:10.1002/9781118029176 · Cited by 2,359

Kronecker products and matrix calculus in system theory

Brewer, J. (1978) · IEEE Transactions on Circuits and Systems · doi:10.1109/tcs.1978.1084534 · Cited by 1,920

Online actor–critic algorithm to solve the continuous-time infinite horizon optimal control problem

Vamvoudakis, K. G., & Lewis, F. L. (2010) · Automatica · doi:10.1016/j.automatica.2010.02.018 · Cited by 1,722

Reinforcement learning and adaptive dynamic programming for feedback control

Lewis, F. L., & Vrabie, D. (2009) · IEEE Circuits and Systems Magazine · doi:10.1109/mcas.2009.933854 · Cited by 1,591

Constructing a Precise Method to Control Non-Linear Systems Employing Special Functions and Machine Learning

Sahani, E. A. S. K. (2023) · Communications on Applied Nonlinear Analysis · doi:10.52783/cana.v30.259

Integral Reinforcement Learning for Optimal Tracking

Lian, B., Xue, W., Lewis, F. L., Modares, H., & Kiumarsi, B. (2024) · Advances in industrial control · doi:10.1007/978-3-031-45252-9_4

Reinforcement Learning and Disturbance Observer Based Optimal Control for Uncertain Systems

Chen, Y., Zhu, Y., Wang, S., Yin, L., Zhu, H., Sun, X., & Wu, C. (2023) · China Automation Congress (CAC) · doi:10.1109/cac59555.2023.10451252

Q-Learning Design for Discrete-Time Stochastic Zero-Sum Games

Guo, L., Wang, B., & Dong, H. (2023) · China Automation Congress (CAC) · doi:10.1109/cac59555.2023.10451449 · Cited by 1

Model Free Difference Feedback Control of Stochastic Systems

Zaheer, M. H., & Yoon, S. Y. (2024) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.23919/acc60939.2024.10644496

Learning-Based Robust Control Policy Design for Vehicular Navigation via Ultra-Wideband Communication

Lei, S., Zhang, C., Gu, X., Qiu, J., Gao, Z., & Chen, C. (2024) · Unmanned Systems · doi:10.1142/s2301385025420038

H2/H∞ Dynamic Output Synthesis Based on Regularized Reinforcement Learning

RajabAliFardi, M., Sojoodi, M., & Badri, P. (2024) · International Conference on Control, Instrumentation, and Automation · doi:10.1109/iccia65044.2024.10768147

ADP-based control of a two-wheeled self-balancing mobile robot

Stojanović, V., Đorđević, V., Dubonjić, L., & Nikolić, M. (2024) · Engineering Today · doi:10.5937/engtoday2400018s · Cited by 1

Reinforcement learning-based near-optimal control for discrete time-delay singularly perturbed systems with unmeasurable states

Xu, M., Dai, W., Zhang, Q., & Yang, C. (2025) · International Journal of Systems Science · doi:10.1080/00207721.2025.2454408

A Model Free Data-Driven Q-Learning Algorithm with its Application to Single-Phase UPS Inverters

Xu, Q., Sun, W., Yuan, K., Chen, J., & Dong, X. (2024) · Asia Power and Electrical Technology Conference (APET) · doi:10.1109/apet63768.2024.10882785

Policy Iteration-Based Learning Designs for Linear Systems With Prescribed Performance

Li, L., Chen, Y., & Chen, C. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-14081-5.00040-4

On-Policy and Off-Policy Value Iteration Algorithms for Stochastic Zero-Sum Dynamic Games

Guo, L., Wang, B., & Zhang, J. (2025) · Journal of Systems Science and Complexity · doi:10.1007/s11424-025-4572-y

A Value Iteration Algorithm for Stochastic Linear Quadratic Regulator

Wang, H., Liu, Y., & Liu, X. (2025) · Journal of Optimization Theory and Applications · doi:10.1007/s10957-025-02777-3

Control policy learning for linear quadratic regulation in systems with unknown dynamics using short input-output trajectories

Asl, A. P., & Akbari, A. (2025) · International Journal of Systems Science · doi:10.1080/00207721.2025.2532035

Output Feedback Tracking Control of a MEMS Electromagnetic Micromirror Using Adaptive Q-Learning Approach

Xu, Q., Du, S., Zhang, L., Sun, W., & Chen, H. (2025) · International Conference on Electronics Technology (ICET) · doi:10.1109/icet64964.2025.11103445

A Reduced-Order Output Feedback Parameterization for Reinforcement Learning Control with Application to the LQR Problem

Rizvi, S. A. A., & Lin, Z. (2025) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.23919/acc63710.2025.11107833

Information-state based Approach to the Optimal Output Feedback Control of Nonlinear Systems

Goyal, R., Mohamed, M. N. G., Wang, R., Sharma, A., & Chakravorty, S. (2025) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.23919/acc63710.2025.11107601

Dynamic Event‐Triggered RL for Heterogeneous MASs Bipartite Consensus

Guo, Y., Pang, D., Cao, J., Liu, S., & Abdel‐Aty, M. (2025) · International Journal of Robust and Nonlinear Control · doi:10.1002/rnc.70178 · Cited by 1

Robust Linear Quadratic Reinforcement Learning by Filtering

Svedlund, L., & Lennartson, B. (2025) · IEEE International Conference on Automation Science and Engineering (CASE) · doi:10.1109/case58245.2025.11164101

Adaptive Dynamic Programming Infinite‐Horizon Optimal Tracking Control for Stochastic Linear Discrete‐Time Systems

Zhang, K., Liu, X., & Peng, Y. (2025) · International Journal of Adaptive Control and Signal Processing · doi:10.1002/acs.4076

Distributed Output Optimal Robust Time‐Varying Formation Tracking Control for Heterogeneous Multi‐Agent Systems Based on Reinforcement Learning

Wang, Y., Li, Z., & Gao, L. (2025) · International Journal of Robust and Nonlinear Control · doi:10.1002/rnc.70256

Online Continual Reinforcement Learning-Based Optimal Output Tracking Control of Nonlinear Systems Using a Multilayer Observer

Ganie, I. A., & Jagannathan, S. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11229184

One-shot Reinforcement Learning of Dynamic Output-feedback Controllers for a Class of Nonlinear Systems

Keisuke, B. A. B. A., & Sadamoto, T. (2025) · Transactions of the Society of Instrument and Control Engineers · doi:10.9746/sicetr.61.506

Off-policy hierarchical reinforcement learning for collision avoidance via broad learning system

Zhang, T., Song, P., Jia, L., Kang, Q., Li, P., & Yu, D. (2025) · Journal of the Franklin Institute · doi:10.1016/j.jfranklin.2025.108274

Output-Feedback Optimal Control to Prevent Hypotension Associated with Labor Epidural Anesthesia

Yang, Z., Dong, Y., Gao, W., Na, Q., & Liu, T. (2025) · Unmanned Systems · doi:10.1142/s2301385026410049

Low-Complexity Q-Value Iteration Learning for Linear Quadratic Regulators Without Initial Stabilizing Gain

Huang, L., Zhao, L., & Zhang, W. (2025) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2025.3632464

Data-Driven Bias-Lyapunov Iteration for Optimal Control of Unknown Markovian Jump Linear Systems

Zhang, R., Jiang, H., & Zhou, B. (2025) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2025.3641963

Data-Driven Incremental Approximate Dynamic Programming for Optical Flow Landing Control

Zhou, Y., & Ho, H. W. (2025) · IEEE International Conference on Recent Advances in Systems Science and Engineering (RASSE) · doi:10.1109/rasse64831.2025.11315402

Critic-Only Dynamic Event-Triggered Consensus for Multi-Robots with Asymmetric Input Constraints

Lina, X., Li, Q., Ruizhuo, S., Xiaoyue, F., Kaixuan, Y., Gaofu, Y., & Mian, W. (2025) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2025.12.504

Adaptive optimal control for backward linear quadratic problem: iterative computation of anti-stabilising solutions

Lin, Y., Wang, B., & Guo, L. (2026) · International Journal of Control · doi:10.1080/00207179.2025.2612061

Data-Driven Output Regulation From Partial Noisy Measurements: An Adaptive Dynamic Programming Approach

Rajkumar, S. M., & Goswami, D. (2026) · AIAA SciTech Forum · doi:10.2514/6.2026-0994

Q-learning for continuous-time linear systems: a data-driven infinite horizon optimal control approach with dynamic output feedback

Chen, Y., Shen, S., Hu, Z., & Li, Z. (2026) · International Journal of Control · doi:10.1080/00207179.2026.2623467

Basic Structure and Iterative Algorithms of Adaptive Dynamic Programming (ADP)

Zhang, G., Yuan, J., Li, Z., & Zhang, Y. (2026) · Studies in systems, decision and control · doi:10.1007/978-3-032-14918-3_6

Reinforcement Learning-Based Adaptive Critic Control Design for Leader-Followers Multi-Agent Systems in Zero-Sum Games

Oh, Y., Lee, J., & Moon, J. (2026) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2026.3689894

Dropout Resilience and Model-Free H ∞ Off-Policy Learning for Unknown Target Tracking

Zhang, C., Liu, W., Huang, X., Wang, Y., Lewis, F. L., & Chen, C. (2026) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2026.3691585

Output feedback Q-learning for decentralized finite-horizon nonzero-sum games with asymmetric information

Zhang, Q., Zhang, Z., Wang, H., & Lu, X. (2026) · Systems & Control Letters · doi:10.1016/j.sysconle.2026.106505

Optimal Control of Discrete-Time Switched Systems Based on Input-Output Data Using Adaptive Dynamic Programming

Xu, Z., Lian, J., Jia, P., & Zhang, R. (2026) · Chinese Control and Decision Conference (CCDC) · doi:10.1109/ccdc69976.2026.11560296

Privacy preservation based on reinforcement learning in cooperative LQG control systems

Lin, W., Yang, W. Z., & Yang, C. (2026) · Systems & Control Letters · doi:10.1016/j.sysconle.2026.106516

Learning-Enabled Output–Feedback Design for Lane Change Control: A Comparative Study

Ha, W. Y., Chakraborty, S., & Jiang, Z. (2026) · Journal of Transportation Engineering Part A Systems · doi:10.1061/jtepbs.teeng-9554

Beyond Visual Range Missile Evasion with Model-based Reinforcement Learning

Cetin, A. T., & Koyuncu, E. (2026) · International Conference on Control, Decision and Information Technologies (CoDIT) · doi:10.1109/codit70676.2026.11631010

Decentralized strategies for finite population LQG social control: A reinforcement learning approach

Guo, L., Wang, B., & Wang, G. (2026) · Automatica · doi:10.1016/j.automatica.2026.113239

Off-Policy Inverse Q-Learning Algorithm with Unobservable States

Li, Z., Zhang, L., Dai, X., Fang, H., Liang, X., & Li, P. (2026) · Actuators · doi:10.3390/act15090482

Data-driven preview Q-learning for H∞ tracking control of unknown linear discrete-time systems

Su, Y., Wang, D., Mib, X., & Sun, Y. (2026) · ISA Transactions · doi:10.1016/j.isatra.2026.09.025

Reinforcement-Learning Robust Tracking Control of Discrete-Time Systems with Diagonal Scaling

Jiang, K., Gao, Z., Zeng, Y., Lu, J., Chen, C., & Shengl, X. (2026) · Eksploatacja i Niezawodnosc - Maintenance and Reliability · doi:10.17531/ein/235726

Optimal adaptive control for unknown systems using output feedback by reinforcement learning methods

Lewis, F. L., & Vamvoudakis, K. G. (2010) · International Conference on Control and Automation · doi:10.1109/icca.2010.5524211 · Cited by 22

Data-driven partially observable dynamic processes using adaptive dynamic programming

Zhong, X., Ni, Z., Tang, Y., & He, H. (2014) · IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning · doi:10.1109/adprl.2014.7010628 · Cited by 11

Adaptive output-feedback optimal control for continuous-time linear systems based on adaptive dynamic programming approach

Shi, Z., & Wang, Z. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.01.070 · Cited by 27

Adaptive and optimal output feedback control of linear systems: An adaptive dynamic programming approach

Gao, W., Jiang, Y., Jiang, Z.-P., & Chai, T. (2014) · Proceeding of the 11th World Congress on Intelligent Control and Automation · doi:10.1109/wcica.2014.7053043 · Cited by 35

Data-Driven Output Feedback Optimal Control for a Class of Nonlinear Systems via Adaptive Dynamic Programming Approach: Part I-Algorithms

Wang, Y. (2018) · Chinese Control Conference (CCC) · doi:10.23919/chicc.2018.8483373 · Cited by 3