Data-based optimal control
Open accessAbstract
This paper deals with data-based optimal control. The control algorithm consists of two complementary subsystems, namely a data-based observer and an optimal feedback controller based on the system's Markov parameters. These parameters can be identified on-line using only input/output data. The effectiveness of the resulting controller is evaluated with a regulation and a tracking control experiment, performed on a direct-drive robot of spatial kinematics.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
If the conditions of observability and controllability of the system described by (3.7) and (3.8) are fulfilled, then the states of the HSA are uniquely received in terms of measured inputs and outputs signals.
“Lemma 3.2. If the conditions of observability and controllability of the system described by (3.7) and (3.8) are fulfilled, then the states of the HSA are uniquely received in terms of measured inputs and outputs signals as follows:”
From Data-driven control of hydraulic servo actuator: An event-triggered adaptive dynamic programming approach (2023) · cites this paper as [48]
Cites
Lewis, F. L. (1986) · Cited by 2,957 · see citing works
Robotics: Control, Sensing, Vision, and Intelligence
Fu, K., González, R. C., & Lee, C. S. G. (1987) · Cited by 1,637 · see citing works
Iterative feedback tuning: theory and applications
Hjalmarsson, H., GEVERS, M. R., Gunnarsson, S., & Lequin, O. (1998) · IEEE Control Systems · doi:10.1109/37.710876 · Cited by 995 · see citing works
The unfalsified control concept and learning
Safonov, M. G., & Tsao, T. (1997) · IEEE Transactions on Automatic Control · doi:10.1109/9.587340 · Cited by 597 · see citing works
Model-free control of nonlinear stochastic systems with discrete-time measurements
Spall, J. C., & Cristion, J. A. (1998) · IEEE Transactions on Automatic Control · doi:10.1109/9.718605 · Cited by 241 · see citing works
Virtual reference feedback tuning for two degree of freedom controllers
Lecchini, A., Campi, M. C., & Savaresi, S. M. (2002) · International Journal of Adaptive Control and Signal Processing · doi:10.1002/acs.711 · Cited by 158 · see citing works
Modeling and Identification for High-Performance Robot Control: An RRR-Robotic Arm Case Study
Kostić, D., deJager, B., Steinbuch, M., & Hensen, R. H. A. (2004) · IEEE Transactions on Control Systems Technology · doi:10.1109/tcst.2004.833641 · Cited by 103 · see citing works
Self-citationMarkov Data-Based LQG Control1
Shi, G., & Skelton, R. E. (1998) · Journal of Dynamic Systems Measurement and Control · doi:10.1115/1.1286868 · Cited by 49 · see citing works
Closed-form solutions to discrete-time LQ optimal control and disturbance attenuation
Furuta, K., & Wongsaisuwan, M. (1993) · Systems & Control Letters · doi:10.1016/0167-6911(93)90104-e · Cited by 42 · see citing works
State-Space System Identification with Identified Hankel Matrix
Lim, R. K., Phan, M. Q., & Longman, R. W. (1998) · Cited by 28 · see citing works
Identification of a Multistep-Ahead Observer and Its Application to Predictive Control
Lim, R. K., & Phan, M. Q. (1997) · Journal of Guidance Control and Dynamics · doi:10.2514/2.4177 · Cited by 20 · see citing works
RRR-robot design: basic outlines, servo sizing, and control
van Beek, B., & de Jager, B. (2002) · The proceedings of the IEEE Conference on Control Applications/The proceedings of the ... IEEE Conference on Control Applications · doi:10.1109/cca.1997.627460 · Cited by 18 · see citing works
State Estimation with ARMarkov Models
Lim, R. K., Phan, M. Q., & Longman, R. W. (1998) · Cited by 17 · see citing works
Suppressing non-periodically repeating disturbances in mechanical servo systems
Tousain, R. L., Boissy, J.-C., Norg, M. L., Steinbuch, M., & Bosgra, O. H. (2002) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.1998.757832 · Cited by 15 · see citing works
Self-citationAn experimental facility for nonlinear robot control
Beek, B. V., & de Jager, B. (2003) · The proceedings of the IEEE Conference on Control Applications/The proceedings of the ... IEEE Conference on Control Applications · doi:10.1109/cca.1999.806732 · Cited by 15 · see citing works
Minimum time pulse response based control of flexible structures
Bennighof, J. K., Chang, S.-H. M., & Subramaniam, M. (1993) · Journal of Guidance Control and Dynamics · doi:10.2514/3.21095 · Cited by 14 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Zhang, H., Cui, L., Zhang, X., & Luo, Y. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2011.2168538 · Cited by 645 · see citing works
Lewis, F. L., & Vamvoudakis, K. G. (2011) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2010.2043839 · Cited by 544 · see citing works
Data Informativity: A New Perspective on Data-Driven Analysis and Control
van Waarde, H. J., Eising, J., Trentelman, H. L., & Camlibel, M. K. (2020) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2020.2966717 · Cited by 517 · see citing works
From Noisy Data to Feedback Controllers: Nonconservative Design via a Matrix S-Lemma
van Waarde, H. J., Camlibel, M. K., & Mesbahi, M. (2020) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2020.3047577 · Cited by 385 · see citing works
Gao, W., Jiang, Y., Jiang, Z.-P., & Chai, T. (2016) · Automatica · doi:10.1016/j.automatica.2016.05.008 · Cited by 234 · see citing works
Ding, S. X., Yang, Y. Z., Zhang, Y., & Li, L. (2014) · Automatica · doi:10.1016/j.automatica.2014.08.022 · Cited by 187 · see citing works
Fault-tolerant control of a hydraulic servo actuator via adaptive dynamic programming
Stojanović, V. (2023) · Mathematical Modelling and Control · doi:10.3934/mmc.2023016 · Cited by 136 · see citing works
Output Feedback Q-Learning Control for the Discrete-Time Linear Quadratic Regulator Problem
Rizvi, S. A. A., & Lin, Z. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2870075 · Cited by 124 · see citing works
Djordjevic, V., Tao, H., Song, X., He, S., Gao, W., & Stojanovic, V. (2023) · Mathematical Biosciences and Engineering · doi:10.3934/mbe.2023376 · Cited by 107 · see citing works
Data-driven control of hydraulic servo actuator based on adaptive dynamic programming
Djordjevic, V., Stojanović, V., Tao, H., Song, X., He, S., & Gao, W. (2022) · Discrete and Continuous Dynamical Systems - S · doi:10.3934/dcdss.2021145 · Cited by 93 · see citing works
Data-Driven LQR Control Design
da Silva, G. R. G., Bazanella, A. S., Lorenzini, C., & Campestrini, L. (2018) · IEEE Control Systems Letters · doi:10.1109/lcsys.2018.2868183 · Cited by 88 · see citing works
Data-Driven Minimum-Energy Controls for Linear Systems
Baggio, G., Katewa, V., & Pasqualetti, F. (2019) · IEEE Control Systems Letters · doi:10.1109/lcsys.2019.2914090 · Cited by 86 · see citing works
Zhao, F., Gao, W., Jiang, Z., & Liu, T. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3027301 · Cited by 72 · see citing works
The Informativity Approach: To Data-Driven Analysis and Control
van Waarde, H. J., Eising, J., Camlibel, M. K., & Trentelman, H. L. (2023) · IEEE Control Systems · doi:10.1109/mcs.2023.3310305 · Cited by 69 · see citing works
Sampled‐data‐based adaptive optimal output‐feedback control of a 2‐degree‐of‐freedom helicopter
Gao, W., Huang, M., Jiang, Z., & Chai, T. (2016) · IET Control Theory and Applications · doi:10.1049/iet-cta.2015.0977 · Cited by 49 · see citing works
Zhao, F., Gao, W., Liu, T., & Jiang, Z. (2021) · Automatica · doi:10.1016/j.automatica.2021.110103 · Cited by 46 · see citing works
Data-Driven Design and Optimization of Feedback Control Systems for Industrial Applications
Zhang, Y., Yang, Y. Z., Ding, S. X., & Li, L. (2014) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2014.2301757 · Cited by 39 · see citing works
Event-Triggered Robust Adaptive Dynamic Programming With Output Feedback for Large-Scale Systems
Zhao, F., Gao, W., Liu, T., & Jiang, Z. (2022) · IEEE Transactions on Control of Network Systems · doi:10.1109/tcns.2022.3186623 · Cited by 40 · see citing works
Optimal adaptive control for unknown systems using output feedback by reinforcement learning methods
Lewis, F. L., & Vamvoudakis, K. G. (2010) · International Conference on Control and Automation · doi:10.1109/icca.2010.5524211 · Cited by 22 · see citing works
A data-driven fault tolerant model predictive control with fault identification
Izadi, H. A., Gordon, B. W., & Zhang, Y. M. (2010) · Conference on Control and Fault-Tolerant Systems · doi:10.1109/systol.2010.5675981 · Cited by 21 · see citing works
Zhao, F., Luo, S., Gao, W., & Wen, C. (2025) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2024.3514202 · Cited by 13 · see citing works
Incremental reinforcement learning and optimal output regulation under unmeasurable disturbances
Zhao, J., Yang, C., Gao, W., & Park, J. H. (2023) · Automatica · doi:10.1016/j.automatica.2023.111468 · Cited by 14 · see citing works
Davari, M., Zhao, J., Yang, C., Gao, W., & Chai, T. (2024) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2023.3327574 · Cited by 14 · see citing works
Unfalsified control:data-driven control design for performance improvement
Helvoort, J. (. V. (2007) · TU/e Research Portal · doi:10.6100/ir631347 · Cited by 14 · see citing works
Data-Driven Virtual Inertia Control Method of Doubly Fed Wind Turbine
Li, T., Wang, L., Wang, Y., Liu, G., Zhu, Z., Zhang, Y., Zhao, L. J., & Ji, Z. (2021) · Energies · doi:10.3390/en14175572 · Cited by 13 · see citing works
Data-based adaptive critic design for discrete-time zero-sum games using output feedback
Cui, L., Zhang, H., Zhang, X., & Luo, Y. (2011) · IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning · doi:10.1109/adprl.2011.5967351 · Cited by 13 · see citing works
Data-driven adaptive optimal output-feedback control of a 2-DOF helicopter
Gao, W., & Jiang, Z. (2016) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.1109/acc.2016.7525294 · Cited by 13 · see citing works
Adaptive optimal output regulation via output-feedback: An adaptive dynamic programing approach
Gao, W., & Jiang, Z. (2016) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2016.7799168 · Cited by 13 · see citing works
Gao, W., Jiang, Y., Jiang, Z.-P., & Chai, T. (2014) · Proceeding of the 11th World Congress on Intelligent Control and Automation · doi:10.1109/wcica.2014.7053043 · Cited by 35 · see citing works
Data-driven H∞ control of constrained systems: An application to bilateral teleoperation system
Küçükdemiral, İ. B., Yazıcı, H., Gormus, B., & Bevan, G. (2023) · ISA Transactions · doi:10.1016/j.isatra.2023.01.030 · Cited by 11 · see citing works
Closed-form and robust expressions for data-driven LQ control
Celi, F., Baggio, G., & Pasqualetti, F. (2023) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2023.100916 · Cited by 11 · see citing works
Data-based control of motion systems
Steinbuch, M., van Helvoort, J., Aangenent, W., de Jager, B., & van de Molengraft, R. (2005) · The proceedings of the IEEE Conference on Control Applications/The proceedings of the ... IEEE Conference on Control Applications · doi:10.1109/cca.2005.1507180 · Cited by 10 · see citing works
Self-citationYang, T., Bu, K., Chen, G., Xie, X., & Xia, J. (2024) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2024.3445881 · Cited by 9 · see citing works
Data-driven rate-based integral predictive control with estimated prediction matrices
Verheijen, P. C. N., da Silva, G. R. G., & Lazar, M. (2021) · International Conference on System Theory, Control and Computing (ICSTCC) · doi:10.1109/icstcc52150.2021.9607269 · Cited by 8 · see citing works
Frequency response data based optimal control using the data based symmetric root locus
Hoogendijk, R. R., den Hamer, A., Angelis, G. Z., van de Molengraft, R., & Steinbuch, M. (2010) · The proceedings of the IEEE Conference on Control Applications/The proceedings of the ... IEEE Conference on Control Applications · doi:10.1109/cca.2010.5611199 · Cited by 7 · see citing works
Self-citationIkemoto, J., & Ushio, T. (2020) · Nonlinear Theory and Its Applications IEICE · doi:10.1587/nolta.11.480 · Cited by 6 · see citing works
da Silva, F. N., & Neto, J. V. D. F. (2021) · IEEE Access · doi:10.1109/access.2021.3080626 · Cited by 5 · see citing works
Data-based distributed model predictive control for large-scale systems
Li, Y., Zhang, H., Wang, Z., Huang, C., & Yan, H. (2024) · Nonlinear Dynamics · doi:10.1007/s11071-024-10340-4 · Cited by 6 · see citing works
Recursive data–driven predictive control with persistence of excitation conditions
Verheijen, P. C. N., da Silva, G. R. G., & Lazar, M. (2022) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc51059.2022.9992366 · Cited by 5 · see citing works
Optimal Digital Control with Uncertain Network Delay of Linear Systems Using Reinforcement Learning
Fujita, T., & Ushio, T. (2016) · IEICE Transactions on Fundamentals of Electronics Communications and Computer Sciences · doi:10.1587/transfun.e99.a.454 · Cited by 4 · see citing works
Fujita, T., & Ushio, T. (2014) · IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning · doi:10.1109/adprl.2014.7010632 · Cited by 4 · see citing works
Learning-based Event-triggered Adaptive Optimal Output Regulation of Linear Discrete-time Systems
Zhao, F., Gao, W., Liu, T., & Jiang, Z. (2021) · IEEE Data Driven Control and Learning Systems Conference (DDCLS) · doi:10.1109/ddcls52934.2021.9455453 · Cited by 4 · see citing works
Output Feedback H∞Control of Unknown Discrete-time Linear Systems: Off-policy Reinforcement Learning
Tooranjipour, P., & Kiumarsi, B. (2021) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc45484.2021.9683057 · Cited by 3 · see citing works
da Silva, F. N., & Neto, J. V. D. F. (2020) · Research Society and Development · doi:10.33448/rsd-v9i2.2128 · Cited by 3 · see citing works
Policy Iteration and Event-Triggered Robust Adaptive Dynamic Programming for Large-Scale Systems
Zhao, F., Gao, W., Liu, T., & Jiang, Z. (2021) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2021.10.383 · Cited by 3 · see citing works
RL-based optimal networked control considering network delay of discrete-time linear systems
Fujita, T., & Ushio, T. (2015) · European Control Conference (ECC) · doi:10.1109/ecc.2015.7330910 · Cited by 3 · see citing works
Zhao, F., Jiang, Z., & Liu, T. (2019) · Chinese Control Conference (CCC) · doi:10.23919/chicc.2019.8866079 · Cited by 4 · see citing works
Networked Control of Nonlinear Systems under Partial Observation Using Continuous Deep Q-Learning
Ikemoto, J., & Ushio, T. (2019) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc40024.2019.9029214 · Cited by 3 · see citing works
Fixed Final Time Optimal Adaptive Control of Linear Discrete-Time Systems in Input-Output form
Zhao, Q., Xu, H., & Jagannathan, S. (2013) · Journal of Artificial Intelligence and Soft Computing Research · doi:10.2478/jaiscr-2014-0012 · Cited by 2 · see citing works
A General Closed-Loop Framework for Multi-dimensional Sequence Processing
Ding, Q., Zhao, X., & Han, J. (2012) · Advances in intelligent systems and computing · doi:10.1007/978-3-642-33932-5_30 · Cited by 2 · see citing works
Model-Free Design of Linear Quadratic Regulator
Rizvi, S. A. A., & Lin, Z. (2022) · Control engineering · doi:10.1007/978-3-031-15858-2_2 · Cited by 2 · see citing works
Data-driven Learning of Minimum-Energy Controls for Linear Systems.Preprint
Baggio, G., Katewa, V., & Pasqualetti, F. (2019) · arXiv (Cornell University) · Cited by 2 · see citing works
Secure Linear Quadratic Regulator Using Sparse Model-Free Reinforcement Learning
Kiumarsi, B., & Başar, T. (2019) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc40024.2019.9028861 · Cited by 1 · see citing works
Reduction of data amount in data-driven design of linear quadratic regulators
Izumi, S., & Xin, X. (2024) · Control Theory and Technology · doi:10.1007/s11768-024-00220-y · Cited by 1 · see citing works
Adaptive Optimal Output-Feedback Control of Discrete-Time Systems based on Hybrid Iteration
Liu, S., Gao, W., & Jiang, Z. (2024) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc56724.2024.10886087 · Cited by 1 · see citing works
Shi, J., Yue, D., Yang, Y., & Hu, S. (2016) · World Congress on Intelligent Control and Automation · doi:10.1109/wcica.2016.7578620 · Cited by 1 · see citing works
Plant-model-free Batch Adaptive Control via Controller Unfalsification
Verkooijen, R. R. (2007) · TU/e Research Portal · Cited by 1 · see citing works
From data and structure to models and controllers
van Waarde, H. (2020) · doi:10.33612/diss.144254461 · Cited by 1 · see citing works
Zero-Sum Games for Discrete-Time Systems Based on Model-Free ADP
Zhang, H., Liu, D., Luo, Y., & Wang, D. (2012) · Communications and control engineering/Communications and control engineering series · doi:10.1007/978-1-4471-4757-2_8
Data-Driven Minimum-Energy Controls for Linear SystemsPreprint
Baggio, G., Katewa, V., & Pasqualetti, F. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.02228
Zhou, Y., Li, D., & Xi, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.03452
On recursive Markov parameters estimation for MIMO systems
da Silva, G. R. G., & Lazar, M. (2021) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2021.08.385
Putri, A. N., Hidayat, E., Mahayana, D., & Machbub, C. (2023) · IEEE Access · doi:10.1109/access.2023.3342201
Wang, N., Wen, S.-X., & Wu, Y. (2024) · IEEE International Conference on Industrial Informatics (INDIN) · doi:10.1109/indin58382.2024.10774346
Data-Driven Control Algorithms for Unknown Discrete-Time Linear Periodic Systems
Wu, A., Meng, Y., & Mei, J. (2025) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2025.3578505
Output-Feedback Optimal Control to Prevent Hypotension Associated with Labor Epidural Anesthesia
Yang, Z., Dong, Y., Gao, W., Na, Q., & Liu, T. (2025) · Unmanned Systems · doi:10.1142/s2301385026410049
- Authors
- Aangenent, W., Kostic, D., de Jager, B., van de Molengraft, R., & Steinbuch, M.
- Affiliations
- Eindhoven University of Technology (NL)
- ORCID
- Steinbuch, M.
- Venue
- Proceedings of the 2005, American Control Conference, 2005.
- Publisher
- IEEE
- Published
- 2005-08-10
- Pages
- 1460-1465
- ISSN
- 0743-1619 (ISSN-L)
- OpenAlex
- W2127863965
- Cited by
- 70
- References
- 16
- Citations by year
- 2025: 3 · 2024: 6 · 2023: 10 · 2022: 4 · 2021: 9 · 2020: 7 · 2019: 6 · 2018: 2 · 2016: 6 · 2015: 1 · 2014: 4 · 2013: 1 · 2012: 2
- FWCI
- 1.92
- Type
- conference paper
- Language
- en
- Open access
- green
- research.tue.nl
- Licence
- other-oa
- Locations
- Proceedings of the ... American Control Conference/Proceedings of the American Control Conference (publishedVersion)
- TU/e Research Portal (submittedVersion, other-oa)
- TU/e Research Portal (submittedVersion)
- Topics
- Physical Sciences › Engineering › Control and Systems Engineering › Control Systems and Identification
- Physical Sciences › Engineering › Control and Systems Engineering › Advanced Control Systems Optimization
- Physical Sciences › Engineering › Control and Systems Engineering › Iterative Learning Control Systems
- Keywords
- Markov parameters, online parameter estimation, optimal feedback control, direct-drive robot, spatial kinematics, regulatory control, tracking control
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review