The DOI matches its Crossref record; 72 of the 72 references it cites were found in a registry or an index.
Behavioral systems theory in data-driven analysis, signal processing, and control
Open accessAbstract
The behavioral approach to systems theory, put forward 40 years ago by Jan C. Willems, takes a representation-free perspective of a dynamical system as a set of trajectories. Till recently, it was an unorthodox niche of research but has gained renewed interest for the newly emerged data-driven paradigm, for which it is uniquely suited due to the representation-free perspective paired with recently developed computational methods. A result derived in the behavioral setting that became known as the fundamental lemma started a new class of subspace-type data-driven methods. The fundamental lemma gives conditions for a non-parametric representation of a linear time-invariant system by the image of a Hankel matrix constructed from raw time series data. This paper reviews the fundamental lemma, its generalizations, and related data-driven analysis, signal processing, and control methods. A prototypical signal processing problem, reviewed in the paper, is missing data estimation. It includes simulation, state estimation, and output tracking control as special cases. The direct data-driven control methods using the fundamental lemma and the non-parametric representation are loosely classified as implicit and explicit approaches. Representative examples are data-enabled predictive control (an implicit method) and data-driven linear quadratic regulation (an explicit method). These methods are equally amenable to certainty-equivalence as well as to robust control. Emphasis is put on the robustness of the methods under noise. The methods allow for theoretical certification, they are computationally tractable, in comparison with machine learning methods require small amount of data, and are robustly implementable in real-time on complex physical systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Golub, G. (2012) · doi:10.56021/9781421407944 · Cited by 34,505
Time Series Analysis: Forecasting and Control
Geurts, M., Box, G. E. P., & Jenkins, G. M. (1977) · Journal of Marketing Research · doi:10.2307/3150485 · Cited by 19,186
Model predictive control: Theory and practice—A survey
García, C. E., Prett, D. M., & Morari, M. (1989) · Automatica · doi:10.1016/0005-1098(89)90002-2 · Cited by 5,284
Discovering governing equations from data by sparse identification of nonlinear dynamical systems
Brunton, S. L., Proctor, J. L., & Kutz, J. N. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1517384113 · Cited by 4,796
Parikh, N., & Boyd, S. (2014) · Foundations and Trends® in Optimization · doi:10.1561/2400000003 · Cited by 4,102
Optimal Control: Linear Quadratic Methods
Anderson, B. D. O., & Moore, J. B. (1979) · Cited by 2,823
Subspace identification for linear systems: theory, implementation, applications
Overschee, P. V., & Moor, B. L. R. D. (1996) · CERN Document Server (European Organization for Nuclear Research) · Cited by 2,271
Dynamic matrix control¿A computer control algorithm
Cutler, C. R., & Ramaker, B. L. (1980) · IEEE Transactions on Automatic Control · doi:10.1109/jacc.1980.4232009 · Cited by 1,699
Predictive Control for Linear and Hybrid Systems
Borrelli, F., Bemporad, A., & Morari, M. (2017) · Cambridge University Press eBooks · doi:10.1017/9781139061759 · Cited by 1,443
From model-based control to data-driven control: Survey, classification and perspective
Hou, Z.-S., & Wang, Z. (2013) · Information Sciences · doi:10.1016/j.ins.2012.07.014 · Cited by 1,405
Paradigms and puzzles in the theory of dynamical systems
Willems, J. C. (1991) · IEEE Transactions on Automatic Control · doi:10.1109/9.73561 · Cited by 1,176
A note on persistency of excitation
Willems, J. C., Rapisarda, P., Markovsky, I., & Moor, B. L. M. D. (2004) · Systems & Control Letters · doi:10.1016/j.sysconle.2004.09.003 · Cited by 1,145
Self-citationDynamic Mode Decomposition with Control
Proctor, J. L., Brunton, S. L., & Kutz, J. N. (2016) · SIAM Journal on Applied Dynamical Systems · doi:10.1137/15m1013857 · Cited by 1,124
Robust Solutions to Least-Squares Problems with Uncertain Data
El Ghaoui, L., & Lebret, H. (1997) · SIAM Journal on Matrix Analysis and Applications · doi:10.1137/s0895479896298130 · Cited by 1,076
Formulas for Data-Driven Control: Stabilization, Optimality, and Robustness
De Persis, C., & Tesi, P. (2020) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2019.2959924 · Cited by 983
2013 American Control Conference
(2013) · doi:10.1109/acc31500.2013 · Cited by 979
Learning-Based Model Predictive Control: Toward Safe Learning in Control
Hewing, L., Wabersich, K. P., Menner, M., & Zeilinger, M. N. (2020) · Annual Review of Control, Robotics, and Autonomous Systems · doi:10.1146/annurev-control-090419-075625 · Cited by 835
Data-Driven Model Predictive Control With Stability and Robustness Guarantees
Berberich, J., Kohler, J., Muller, M. A., & Allgower, F. (2021) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2020.3000182 · Cited by 803
Kernel methods in system identification, machine learning and function estimation: A survey
Pillonetto, G., Dinuzzo, F., Chen, T., De Nicolao, G., & Ljung, L. (2014) · Automatica · doi:10.1016/j.automatica.2014.01.001 · Cited by 741
VERHAEGEN, M., & DEWILDE, P. (1992) · International Journal of Control · doi:10.1080/00207179208934363 · Cited by 716
Robust solution to least squares problems with uncertain data
Ghaoui, L. E., & Lebret, H. (1997) · Cited by 638
Data-Enabled Predictive Control: In the Shallows of the DeePC
Coulson, J., Lygeros, J., & Dorfler, F. (2019) · 2019 18th European Control Conference (ECC) · doi:10.23919/ecc.2019.8795639 · Cited by 628
A Tour of Reinforcement Learning: The View from Continuous Control
Recht, B. (2019) · Annual Review of Control, Robotics, and Autonomous Systems · doi:10.1146/annurev-control-053018-023825 · Cited by 609
Introduction to Mathematical Systems Theory
Polderman, J. W., & Willems, J. C. (1998) · Texts in Applied Mathematics · doi:10.1007/978-1-4757-2953-5 · Cited by 609
From time series to linear system—Part I. Finite dimensional linear time invariant systems
Willems, J. C. (1986) · Automatica · doi:10.1016/0005-1098(86)90066-x · Cited by 569
The European Control Conference
(2013) · 2013 European Control Conference (ECC) · doi:10.23919/ecc.2013.6669086 · Cited by 553
Data Informativity: A New Perspective on Data-Driven Analysis and Control
van Waarde, H. J., Eising, J., Trentelman, H. L., & Camlibel, M. K. (2020) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2020.2966717 · Cited by 514
From experiment design to closed-loop control
Hjalmarsson, H. (2005) · Automatica · doi:10.1016/j.automatica.2004.11.021 · Cited by 506
Maneuver-based motion planning for nonlinear systems with symmetries
Frazz, E., Dahleh, M. A., & Feron, E. (2005) · IEEE Transactions on Robotics · doi:10.1109/tro.2005.852260 · Cited by 440
On the Sample Complexity of the Linear Quadratic Regulator
Dean, S., Mania, H., Matni, N., Recht, B., & Tu, S. (2020) · Foundations of Computational Mathematics · doi:10.1007/s10208-019-09426-y · Cited by 436
From Noisy Data to Feedback Controllers: Nonconservative Design via a Matrix S-Lemma
van Waarde, H. J., Camlibel, M. K., & Mesbahi, M. (2022) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2020.3047577 · Cited by 383
1987 American Control Conference
(1987) · doi:10.23919/acc.1987 · Cited by 366
Wasserstein Distributionally Robust Optimization: Theory and Applications in Machine Learning
Kuhn, D., Esfahani, P. M., Nguyen, V. A., & Shafieezadeh-Abadeh, S. (2019) · Operations Research & Management Science in the Age of Analytics · doi:10.1287/educ.2019.0198 · Cited by 342
2019 IEEE 58th Conference on Decision and Control (CDC)
(2019) · doi:10.1109/cdc40024.2019 · Cited by 297
Structured low-rank approximation and its applications
Markovsky, I. (2008) · Automatica · doi:10.1016/j.automatica.2007.09.011 · Cited by 254
Self-citationXu, H., Caramanis, C., & Mannor, S. (2010) · IEEE Transactions on Information Theory · doi:10.1109/tit.2010.2048503 · Cited by 230
Willems’ Fundamental Lemma for State-Space Systems and Its Extension to Multiple Datasets
van Waarde, H. J., De Persis, C., Camlibel, M. K., & Tesi, P. (2020) · IEEE Control Systems Letters · doi:10.1109/lcsys.2020.2986991 · Cited by 230
Bridging Direct and Indirect Data-Driven Control Formulations via Regularizations and Relaxations
Dörfler, F., Coulson, J., & Markovsky, I. (2022) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2022.3148374 · Cited by 223
Self-citation1992 American Control Conference
(1992) · doi:10.23919/acc.1992 · Cited by 219
Distributionally Robust Chance Constrained Data-Enabled Predictive Control
Coulson, J., Lygeros, J., & Dorfler, F. (2022) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2021.3097706 · Cited by 218
2013 9th Asian Control Conference (ASCC)
(2013) · doi:10.1109/ascc30777.2013 · Cited by 204
Predictive control for agile semi-autonomous ground vehicles using motion primitives
Gray, A., Gao, Y., Lin, T., Hedrick, J. K., Tseng, H. E., & Borrelli, F. (2012) · 2012 American Control Conference (ACC) · doi:10.1109/acc.2012.6315303 · Cited by 194
Anderson, J., Doyle, J. C., Low, S. H., & Matni, N. (2019) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2019.03.006 · Cited by 166
Low-complexity learning of Linear Quadratic Regulators from noisy data
Persis, C. D., & Tesi, P. (2021) · Automatica · doi:10.1016/j.automatica.2021.109548 · Cited by 165
Data-driven control of complex networks
Baggio, G., Bassett, D. S., & Pasqualetti, F. (2021) · Nature Communications · doi:10.1038/s41467-021-21554-0 · Cited by 162
Combining Prior Knowledge and Data for Robust Controller Design
Berberich, J., Scherer, C. W., & Allgöwer, F. (2022) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2022.3209342 · Cited by 158
System Identification: A Machine Learning Perspective
Chiuso, A., & Pillonetto, G. (2018) · Annual Review of Control Robotics and Autonomous Systems · doi:10.1146/annurev-control-053018-023744 · Cited by 149
Optimization algorithms as robust feedback controllers
Hauswirth, A., He, Z., Bolognani, S., Hug, G., & Dörfler, F. (2024) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2024.100941 · Cited by 125
Self-citationDecentralized Data-Enabled Predictive Control for Power System Oscillation Damping
Huang, L., Coulson, J., Lygeros, J., & Dörfler, F. (2021) · IEEE Transactions on Control Systems Technology · doi:10.1109/tcst.2021.3088638 · Cited by 118
Self-citationData-Driven Control for Linear Discrete-Time Delay Systems
Rueda-Escobedo, J. G., Fridman, E., & Schiffer, J. (2021) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2021.3096896 · Cited by 117
Bertsimas, D., & Copenhaver, M. S. (2017) · European Journal of Operational Research · doi:10.1016/j.ejor.2017.03.051 · Cited by 106
Data‐enabled predictive control for quadcopters
Elokda, E., Coulson, J., Beuchat, P. N., Lygeros, J., & Dörfler, F. (2021) · International Journal of Robust and Nonlinear Control · doi:10.1002/rnc.5686 · Cited by 102
Self-citationOn the Certainty-Equivalence Approach to Direct Data-Driven LQR Design
Dörfler, F., Tesi, P., & Persis, C. D. (2023) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2023.3253787 · Cited by 95
Self-citationData-Enabled Predictive Control for Grid-Connected Power Converters
Huang, L., Coulson, J., Lygeros, J., & Dörfler, F. (2019) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc40024.2019.9029522 · Cited by 93
Self-citationMaximum Likelihood Estimation in Data-Driven Modeling and Control
Yin, M., Iannelli, A., & Smith, R. S. (2021) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2021.3137788 · Cited by 93
Data-Driven Minimum-Energy Controls for Linear Systems
Baggio, G., Katewa, V., & Pasqualetti, F. (2019) · IEEE Control Systems Letters · doi:10.1109/lcsys.2019.2914090 · Cited by 86
Online learning of data-driven controllers for unknown switched linear systems
Rotulo, M., Persis, C. D., & Tesi, P. (2022) · Automatica · doi:10.1016/j.automatica.2022.110519 · Cited by 72
Adaptive Robust Data-Driven Building Control via Bilevel Reformulation: An Experimental Result
Lian, Y., Shi, J., Koch, M., & Jones, C. N. (2023) · IEEE Transactions on Control Systems Technology · doi:10.1109/tcst.2023.3259641 · Cited by 65
On Direct vs Indirect Data-Driven Predictive Control
Krishnan, V., & Pasqualetti, F. (2021) · Proceedings of the IEEE Conference on Decision & Control, including the Symposium on Adaptive Processes · doi:10.1109/cdc45484.2021.9683187 · Cited by 64
Online data-enabled predictive control
Baros, S., Chang, C.-Y., Colón-Reyes, G. E., & Bernstein, A. (2022) · Automatica · doi:10.1016/j.automatica.2021.109926 · Cited by 63
Data-Based Receding Horizon Control of Linear Network Systems
Allibhoy, A., & Cortes, J. (2020) · IEEE Control Systems Letters · doi:10.1109/lcsys.2020.3021050 · Cited by 63
Unravelling the intertwined atomic and bulk nature of localised excitons by attosecond spectroscopy
Lucchini, M., Sato, S. A., Lucarelli, G. D., Moio, B., Inzani, G., Borrego-Varillas, R., Frassetto, F., Poletto, L., Hübener, H., Giovannini, U., et al. (2021) · RePEc: Research Papers in Economics · Cited by 61
An Extended Kalman Filter for Data-Enabled Predictive Control
Alpago, D., Dörfler, F., & Lygeros, J. (2020) · IEEE Control Systems Letters · doi:10.1109/lcsys.2020.2998296 · Cited by 49
Self-citationYu, Y., Talebi, S., van Waarde, H. J., Topcu, U., Mesbahi, M., & Acikmese, B. A. (2021) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc45484.2021.9682952 · Cited by 38
Approximate realization based upon an alternative to the Hankel matrix: the Page matrix
Damen, A. A. H., den Hof, P. M. J. V., & Hajdasinski, A. (1982) · Systems & Control Letters · doi:10.1016/0167-6911(82)90002-0 · Cited by 36
Model Agnostic Time Series Analysis via Matrix Estimation
Agarwal, A., Amjad, M. J., Shah, D., & Shen, D. (2018) · Proceedings of the ACM on Measurement and Analysis of Computing Systems · doi:10.1145/3287319 · Cited by 27
Nonlinear Data-Enabled Prediction and ControlPreprint
Lian, Y., & Jones, C. N. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.03187 · Cited by 25
Model Agnostic Time Series Analysis via Matrix Estimation
Agarwal, A., Amjad, M. J., Shah, D., & Shen, D. (2019) · ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS) · doi:10.1145/3309697.3331479 · Cited by 24
Data-driven dynamic interpolation and approximation
Markovsky, I., & Dörfler, F. (2021) · Automatica · doi:10.1016/j.automatica.2021.110008 · Cited by 24
Self-citationEncrypted Distributed Lasso for Sparse Data Predictive Control
Alexandru, A. B., Tsiamis, A., & Pappas, G. J. (2021) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc45484.2021.9683401 · Cited by 14
Robust Data-Enabled Predictive Control: Tractable Formulations and Performance GuaranteesPreprint
Huang, L., Zhen, J., Lygeros, J., & Dörfler, F. (2021) · arXiv (Cornell University) · doi:10.3929/ethz-b-000612044 · Cited by 11
Self-citationData Driven Control: An Offset Free Approach
Salvador, J. R., Ramı́rez, D. R., Álamo, T., de la Peña, D. M., & Garcia-Marin, G. (2019) · European Control Conference (ECC) · doi:10.23919/ecc.2019.8795956 · Cited by 9
Cited by
Privacy-Preserving Data-Enabled Predictive Leading Cruise Control in Mixed Traffic
Zhang, K., Chen, K., Li, Z., Chen, J., & Zheng, Y. (2024) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3329484 · Cited by 24
Metadata
- Authors
- Markovsky, I., & Dörfler, F.
- Venue
- Annual Reviews in Control
- Publisher
- Elsevier BV
- Published
- 2021
- Volume
- 52
- Pages
- 42-64
- ISSN
- 1367-5788 (ISSN-L)
- OpenAlex
- W3213835390
- Cited by
- 310
- References
- 72
- FWCI
- 20.09
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.