The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Sparse identification of nonlinear dynamics for model predictive control in the low-data limit
Open accessAbstract
Data-driven discovery of dynamics via machine learning is pushing the frontiers of modelling and control efforts, providing a tremendous opportunity to extend the reach of model predictive control (MPC). However, many leading methods in machine learning, such as neural networks (NN), require large volumes of training data, may not be interpretable, do not easily include known constraints and symmetries, and may not generalize beyond the attractor where models are trained. These factors limit their use for the online identification of a model in the low-data limit, for example following an abrupt change to the system dynamics. In this work, we extend the recent sparse identification of nonlinear dynamics (SINDY) modelling procedure to include the effects of actuation and demonstrate the ability of these models to enhance the performance of MPC, based on limited, noisy data. SINDY models are parsimonious, identifying the fewest terms in the model needed to explain the data, making them interpretable and generalizable. We show that the resulting SINDY-MPC framework has higher performance, requires significantly less data, and is more computationally efficient and robust to noise than NN models, making it viable for online training and execution in response to rapid system changes. SINDY-MPC also shows improved performance over linear data-driven models, although linear models may provide a stopgap until enough data is available for SINDY. SINDY-MPC is demonstrated on a variety of dynamical systems with different challenges, including the chaotic Lorenz system, a simple model for flight control of an F8 aircraft, and an HIV model incorporating drug treatment.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
Multilayer feedforward networks are universal approximators
Hornik, K., Stinchcombe, M., & White, H. (1989) · Neural Networks · doi:10.1016/0893-6080(89)90020-8 · Cited by 21,728
Deterministic Nonperiodic Flow
Lorenz, E. N. (1963) · Journal of the Atmospheric Sciences · doi:10.1175/1520-0469(1963)020<0130:dnf>2.0.co;2 · Cited by 19,398
Nonlinear total variation based noise removal algorithms
Rudin, L. I., Osher, S., & Fatemi, E. (1992) · Physica D: Nonlinear Phenomena · doi:10.1016/0167-2789(92)90242-f · Cited by 15,704
Detecting strange attractors in turbulence
Takens, F. (1981) · Lecture Notes in Mathematics · doi:10.1007/bfb0091924 · Cited by 10,459 · cited 1×
“mited measurements. It has recently been shown that delay coordinates provide a useful embedding to identify simple models of chaotic systems [41], building on the celebrated Takens embedding theorem [77]. Delay coordinates also define intrinsic coordinates for the Koopman operator [41], which provides a simple linear…”
MethodAn introduction to computing with neural nets
Lippmann, R. (1987) · IEEE ASSP Magazine · doi:10.1109/massp.1987.1165576 · Cited by 7,825
Dynamic mode decomposition of numerical and experimental data
SCHMID, P. J. (2010) · Journal of Fluid Mechanics · doi:10.1017/s0022112010001217 · Cited by 5,915
Model predictive control: Theory and practice—A survey
García, C. E., Prett, D. M., & Morari, M. (1989) · Automatica · doi:10.1016/0005-1098(89)90002-2 · Cited by 5,284
Discovering governing equations from data by sparse identification of nonlinear dynamical systems
Brunton, S. L., Proctor, J. L., & Kutz, J. N. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1517384113 · Cited by 4,796
Self-citationDistilling Free-Form Natural Laws from Experimental Data
Schmidt, M., & Lipson, H. (2009) · Science · doi:10.1126/science.1165893 · Cited by 2,890
An eigensystem realization algorithm for modal parameter identification and model reduction
Juang, J.-N., & Pappa, R. S. (1985) · Journal of Guidance, Control, and Dynamics · doi:10.2514/3.20031 · Cited by 2,762
Fitting autoregressive models for prediction
Akaike, H. (1969) · Annals of the Institute of Statistical Mathematics · doi:10.1007/bf02532251 · Cited by 2,471
Model predictive control: past, present and future
Morari, M., & H. Lee, J. (1999) · Computers & Chemical Engineering · doi:10.1016/s0098-1354(98)00301-9 · Cited by 2,335
Spectral analysis of nonlinear flows
ROWLEY, C. W., MEZIĆ, I., BAGHERI, S., SCHLATTER, P., & HENNINGSON, D. S. (2009) · Journal of Fluid Mechanics · doi:10.1017/s0022112009992059 · Cited by 2,324
Model predictive control: Recent developments and future promise
Mayne, D. Q. (2014) · Automatica · doi:10.1016/j.automatica.2014.10.128 · Cited by 1,975
A Data–Driven Approximation of the Koopman Operator: Extending Dynamic Mode Decomposition
Williams, M. O., Kevrekidis, I. G., & Rowley, C. W. (2015) · Journal of Nonlinear Science · doi:10.1007/s00332-015-9258-5 · Cited by 1,945
Data-driven discovery of partial differential equations
Rudy, S. H., Brunton, S. L., Proctor, J. L., & Kutz, J. N. (2017) · Science Advances · doi:10.1126/sciadv.1602614 · Cited by 1,557
Self-citationMathematical Analysis of HIV-1 Dynamics in Vivo
Perelson, A. S., & Nelson, P. W. (1999) · SIAM Review · doi:10.1137/s0036144598335107 · Cited by 1,552
On dynamic mode decomposition: Theory and applications
Tu, J. H., Rowley, C. W., Luchtenburg, D. M., Brunton, S. L., & Kutz, J. N. (2014) · Journal of Computational Dynamics · doi:10.3934/jcd.2014.1.391 · Cited by 1,528
Self-citationJust relax: convex programming methods for identifying sparse signals in noise
Tropp, J. A. (2006) · IEEE Transactions on Information Theory · doi:10.1109/tit.2005.864420 · Cited by 1,407
Spectral Properties of Dynamical Systems, Model Reduction and Decompositions
Mezić, I. (2005) · Nonlinear Dynamics · doi:10.1007/s11071-005-2824-x · Cited by 1,317
Dynamic Mode Decomposition: Data-Driven Modeling of Complex Systems
Kutz, J. N., Brunton, S. L., Brunton, B. W., & Proctor, J. L. (2016) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611974508 · Cited by 1,180
Self-citationDynamic Mode Decomposition with Control
Proctor, J. L., Brunton, S. L., & Kutz, J. N. (2016) · SIAM Journal on Applied Dynamical Systems · doi:10.1137/15m1013857 · Cited by 1,124
Self-citationTurbulence, Coherent Structures, Dynamical Systems and Symmetry
Holmes, P., Lumley, J. L., Berkooz, G., & Rowley, C. W. (2012) · Cambridge University Press eBooks · doi:10.1017/cbo9780511919701 · Cited by 924
Automated reverse engineering of nonlinear dynamical systems
Bongard, J., & Lipson, H. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0609476104 · Cited by 792
A Course in Robust Control Theory
Dullerud, G. E., & Paganini, F. (2000) · Texts in Applied Mathematics · doi:10.1007/978-1-4757-3290-0 · Cited by 769
Kernel methods in system identification, machine learning and function estimation: A survey
Pillonetto, G., Dinuzzo, F., Chen, T., De Nicolao, G., & Ljung, L. (2014) · Automatica · doi:10.1016/j.automatica.2014.01.001 · Cited by 741 · cited 1×
“We refer the reader to an extensive review on nonlinear system identification methods [39] and a recent review in the context of machine learning [40].”
MethodSynthesis of low-peak-factor signals and binary sequences with low autocorrelation (Corresp.)
Schroeder, M. (1970) · IEEE Transactions on Information Theory · doi:10.1109/tit.1970.1054411 · Cited by 740
Budišić, M., Mohr, R., & Mezić, I. (2012) · Chaos: An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.4772195 · Cited by 710
Model predictive control: Review of the three decades of development
Lee, J. H. (2011) · International Journal of Control, Automation and Systems · doi:10.1007/s12555-011-0300-6 · Cited by 641
Wang, T., Gao, H., & Qiu, J. (2016) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2411671 · Cited by 636
Closed-Loop Turbulence Control: Progress and Challenges
Brunton, S. L., & Noack, B. R. (2015) · Applied Mechanics Reviews · doi:10.1115/1.4031175 · Cited by 623
Self-citationChaos as an intermittently forced linear system
Brunton, S. L., Brunton, B. W., Proctor, J. L., Kaiser, E., & Kutz, J. N. (2017) · Nature Communications · doi:10.1038/s41467-017-00030-8 · Cited by 608
Self-citationNonlinear Predictive Control and Moving Horizon Estimation — An Introductory Overview
Allgöwer, F., Badgwell, T. A., Qin, J. S., Rawlings, J. B., & Wright, S. J. (1999) · Advances in Control · doi:10.1007/978-1-4471-0853-5_19 · Cited by 474
Learning deep control policies for autonomous aerial vehicles with MPC-guided policy search
Zhang, T., Kahn, G., Levine, S., & Abbeel, P. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487175 · Cited by 452 · cited 1×
“Nonlinear models based on machine learning, such as neural networks, are increasingly used due to advances in computing power, and recently deep reinforcement learning has been combined with MPC [36, 56], yielding impressive results in the large-data limit.”
Numerical Differentiation of Noisy, Nonsmooth Data
Chartrand, R. (2011) · ISRN Applied Mathematics · doi:10.5402/2011/164564 · Cited by 444
Inferring biological networks by sparse identification of nonlinear dynamics
Mangan, N. M., Brunton, S. L., Proctor, J. L., & Kutz, J. N. (2016) · IEEE Transactions on Molecular, Biological and Multi-Scale Communications · doi:10.1109/tmbmc.2016.2633265 · Cited by 436
Self-citationLearning partial differential equations via data discovery and sparse optimization
Schaeffer, H. (2017) · Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rspa.2016.0446 · Cited by 432
Model Predictive Control in Aerospace Systems: Current State and Opportunities
Eren, U., Prach, A., Koçer, B. B., Raković, S. V., Kayacan, E., & Açıkmeşe, B. (2017) · Journal of Guidance, Control, and Dynamics · doi:10.2514/1.g002507 · Cited by 410
Volterra series and geometric control theory
Brockett, R. W. (1976) · Automatica · doi:10.1016/0005-1098(76)90080-7 · Cited by 366
Constrained sparse Galerkin regression
Loiseau, J.-C., & Brunton, S. L. (2018) · Journal of Fluid Mechanics · doi:10.1017/jfm.2017.823 · Cited by 349
Self-citationSparse reduced-order modelling: sensor-based dynamics to full-state estimation
Loiseau, J.-C., Noack, B. R., & Brunton, S. L. (2018) · Journal of Fluid Mechanics · doi:10.1017/jfm.2018.147 · Cited by 246
Self-citationModel predictive control using neural networks
(1995) · IEEE Control Systems · doi:10.1109/37.466261 · Cited by 233
A fast nonlinear model identification method
Li, K., Peng, J.-X., & Irwin, G. W. (2005) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2005.852557 · Cited by 226
Sparse model selection via integral terms
Schaeffer, H., & McCalla, S. G. (2017) · Physical Review E · doi:10.1103/physreve.96.023302 · Cited by 225
Model selection for dynamical systems via sparse regression and information criteria
Mangan, N. M., Kutz, J. N., Brunton, S. L., & Proctor, J. L. (2017) · Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rspa.2017.0009 · Cited by 205
Self-citationA Unified Framework for Sparse Relaxed Regularized Regression: SR3
Zheng, P., Askham, T., Brunton, S. L., Kutz, J. N., & Aravkin, A. Y. (2019) · IEEE Access · doi:10.1109/access.2018.2886528 · Cited by 193
Self-citationFalse discoveries occur early on the Lasso path
Su, W., Bogdan, M., & Candès, E. (2017) · The Annals of Statistics · doi:10.1214/16-aos1521 · Cited by 173
Chen, T., Andersen, M. S., Ljung, L., Chiuso, A., & Pillonetto, G. (2014) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2014.2351851 · Cited by 169
A model predictive control based scheduling method for HIV therapy
Zurakowski, R., & Teel, A. R. (2006) · Journal of Theoretical Biology · doi:10.1016/j.jtbi.2005.05.004 · Cited by 166
Sparse identification of nonlinear dynamics for rapid model recovery
Quade, M., Abel, M., Nathan Kutz, J., & Brunton, S. L. (2018) · Chaos: An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.5027470 · Cited by 163
Self-citationA Sparse Bayesian Approach to the Identification of Nonlinear State-Space Systems
Pan, W., Yuan, Y., Gonçalves, J. M., & Stan, G.-B. V. (2015) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2015.2426291 · Cited by 146
Yan, Z., & Wang, J. (2012) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2012.2205582 · Cited by 127
Brunton, S. L., Tu, J. H., Bright, I., & Kutz, J. N. (2014) · SIAM Journal on Applied Dynamical Systems · doi:10.1137/130949282 · Cited by 122
Self-citationAggelogiannaki, E., & Sarimveis, H. (2007) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2007.05.002 · Cited by 118
Lee, S.-J., Lee, D.-J., & Oh, H. (2005) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2002.11.001 · Cited by 114
Nonlinear model reduction for dynamical systems using sparse sensor locations from learned libraries
Sargsyan, S., Brunton, S. L., & Kutz, J. N. (2015) · Physical Review E · doi:10.1103/physreve.92.033304 · Cited by 69
Self-citationReconstruction of arbitrary biochemical reaction networks: A compressive sensing approach
Pan, W., Yuan, Y., Gonçalves, J., & Stan, G.-B. (2012) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2012.6426216 · Cited by 23
Identifiability of affine linear parameter-varying models
Alkhoury, Z., Petreczky, M., & Mercère, G. (2017) · Automatica · doi:10.1016/j.automatica.2017.01.029 · Cited by 18
Cited by
Data-Driven Science and Engineering: Machine Learning, Dynamical Systems, and Control
Brunton, S. L., & Kutz, J. N. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108380690 · Cited by 1,154
Self-citationData-driven discovery of coordinates and governing equations
Champion, K., Lusch, B., Kutz, J. N., & Brunton, S. L. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1906995116 · Cited by 909
Self-citationPhysics-informed learning of governing equations from scarce data
Chen, Z., Liu, Y., & Sun, H. (2021) · Nature Communications · doi:10.1038/s41467-021-26434-1 · Cited by 609
Cheng, S., Quilodrán-Casas, C., Ouala, S., Farchi, A., Liu, C., Tandeo, P., Fablet, R., Lucor, D., Iooss, B., Brajard, J., et al. (2023) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2023.123537 · Cited by 303
Fasel, U., Kutz, J. N., Brunton, B. W., & Brunton, S. L. (2022) · Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rspa.2021.0904 · Cited by 294
Self-citation
Metadata
- Authors
- Kaiser, E., Kutz, J. N., & Brunton, S. L.
- Venue
- Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences
- Publisher
- The Royal Society
- Published
- 2018-11
- Volume
- 474
- Issue
- 2219
- Pages
- 20180335-20180335
- ISSN
- 1364-5021 (ISSN-L)
- 1471-2946
- OpenAlex
- W2768748954
- Cited by
- 462
- References
- 59
- FWCI
- 18.46
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.