The DOI matches its Crossref record; 83 of the 83 references it cites were found in a registry or an index.
Ensemble-SINDy: Robust sparse model discovery in the low-data, high-noise limit, with active learning and control
Open accessAbstract
Sparse model identification enables the discovery of nonlinear dynamical systems purely from data; however, this approach is sensitive to noise, especially in the low-data limit. In this work, we leverage the statistical approach of bootstrap aggregating (bagging) to robustify the sparse identification of the nonlinear dynamics (SINDy) algorithm. First, an ensemble of SINDy models is identified from subsets of limited and noisy data. The aggregate model statistics are then used to produce inclusion probabilities of the candidate functions, which enables uncertainty quantification and probabilistic forecasts. We apply this ensemble-SINDy (E-SINDy) algorithm to several synthetic and real-world datasets and demonstrate substantial improvements to the accuracy and robustness of model discovery from extremely noisy and limited data. For example, E-SINDy uncovers partial differential equations models from data with more than twice as much measurement noise as has been previously reported. Similarly, E-SINDy learns the Lotka Volterra dynamics from remarkably limited data of yearly lynx and hare pelts collected from 1900 to 1920. E-SINDy is computationally efficient, with similar scaling as standard SINDy. Finally, we show that ensemble statistics from E-SINDy can be exploited for active learning and improved model predictive control.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Elements of Statistical Learning
Hastie, T., Friedman, J., & Tibshirani, R. (2001) · Springer Series in Statistics · doi:10.1007/978-0-387-21606-5 · Cited by 24,162
Raissi, M., Perdikaris, P., & Karniadakis, G. E. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2018.10.045 · Cited by 20,384
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325
The Jackknife, the Bootstrap and Other Resampling Plans
Efron, B. (1982) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611970319 · Cited by 8,120
Dynamic mode decomposition of numerical and experimental data
SCHMID, P. J. (2010) · Journal of Fluid Mechanics · doi:10.1017/s0022112010001217 · Cited by 5,915
Model predictive control: Theory and practice—A survey
García, C. E., Prett, D. M., & Morari, M. (1989) · Automatica · doi:10.1016/0005-1098(89)90002-2 · Cited by 5,284
Discovering governing equations from data by sparse identification of nonlinear dynamical systems
Brunton, S. L., Proctor, J. L., & Kutz, J. N. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1517384113 · Cited by 4,796
Self-citation(2009) · Minds at UW (University of Wisconsin) · Cited by 4,791
The Strength of Weak Learnability
Schapire, R. E. (1990) · Machine Learning · doi:10.1007/bf00116037 · Cited by 4,600
Learning nonlinear operators via DeepONet based on the universal approximation theorem of operators
Lu, L., Jin, P., Pang, G., Zhang, Z., & Karniadakis, G. E. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00302-5 · Cited by 3,418
Distilling Free-Form Natural Laws from Experimental Data
Schmidt, M., & Lipson, H. (2009) · Science · doi:10.1126/science.1165893 · Cited by 2,890
Model predictive control: past, present and future
Morari, M., & H. Lee, J. (1999) · Computers & Chemical Engineering · doi:10.1016/s0098-1354(98)00301-9 · Cited by 2,335
Spectral analysis of nonlinear flows
ROWLEY, C. W., MEZIĆ, I., BAGHERI, S., SCHLATTER, P., & HENNINGSON, D. S. (2009) · Journal of Fluid Mechanics · doi:10.1017/s0022112009992059 · Cited by 2,324
Meinshausen, N., & Bühlmann, P. (2010) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2010.00740.x · Cited by 2,215
Model predictive control: Recent developments and future promise
Mayne, D. Q. (2014) · Automatica · doi:10.1016/j.automatica.2014.10.128 · Cited by 1,975
Neural Network Ensembles, Cross Validation, and Active Learning
Krogh, A., & Vedelsby, J. (1994) · Cited by 1,838
Boosting a Weak Learning Algorithm by Majority
Freund, Y. (1995) · Information and Computation · doi:10.1006/inco.1995.1136 · Cited by 1,674
Data-driven discovery of partial differential equations
Rudy, S. H., Brunton, S. L., Proctor, J. L., & Kutz, J. N. (2017) · Science Advances · doi:10.1126/sciadv.1602614 · Cited by 1,557
Self-citationSpectral Properties of Dynamical Systems, Model Reduction and Decompositions
Mezić, I. (2005) · Nonlinear Dynamics · doi:10.1007/s11071-005-2824-x · Cited by 1,317
Dynamic Mode Decomposition: Data-Driven Modeling of Complex Systems
Kutz, J. N., Brunton, S. L., Brunton, B. W., & Proctor, J. L. (2016) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611974508 · Cited by 1,180
Self-citation(2013) · Dynamic Modelling and Predictive Control in Solid Oxide Fuel Cells: First Principle and Data‐Based Approaches · doi:10.1002/9781118501054.ch6 · Cited by 1,047
Fourier Neural Operator for Parametric Partial Differential Equations
Li, Z., Kovachki, N., Azizzadenesheli, K., Liu, B., Bhattacharya, K., Stuart, A., & Anandkumar, A. (2020) · arXiv · doi:10.48550/arxiv.2010.08895 · Cited by 1,021
Analysis of Fluid Flows via Spectral Properties of the Koopman Operator
Mezić, I. (2013) · Annual Review of Fluid Mechanics · doi:10.1146/annurev-fluid-011212-140652 · Cited by 983
Data-driven discovery of coordinates and governing equations
Champion, K., Lusch, B., Kutz, J. N., & Brunton, S. L. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1906995116 · Cited by 909
Self-citationAutomated reverse engineering of nonlinear dynamical systems
Bongard, J., & Lipson, H. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0609476104 · Cited by 792 · cited 1×
“…exist, including equation-free modeling [1], normal form identification [2–4], nonlinear Laplacian spectral analysis [5], Koop-man analysis [6, 7] and dynamic mode decomposition (DMD) [8–10], symbolic regression [11–15], sparse regression [16, 17], Gaussian processes [18], and deep learning [19–24].”
BackgroundGear, C. W., Hyman, J. M., Kevrekidid, P. G., Kevrekidis, I. G., Runborg, O., & Theodoropoulos, C. (2003) · Communications in Mathematical Sciences · doi:10.4310/cms.2003.v1.n4.a5 · Cited by 776
Dynamic Mode Decomposition: Data-Driven Modeling of Complex Systems
Kutz, J. N., Brunton, S. L., Brunton, B. W., et al. (2016) · Cited by 699
Self-citationUniversal Differential Equations for Scientific Machine Learning
Rackauckas, C., Ma, Y., Martensen, J., Warner, C., Zubov, K., Supekar, R., Skinner, D., Ramadhan, A., & Edelman, A. (2020) · doi:10.21203/rs.3.rs-55125/v1 · Cited by 643
Machine learning of linear differential equations using Gaussian processes
Raissi, M., Perdikaris, P., & Karniadakis, G. E. (2017) · Journal of Computational Physics · doi:10.1016/j.jcp.2017.07.050 · Cited by 584
Sparse identification of nonlinear dynamics for model predictive control in the low-data limit
Kaiser, E., Kutz, J. N., & Brunton, S. L. (2018) · Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rspa.2018.0335 · Cited by 462
Self-citationLearning deep control policies for autonomous aerial vehicles with MPC-guided policy search
Zhang, T., Kahn, G., Levine, S., & Abbeel, P. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487175 · Cited by 452 · cited 1×
“Deep neural network models have been increasingly used for deep MPC [83, 84]; however, they often rely on access to massive data sets, have limited ability to generalize, do not readily incorporate known physical constraints, and are computationally expensive.”
MethodInferring biological networks by sparse identification of nonlinear dynamics
Mangan, N. M., Brunton, S. L., Proctor, J. L., & Kutz, J. N. (2016) · IEEE Transactions on Molecular, Biological and Multi-Scale Communications · doi:10.1109/tmbmc.2016.2633265 · Cited by 436
Self-citationLearning partial differential equations via data discovery and sparse optimization
Schaeffer, H. (2017) · Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rspa.2016.0446 · Cited by 432
Bagging, Boosting and Ensemble Methods
Bühlmann, P. (2012) · Handbook of Computational Statistics · doi:10.1007/978-3-642-21551-3_33 · Cited by 375
Constrained sparse Galerkin regression
Loiseau, J.-C., & Brunton, S. L. (2018) · Journal of Fluid Mechanics · doi:10.1017/jfm.2017.823 · Cited by 349
Self-citationSINDy-PI: a robust algorithm for parallel implicit sparse identification of nonlinear dynamics
Kaheman, K., Kutz, J. N., & Brunton, S. L. (2020) · Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rspa.2020.0279 · Cited by 276
Self-citationData‐Driven Equation Discovery of Ocean Mesoscale Closures
Zanna, L., & Bolton, T. (2020) · Geophysical Research Letters · doi:10.1029/2020gl088376 · Cited by 259
PySINDy: A Python package for the sparse identification of nonlinear dynamical systems from data
de Silva, B., Champion, K., Quade, M., Loiseau, J.-C., Kutz, J., & Brunton, S. (2020) · Journal of Open Source Software · doi:10.21105/joss.02104 · Cited by 250
Self-citationSparse reduced-order modelling: sensor-based dynamics to full-state estimation
Loiseau, J.-C., Noack, B. R., & Brunton, S. L. (2018) · Journal of Fluid Mechanics · doi:10.1017/jfm.2018.147 · Cited by 246
Self-citationWeak SINDy for partial differential equations
Messenger, D. A., & Bortz, D. M. (2021) · Journal of Computational Physics · doi:10.1016/j.jcp.2021.110525 · Cited by 243
Sparse learning of stochastic dynamical equations
Boninsegna, L., Nüske, F., & Clementi, C. (2018) · The Journal of Chemical Physics · doi:10.1063/1.5018409 · Cited by 236
Sparse model selection via integral terms
Schaeffer, H., & McCalla, S. G. (2017) · Physical Review E · doi:10.1103/physreve.96.023302 · Cited by 225
From Theories to Queries: Active Learning in Practice
Settles, B. (2011) · Cited by 221
Giannakis, D., & Majda, A. J. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1118984109 · Cited by 205
Automated adaptive inference of phenomenological dynamical models
Daniels, B. C., & Nemenman, I. (2015) · Nature Communications · doi:10.1038/ncomms9133 · Cited by 194
PySINDy: A comprehensive Python package for robust sparse system identification
Kaptanoglu, A., de Silva, B., Fasel, U., Kaheman, K., Goldschmidt, A., Callaham, J., Delahunt, C., Nicolaou, Z., Champion, K., Loiseau, J.-C., et al. (2022) · Journal of Open Source Software · doi:10.21105/joss.03994 · Cited by 191
Self-citationSparsifying priors for Bayesian uncertainty quantification in model discovery
Hirsh, S. M., Barajas‐Solano, D. A., & Kutz, J. N. (2022) · Royal Society Open Science · doi:10.1098/rsos.211823 · Cited by 186
Self-citationA Unified Sparse Optimization Framework to Learn Parsimonious Physics-Informed Models From Data
Champion, K., Zheng, P., Aravkin, A. Y., Brunton, S. L., & Kutz, J. N. (2020) · IEEE Access · doi:10.1109/access.2020.3023625 · Cited by 184
Self-citationModel-Based Active ExplorationPreprint
Shyam, P., Jaśkowski, W., & Gomez, F. J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.12162 · Cited by 174
Boosting a weak learning algorithm by majority
Freund, Y. (1990) · Colt Proceedings 1990 · doi:10.1016/b978-1-55860-146-8.50019-9 · Cited by 163
Weak SINDy: Galerkin-Based Data-Driven Model Selection
Messenger, D. A., & Bortz, D. M. (2021) · Multiscale Modeling and Simulation · doi:10.1137/20m1343166 · Cited by 162
Active Learning From Stream Data Using Optimal Weight Classifier Ensemble
Zhu, X., Zhang, P., Lin, X. S., & Shi, Y. (2010) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2010.2042445 · Cited by 154
Promoting global stability in data-driven models of quadratic nonlinear dynamics
Kaptanoglu, A. A., Callaham, J., Aravkin, A. Y., Hansen, C. J., & Brunton, S. L. (2021) · Physical Review Fluids · doi:10.1103/physrevfluids.6.094401 · Cited by 145
Self-citationAutomated refinement and inference of analytical models for metabolic networks
Schmidt, M. D., Vallabhajosyula, R. R., Jenkins, J. W., Hood, J. E., Soni, A. S., Wikswo, J. P., & Lipson, H. (2011) · Physical Biology · doi:10.1088/1478-3975/8/5/055011 · Cited by 144
Normal forms for reduced stochastic climate models
Majda, A. J., Franzke, C. L. E., & Crommelin, D. T. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0900173106 · Cited by 135
Sparse identification for nonlinear optical communication systems: SINO method
Sorokina, M. A., Sygletos, S., & Turitsyn, S. K. (2016) · Optics Express · doi:10.1364/oe.24.030433 · Cited by 132
Kaptanoglu, A. A., Morgan, K., Hansen, C. J., & Brunton, S. L. (2021) · Physical review. E · doi:10.1103/physreve.104.015206 · Cited by 131
Self-citationReinbold, P. A. K., Kageorge, L. M., Schatz, M. F., & Grigoriev, R. O. (2021) · Nature Communications · doi:10.1038/s41467-021-23479-0 · Cited by 129
Using noisy or incomplete data to discover models of spatiotemporal dynamics
Reinbold, P. A. K., Gurevich, D. R., & Grigoriev, R. O. (2020) · Physical review. E · doi:10.1103/physreve.101.010203 · Cited by 127
Sparse identification of a predator-prey system from simulation data of a convection model
Dam, M., Brøns, M., Rasmussen, J. J., Naulin, V., & Hesthaven, J. S. (2017) · Physics of Plasmas · doi:10.1063/1.4977057 · Cited by 121
Formulating turbulence closures using sparse regression with embedded form invariance
Beetham, S., & Capecelatro, J. (2020) · Physical Review Fluids · doi:10.1103/physrevfluids.5.084611 · Cited by 97
Active Learning for Nonlinear System Identification with GuaranteesPreprint
Mania, H., Jordan, M. I., & Recht, B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.10277 · Cited by 96
Daniels, B. C., & Nemenman, I. M. (2015) · PLoS ONE · doi:10.1371/journal.pone.0119821 · Cited by 95
Reinbold, P. A. K., Kageorge, L., Schatz, M. F., & Grigoriev, R. O. (2021) · RePEc: Research Papers in Economics · Cited by 95
Nonlinear stochastic modelling with Langevin regression
Callaham, J., Loiseau, J.-C., Rigas, G., & Brunton, S. L. (2021) · Proceedings of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rspa.2021.0092 · Cited by 92
Self-citationGottwald, G. A., & Reich, S. (2021) · Physica D Nonlinear Phenomena · doi:10.1016/j.physd.2021.132911 · Cited by 91
Sashidhar, D., & Kutz, J. N. (2022) · Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rsta.2021.0199 · Cited by 89
Self-citationMultidimensional Approximation of Nonlinear Dynamical Systems
Gelß, P., Klus, S., Eisert, J., & Schütte, C. (2019) · Journal of Computational and Nonlinear Dynamics · doi:10.1115/1.4043148 · Cited by 79
Data-driven discovery of reduced plasma physics models from fully kinetic simulations
Alves, E. P., & Fiúza, F. (2022) · Physical Review Research · doi:10.1103/physrevresearch.4.033192 · Cited by 75
Gottwald, G. A., & Reich, S. (2021) · Chaos An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/5.0066080 · Cited by 71
Sparse nonlinear models of chaotic electroconvection
Guan, Y., Brunton, S. L., & Novosselov, I. V. (2021) · Royal Society Open Science · doi:10.1098/rsos.202367 · Cited by 66
Self-citationReconstruction of normal forms by learning informed observation geometries from data
Yair, O., Talmon, R., Coifman, R. R., & Kevrekidis, I. G. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1620045114 · Cited by 61
Robust and optimal sparse regression for nonlinear PDE models
Gurevich, D. R., Reinbold, P. A. K., & Grigoriev, R. O. (2019) · Chaos An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.5120861 · Cited by 61
Data-driven modeling of the chaotic thermal convection in an annular thermosyphon
Loiseau, J.-C. (2020) · Theoretical and Computational Fluid Dynamics · doi:10.1007/s00162-020-00536-w · Cited by 56
Bagging, Subagging and Bragging for Improving some Prediction Algorithms
Bühlmann, P. (2003) · Elsevier eBooks · doi:10.1016/b978-044451378-6/50002-8 · Cited by 47
Bayesian system ID: optimal management of parameter, model, and measurement uncertainty
Galioto, N., & Gorodetsky, A. (2020) · Nonlinear Dynamics · doi:10.1007/s11071-020-05925-8 · Cited by 43
A Toolkit for Data-Driven Discovery of Governing Equations in High-Noise Regimes
Delahunt, C. B., & Kutz, J. N. (2022) · IEEE Access · doi:10.1109/access.2022.3159335 · Cited by 40
Self-citationAn empirical mean-field model of symmetry-breaking in a turbulent wake
Callaham, J., Rigas, G., Loiseau, J.-C., & Brunton, S. L. (2022) · Science Advances · doi:10.1126/sciadv.abm4786 · Cited by 39
Self-citationSparse identification of truncation errors
Thaler, S., Paehler, L., & Adams, N. A. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.07.049 · Cited by 31
Learning Equations from Biological Data with Limited Time Samples
Nardini, J. T., Lagergren, J. H., Hawkins-Daarud, A. J., et al. (2020) · Bulletin of Mathematical Biology · doi:10.1007/s11538-020-00794-z · Cited by 31
PySINDy: A Python package for the Sparse Identification of Nonlinear Dynamics from Data
de Silva, B. M., Champion, K. P., Quade, M., Loiseau, J.-C., Kutz, J. N., & Brunton, S. L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.08424 · Cited by 30
Self-citationGurevich, D. R., Golden, M. R., Reinbold, P. A. K., & Grigoriev, R. O. (2024) · Journal of Fluid Mechanics · doi:10.1017/jfm.2024.813 · Cited by 19
Maddu, S., Cheeseman, B. L., Sbalzarini, I. F., & Müller, C. L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.07810 · Cited by 15
Cited by
Cheng, S., Quilodrán-Casas, C., Ouala, S., Farchi, A., Liu, C., Tandeo, P., Fablet, R., Lucor, D., Iooss, B., Brajard, J., et al. (2023) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2023.123537 · Cited by 303
Metadata
- Authors
- Fasel, U., Kutz, J. N., Brunton, B. W., & Brunton, S. L.
- Venue
- Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences
- Publisher
- The Royal Society
- Published
- 2022-04
- Volume
- 478
- Issue
- 2260
- Pages
- 20210904-20210904
- ISSN
- 1364-5021 (ISSN-L)
- 1471-2946
- OpenAlex
- W3215447930
- Cited by
- 294
- References
- 83
- FWCI
- 22.70
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.