The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Data-driven forecasting of high-dimensional chaotic systems with long short-term memory networks
Open accessAbstract
We introduce a data-driven forecasting method for high-dimensional chaotic systems using long short-term memory (LSTM) recurrent neural networks. The proposed LSTM neural networks perform inference of high-dimensional dynamical systems in their reduced order space and are shown to be an effective set of nonlinear approximators of their attractor. We demonstrate the forecasting performance of the LSTM and compare it with Gaussian processes (GPs) in time series obtained from the Lorenz 96 system, the Kuramoto–Sivashinsky equation and a prototype climate model. The LSTM networks outperform the GPs in short-term forecasting accuracy in all applications considered. A hybrid architecture, extending the LSTM with a mean stochastic model (MSM–LSTM), is proposed to ensure convergence to the invariant measure. This novel hybrid method is fully data-driven and extends the forecasting capabilities of LSTM networks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Detecting strange attractors in turbulence
Takens, F. (1981) · Lecture Notes in Mathematics · doi:10.1007/bfb0091924 · Cited by 10,459 · cited 1×
“Inspired by Taken’s theorem [46] an embedding space is constructed using time-delayed versions of the reduced order variable.”
MethodSpeech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893
Learning long-term dependencies with gradient descent is difficult
Bengio, Y., Simard, P., & Frasconi, P. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279181 · Cited by 8,542
New extension of the Kalman filter to nonlinear systems
Julier, S. J., & Uhlmann, J. K. (1997) · SPIE Proceedings · doi:10.1117/12.280797 · Cited by 5,331
Discovering governing equations from data by sparse identification of nonlinear dynamical systems
Brunton, S. L., Proctor, J. L., & Kutz, J. N. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1517384113 · Cited by 4,796
Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication
Jaeger, H., & Haas, H. (2004) · Science · doi:10.1126/science.1091277 · Cited by 3,811
Annular Modes in the Extratropical Circulation. Part I: Month-to-Month Variability*
Thompson, D. W. J., & Wallace, J. M. (2000) · Journal of Climate · doi:10.1175/1520-0442(2000)013<1000:amitec>2.0.co;2 · Cited by 3,403
A Data–Driven Approximation of the Koopman Operator: Extending Dynamic Mode Decomposition
Williams, M. O., Kevrekidis, I. G., & Rowley, C. W. (2015) · Journal of Nonlinear Science · doi:10.1007/s00332-015-9258-5 · Cited by 1,945
Nonlinear analysis of hydrodynamic instability in laminar flames—I. Derivation of basic equations
Sivashinsky, G. I. (1977) · Acta Astronautica · doi:10.1016/0094-5765(77)90096-0 · Cited by 1,551
On dynamic mode decomposition: Theory and applications
Tu, J. H., Rowley, C. W., Luchtenburg, D. M., Brunton, S. L., & Kutz, J. N. (2014) · Journal of Computational Dynamics · doi:10.3934/jcd.2014.1.391 · Cited by 1,528
Pathak, J., Hunt, B., Girvan, M., Lu, Z., & Ott, E. (2018) · Physical Review Letters · doi:10.1103/physrevlett.120.024102 · Cited by 1,303
Atmospheric Predictability as Revealed by Naturally Occurring Analogues
Lorenz, E. N. (1969) · Journal of the Atmospheric Sciences · doi:10.1175/1520-0469(1969)26<636:aparbn>2.0.co;2 · Cited by 1,076
Persistent Propagation of Concentration Waves in Dissipative Media Far from Thermal Equilibrium
Kuramoto, Y., & Tsuzuki, T. (1976) · Progress of Theoretical Physics · doi:10.1143/ptp.55.356 · Cited by 1,032
Kerschen, G., Golinval, J.-C., VAKAKIS, A. F., & BERGMAN, L. A. (2005) · Nonlinear Dynamics · doi:10.1007/s11071-005-2803-2 · Cited by 925
MODEL REDUCTION FOR FLUIDS, USING BALANCED PROPER ORTHOGONAL DECOMPOSITION
ROWLEY, C. W. (2005) · International Journal of Bifurcation and Chaos · doi:10.1142/s0218127405012429 · Cited by 909
Automated reverse engineering of nonlinear dynamical systems
Bongard, J., & Lipson, H. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0609476104 · Cited by 792
Using machine learning to replicate chaotic attractors and calculate Lyapunov exponents from data
Pathak, J., Lu, Z., Hunt, B. R., Girvan, M., & Ott, E. (2017) · Chaos: An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.5010300 · Cited by 620
Diffusion-Induced Chaos in Reaction Systems
Kuramoto, Y. (1978) · Progress of Theoretical Physics Supplement · doi:10.1143/ptps.64.346 · Cited by 610
Arbabi, H., & Mezić, I. (2017) · SIAM Journal on Applied Dynamical Systems · doi:10.1137/17m1125236 · Cited by 476
Multiresolution Dynamic Mode Decomposition
Kutz, J. N., Fu, X., & Brunton, S. L. (2016) · SIAM Journal on Applied Dynamical Systems · doi:10.1137/15m1023543 · Cited by 442
Learning partial differential equations via data discovery and sparse optimization
Schaeffer, H. (2017) · Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rspa.2016.0446 · Cited by 432
Neural Network Modeling for Near Wall Turbulent Flow
Milano, M., & Koumoutsakos, P. (2002) · Journal of Computational Physics · doi:10.1006/jcph.2002.7146 · Cited by 428
Self-citationRobust extended Kalman filtering
Einicke, G. A., & White, L. B. (1999) · IEEE Transactions on Signal Processing · doi:10.1109/78.782219 · Cited by 405
Applying LSTM to Time Series Predictable through Time-Window Approaches
Gers, F. A., Eck, D., & Schmidhuber, J. (2001) · Lecture Notes in Computer Science · doi:10.1007/3-540-44668-0_93 · Cited by 334
Filtering Complex Turbulent Systems
Majda, A. J., & Harlim, J. (2012) · Cambridge University Press eBooks · doi:10.1017/cbo9781139061308 · Cited by 226
Information Theory and Stochastics for Multiscale Nonlinear Systems
Majda, A., Abramov, R., & Grote, M. (2005) · CRM Monograph Series · doi:10.1090/crmm/025 · Cited by 195
Prediction of dynamical systems by symbolic regression
Quade, M., Abel, M., Shafi, K., Niven, R. K., & Noack, B. R. (2016) · Physical review. E · doi:10.1103/physreve.94.012214 · Cited by 153
DISCRETE- vs. CONTINUOUS-TIME NONLINEAR SIGNAL PROCESSING OF Cu ELECTRODISSOLUTION DATA
RICO-MARTÍNEZ, R., KRISCHER, K., KEVREKIDIS, I. G., KUBE, M. C., & HUDSON, J. L. (1992) · Chemical Engineering Communications · doi:10.1080/00986449208936084 · Cited by 144
Strategies for Model Reduction: Comparing Different Optimal Bases
Crommelin, D. T., & Majda, A. J. (2004) · Journal of the Atmospheric Sciences · doi:10.1175/1520-0469(2004)061<2206:sfmrcd>2.0.co;2 · Cited by 133
Singular spectrum analysis and forecasting of hydrological time series
Marques, C. A. F., Ferreira, J. A., Rocha, A. C., et al. (2006) · Physics and Chemistry of the Earth Parts A/B/C · doi:10.1016/j.pce.2006.02.061 · Cited by 119
Chatzis, S., & Demiris, Y. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2011.2162109 · Cited by 114
Reduced-order precursors of rare events in unidirectional nonlinear water waves
Cousins, W., & Sapsis, T. P. (2016) · Journal of Fluid Mechanics · doi:10.1017/jfm.2016.13 · Cited by 94
Self-citationModel identification of a spatiotemporally varying catalytic reaction
Krischer, K., Rico-Martı́nez, R., Kevrekidis, I. G., Rotermund, H. H., Ertl, G., & Hudson, J. L. (1993) · AIChE Journal · doi:10.1002/aic.690390110 · Cited by 93
Analog forecasting with dynamics-adapted kernels
Zhao, Z., & Giannakis, D. (2016) · Nonlinearity · doi:10.1088/0951-7715/29/9/2888 · Cited by 81
An Efficient Description of the Dynamics of Barotropic Flow
Selten, F. (1995) · Journal of the Atmospheric Sciences · Cited by 70
Combined Model Based on EMD-SVM for Short-term Wind Power Prediction
Liu, P. (2011) · Proceedings of the CSEE · Cited by 67
Quantification and prediction of extreme events in a one-dimensional nonlinear dispersive wave model
Cousins, W., & Sapsis, T. P. (2014) · Physica D Nonlinear Phenomena · doi:10.1016/j.physd.2014.04.012 · Cited by 66
Self-citationDynamical indicators for the prediction of bursting phenomena in high-dimensional systems
Farazmand, M., & Sapsis, T. P. (2016) · Physical review. E · doi:10.1103/physreve.94.032212 · Cited by 59
Self-citationConceptual dynamical models for turbulence
Majda, A. J., & Lee, Y. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1404914111 · Cited by 58
Reduced Models in Chemical Kinetics via Nonlinear Data-Mining
Chiavazzo, E., Gear, C. W., Dsilva, C. J., Rabin, N., & Kevrekidis, I. G. (2014) · Processes · doi:10.3390/pr2010112 · Cited by 57
Extracting the main patterns of natural time series for long-term neurofuzzy prediction
Gholipour, A., Lucas, C., Araabi, B. N., Mirmomeni, M., & Shafiee, M. (2006) · Neural Computing and Applications · doi:10.1007/s00521-006-0062-x · Cited by 54
Wan, Z. Y., & Sapsis, T. P. (2017) · Physica D Nonlinear Phenomena · doi:10.1016/j.physd.2016.12.005 · Cited by 50
Self-citationData-driven prediction strategies for low-frequency patterns of North Pacific climate variability
Comeau, D. S., Zhao, Z., Giannakis, D., & Majda, A. J. (2016) · Climate Dynamics · doi:10.1007/s00382-016-3177-5 · Cited by 30
State estimation and prediction using clustered particle filters
Lee, Y., & Majda, A. J. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1617398113 · Cited by 30
Tatsis, K., Dertimanis, V. K., Abdallah, I., & Chatzi, E. (2017) · Procedia Engineering · doi:10.1016/j.proeng.2017.09.285 · Cited by 25
Cited by
Machine Learning for Fluid Mechanics
Brunton, S. L., Noack, B. R., & Koumoutsakos, P. (2020) · Annual Review of Fluid Mechanics · doi:10.1146/annurev-fluid-010719-060214 · Cited by 3,063
Self-citationDigital twin: values, challenges and enablers from a modeling perspective
Rasheed, A., San, O., & Kvamsdal, T. (2020) · IEEE Access · doi:10.1109/access.2020.2970143 · Cited by 1,952
Data-driven discovery of coordinates and governing equations
Champion, K., Lusch, B., Kutz, J. N., & Brunton, S. L. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1906995116 · Cited by 909
Enhancing computational fluid dynamics with machine learning
Vinuesa, R., & Brunton, S. L. (2022) · Nature Computational Science · doi:10.1038/s43588-022-00264-7 · Cited by 596
Deep learning of vortex-induced vibrations
Raissi, M., Wang, Z., Triantafyllou, M. S., & Karniadakis, G. E. (2019) · Journal of Fluid Mechanics · doi:10.1017/jfm.2018.872 · Cited by 404
Metadata
- Authors
- Vlachas, P. R., Byeon, W., Wan, Z. Y., Sapsis, T. P., & Koumoutsakos, P.
- Venue
- Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences
- Publisher
- The Royal Society
- Published
- 2018-05
- Volume
- 474
- Issue
- 2213
- Pages
- 20170844
- ISSN
- 1364-5021 (ISSN-L)
- 1471-2946
- OpenAlex
- W2788403524
- Cited by
- 358
- References
- 46
- FWCI
- 16.45
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.