Combining data assimilation and machine learning to emulate a dynamical model from sparse and noisy observations: A case study with the Lorenz 96 model
Open accessThe DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
A novel method, based on the combination of data assimilation and machine learning is introduced. The new hybrid approach is designed for a two-fold scope: (i) emulating hidden, possibly chaotic, dynamics and (ii) predicting their future states. The method consists in applying iteratively a data assimilation step, here an ensemble Kalman filter, and a neural network. Data assimilation is used to optimally combine a surrogate model with sparse noisy data. The output analysis is spatially complete and is used as a training set by the neural network to update the surrogate model. The two steps are then repeated iteratively. Numerical experiments have been carried out using the chaotic 40-variables Lorenz 96 model, proving both convergence and statistical skill of the proposed hybrid approach. The surrogate model shows short-term forecast skill up to two Lyapunov times, the retrieval of positive Lyapunov exponents as well as the more energetic frequencies of the power density spectrum. The sensitivity of the method to critical setup parameters is also presented: the forecast skill decreases smoothly with increased observational noise but drops abruptly if less than half of the model domain is observed. The successful synergy between data assimilation and machine learning, proven here with a low-dimensional system, encourages further investigation of such hybrids with more sophisticated dynamics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Welch, P. (1967) · IEEE Transactions on Audio and Electroacoustics · doi:10.1109/tau.1967.1161901 · Cited by 12,277
Determining Lyapunov exponents from a time series
Wolf, A., Swift, J. B., Swinney, H. L., & Vastano, J. A. (1985) · Physica D: Nonlinear Phenomena · doi:10.1016/0167-2789(85)90011-9 · Cited by 9,499
Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting
Shi, X., Chen, Z., Wang, H., Yeung, D.-Y., Wong, W.-K., & Woo, W.-C. (2015) · arXiv · doi:10.48550/arxiv.1506.04214 · Cited by 7,709
Deep learning and process understanding for data-driven Earth system science
Reichstein, M., Camps-Valls, G., Stevens, B., Jung, M., Denzler, J., Carvalhais, N., & Prabhat (2019) · Nature · doi:10.1038/s41586-019-0912-1 · Cited by 5,673
The Ensemble Kalman Filter: theoretical formulation and practical implementation
Evensen, G. (2003) · Ocean Dynamics · doi:10.1007/s10236-003-0036-9 · Cited by 4,420
The EM Algorithm and Extensions, 2E
McLachlan, G. J., & Krishnan, T. (2008) · Wiley Series in Probability and Statistics · doi:10.1002/9780470191613 · Cited by 1,529
Pathak, J., Hunt, B., Girvan, M., Lu, Z., & Ott, E. (2018) · Physical Review Letters · doi:10.1103/physrevlett.120.024102 · Cited by 1,303
Data assimilation in the geosciences: An overview of methods, issues, and perspectives
Carrassi, A., Bocquet, M., Bertino, L., & Evensen, G. (2018) · WIREs Climate Change · doi:10.1002/wcc.535 · Cited by 867
Self-citationOptimal Sites for Supplementary Weather Observations: Simulation with a Small Model
Lorenz, E. N., & Emanuel, K. A. (1998) · Journal of the Atmospheric Sciences · doi:10.1175/1520-0469(1998)055<0399:osfswo>2.0.co;2 · Cited by 641
Using machine learning to replicate chaotic attractors and calculate Lyapunov exponents from data
Pathak, J., Lu, Z., Hunt, B. R., Girvan, M., & Ott, E. (2017) · Chaos: An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.5010300 · Cited by 620
Chaos as an intermittently forced linear system
Brunton, S. L., Brunton, B. W., Proctor, J. L., Kaiser, E., & Kutz, J. N. (2017) · Nature Communications · doi:10.1038/s41467-017-00030-8 · Cited by 608
A Proposal on Machine Learning via Dynamical Systems
E, W. (2017) · Communications in Mathematics and Statistics · doi:10.1007/s40304-017-0103-z · Cited by 607
Reservoir observers: Model-free inference of unmeasured variables in chaotic systems
Lu, Z., Pathak, J., Hunt, B., Girvan, M., Brockett, R., & Ott, E. (2017) · Chaos: An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.4979665 · Cited by 344
Accounting for an imperfect model in 4D‐Var
Trémolet, Y. (2006) · Quarterly Journal of the Royal Meteorological Society · doi:10.1256/qj.05.224 · Cited by 309
Earth observation satellite sensors for biodiversity monitoring: potentials and bottlenecks
Kuenzer, C., Ottinger, M., Wegmann, M., Guo, H., Wang, C., Zhang, J., Dech, S., & Wikelski, M. (2014) · International Journal of Remote Sensing · doi:10.1080/01431161.2014.964349 · Cited by 195
Robust data-driven discovery of governing physical laws with error bars
Zhang, S., & Lin, G. (2018) · Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rspa.2018.0305 · Cited by 162
Estimating Model Parameters with Ensemble-Based Data Assimilation: A Review
RUIZ, J. J., PULIDO, M., & MIYOSHI, T. (2013) · Journal of the Meteorological Society of Japan. Ser. II · doi:10.2151/jmsj.2013-201 · Cited by 145
Bocquet, M., Brajard, J., Carrassi, A., & Bertino, L. (2019) · Nonlinear processes in geophysics · doi:10.5194/npg-26-143-2019 · Cited by 117
Self-citationEnsemble Kalman filtering without the intrinsic need for inflation
Bocquet, M. (2011) · Nonlinear processes in geophysics · doi:10.5194/npg-18-735-2011 · Cited by 108
Self-citationMachine Learning: Deepest Learning as Statistical Data Assimilation Problems
Abarbanel, H. D. I., Rozdeba, P. J., & Shirman, S. (2018) · Neural Computation · doi:10.1162/neco_a_01094 · Cited by 85
Bocquet, M. (2011) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.961 · Cited by 83
Self-citationAdaptive covariance inflation in the ensemble Kalman filter by Gaussian scale mixtures
Raanes, P. N., Bocquet, M., & Carrassi, A. (2019) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.3386 · Cited by 76
Self-citationDegenerate Kalman Filter Error Covariances and Their Convergence onto the Unstable Subspace
Bocquet, M., Gurumoorthy, K. S., Apte, A., Carrassi, A., Grudzien, C., & Jones, C. K. R. T. (2017) · SIAM/ASA Journal on Uncertainty Quantification · doi:10.1137/16m1068712 · Cited by 71
Self-citationExpanding the validity of the ensemble Kalman filter without the intrinsic need for inflation
Bocquet, M., Raanes, P. N., & Hannart, A. (2015) · Nonlinear processes in geophysics · doi:10.5194/npg-22-645-2015 · Cited by 71
Self-citationPulido, M., Tandeo, P., Bocquet, M., Carrassi, A., & Lucini, M. (2018) · Tellus A Dynamic Meteorology and Oceanography · doi:10.1080/16000870.2018.1442099 · Cited by 70
Self-citationAn iterative ensemble Kalman filter in the presence of additive model error
Sakov, P., Haussaire, J., & Bocquet, M. (2017) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.3213 · Cited by 55
Self-citationCarrassi, A., & Vannitsem, S. (2011) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.762 · Cited by 45
Self-citationAn iterative ensemble Kalman filter in presence of additive model errorPreprint
Sakov, P., Haussaire, J., & Bocquet, M. (2017) · HAL · Cited by 42
Self-citationModel Error in Data Assimilation
Harlim, J. (2016) · Cambridge University Press eBooks · doi:10.1017/9781316339251.011 · Cited by 37
A Time Series Data Prediction Scheme Using Bilinear Recurrent Neural Network
Park, D.-C. (2010) · International Conference on Information Science and Applications · doi:10.1109/icisa.2010.5480383 · Cited by 35
Metref, S., Hannart, A., Ruiz, J. J., Bocquet, M., Carrassi, A., & Ghil, M. (2019) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.3513 · Cited by 22
Self-citation
Cited by
Towards neural Earth system modelling by integrating artificial intelligence in Earth system science
Irrgang, C., Boers, N., Sonnewald, M., Barnes, E. A., Kadow, C., Staneva, J., & Saynisch-Wagner, J. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00374-3 · Cited by 308
Cheng, S., Quilodrán-Casas, C., Ouala, S., Farchi, A., Liu, C., Tandeo, P., Fablet, R., Lucor, D., Iooss, B., Brajard, J., et al. (2023) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2023.123537 · Cited by 303
Self-citationLearning earth system models from observations: machine learning or data assimilation?
Geer, A. J. (2021) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2020.0089 · Cited by 229
Outlook for Exploiting Artificial Intelligence in the Earth and Environmental Sciences
Boukabara, S.-A., Krasnopolsky, V., Penny, S. G., Stewart, J. Q., McGovern, A., Hall, D., Ten Hoeve, J. E., Hickey, J., Allen Huang, H.-L., Williams, J. K., et al. (2021) · Bulletin of the American Meteorological Society · doi:10.1175/bams-d-20-0031.1 · Cited by 87
Dueben, P. D., Schultz, M. G., Chantry, M., Gagne, D. J., Hall, D. M., & McGovern, A. (2022) · Artificial Intelligence for the Earth Systems · doi:10.1175/aies-d-21-0002.1 · Cited by 64
Metadata
- Authors
- Brajard, J., Carrassi, A., Bocquet, M., & Bertino, L.
- Venue
- Journal of Computational Science
- Publisher
- Elsevier BV
- Published
- 2020-07
- Volume
- 44
- Pages
- 101171
- ISSN
- 1877-7503 (ISSN-L)
- OpenAlex
- W2998192345
- Cited by
- 249
- References
- 32
- FWCI
- 10.90
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.