Bridging observations, theory and numerical simulation of the ocean using machine learning
Open accessThe DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
Progress within physical oceanography has been concurrent with the increasing sophistication of tools available for its study. The incorporation of machine learning (ML) techniques offers exciting possibilities for advancing the capacity and speed of established methods and for making substantial and serendipitous discoveries. Beyond vast amounts of complex data ubiquitous in many modern scientific fields, the study of the ocean poses a combination of unique challenges that ML can help address. The observational data available is largely spatially sparse, limited to the surface, and with few time series spanning more than a handful of decades. Important timescales span seconds to millennia, with strong scale interactions and numerical modelling efforts complicated by details such as coastlines. This review covers the current scientific insight offered by applying ML and points to where there is imminent potential. We cover the main three branches of the field: observations, theory, and numerical modelling. Highlighting both challenges and opportunities, we discuss both the historical context and salient ML tools. We focus on the use of ML in situ sampling and satellite observations, and the extent to which ML applications can advance theoretical oceanographic exploration, as well as aid numerical simulations. Applications that are also covered include model error and bias correction and current and potential use within data assimilation. While not without risk, there is great interest in the potential benefits of oceanographic ML applications; this review caters to this interest within the research community.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421 · cited 1×
“• Support vector machines (SVM) [61], where the classification is done by finding a linear separating hyperplane with the maximal margin between two classes (the term ‘margin’ here denotes the space between the hyperplane and the nearest points in either class.)”
A Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
Approximation by superpositions of a sigmoidal function
Cybenko, G. (1989) · Mathematics of Control, Signals, and Systems · doi:10.1007/bf02551274 · Cited by 13,883
Rudin, C. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0048-x · Cited by 10,561 · cited 2×
“This is facilitated by either building a priori interpretable ML applications or by retrospectively explaining the source of predictive skill, coined interpretable and explain-able artificial intelligence (IAI and XAI, respectively [26, 134, 214, 228]).”
Self-organized formation of topologically correct feature maps
Kohonen, T. (1982) · Biological Cybernetics · doi:10.1007/bf00337288 · Cited by 9,529
Mastering the game of Go without human knowledge
Silver, D., Schrittwieser, J., Simonyan, K., Antonoglou, I., Huang, A., Guez, A., Hubert, T., Baker, L., Lai, M., Bolton, A., et al. (2017) · Nature · doi:10.1038/nature24270 · Cited by 9,084
Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting
Shi, X., Chen, Z., Wang, H., Yeung, D.-Y., Wong, W.-K., & Woo, W.-C. (2015) · arXiv · doi:10.48550/arxiv.1506.04214 · Cited by 7,709
UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
McInnes, L., Healy, J., & Melville, J. (2018) · arXiv · doi:10.48550/arxiv.1802.03426 · Cited by 7,101
“Why Should I Trust You?”: Explaining the Predictions of Any Classifier
Ribeiro, M., Singh, S., & Guestrin, C. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Demonstrations · doi:10.18653/v1/n16-3020 · Cited by 6,682
Deep learning and process understanding for data-driven Earth system science
Reichstein, M., Camps-Valls, G., Stevens, B., Jung, M., Denzler, J., Carvalhais, N., & Prabhat (2019) · Nature · doi:10.1038/s41586-019-0912-1 · Cited by 5,673 · cited 2×
“These issues are ubiquitous and not unique to oceanography or to Earth science, with a call for ‘physics informed’ ML [207].”
Evensen, G. (1994) · Journal of Geophysical Research: Oceans · doi:10.1029/94jc00572 · Cited by 5,371 · cited 2×
“[89] Evensen G 1994 Sequential data assimilation with a”
Discovering governing equations from data by sparse identification of nonlinear dynamical systems
Brunton, S. L., Proctor, J. L., & Kutz, J. N. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1517384113 · Cited by 4,796
On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation
Bach, S., Binder, A., Montavon, G., Klauschen, F., Müller, K.-R., & Samek, W. (2015) · PLOS ONE · doi:10.1371/journal.pone.0130140 · Cited by 4,524 · cited 1×
“XAI methods such as lay-erwise relevance propagation (LRP [10, 193]) have been gaining traction within the atmosphere [16, 17, 40, 246], and ocean, but making their application explicitly appropriate to oceanography, and indeed the physical sciences in general, may require targeted method…”
Generalizing from a Few Examples: A Survey on Few-shot Learning
Wang, Y., Yao, Q., Kwok, J. T., & Ni, L. M. (2021) · ACM Computing Surveys · doi:10.1145/3386252 · Cited by 3,165
The quiet revolution of numerical weather prediction
Bauer, P., Thorpe, A., & Brunet, G. (2015) · Nature · doi:10.1038/nature14956 · Cited by 2,729 · cited 2×
“[22] Bauer P, Thorpe A and Brunet G 2015 The quiet revolution of numerical weather prediction Nature 525 47–55”
Methods for interpreting and understanding deep neural networks
Montavon, G., Samek, W., & Müller, K.-R. (2018) · Digital Signal Processing · doi:10.1016/j.dsp.2017.10.011 · Cited by 2,665
Shortcut learning in deep neural networks
Geirhos, R., Jacobsen, J.-H., Michaelis, C., Zemel, R., Brendel, W., Bethge, M., & Wichmann, F. A. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-00257-z · Cited by 2,224
Neural ordinary differential equations
Chen, R. T. Q., Rubanova, Y., Bettencourt, J., & Duvenaud, D. (2018) · arXiv · doi:10.48550/arxiv.1806.07366 · Cited by 2,097
Deep learning to represent subgrid processes in climate models
Rasp, S., Pritchard, M. S., & Gentine, P. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1810286115 · Cited by 1,044 · cited 2×
“This was done successfully in a number of studies [41, 206] for physical parametrization schemes of atmospheric models.”
Taking climate model evaluation to the next level
Eyring, V., Cox, P. M., Flato, G. M., Gleckler, P. J., Abramowitz, G., Caldwell, P., Collins, W. D., Gier, B. K., Hall, A. D., Hoffman, F. M., et al. (2019) · Nature Climate Change · doi:10.1038/s41558-018-0355-y · Cited by 748
WeatherBench: A Benchmark Data Set for Data‐Driven Weather Forecasting
Rasp, S., Dueben, P. D., Scher, S., Weyn, J. A., Mouatadid, S., & Thuerey, N. (2020) · Journal of Advances in Modeling Earth Systems · doi:10.1029/2020ms002203 · Cited by 663
Self-citationThe Art and Science of Climate Model Tuning
Hourdin, F., Mauritsen, T., Gettelman, A., Golaz, J.-C., Balaji, V., Duan, Q., Folini, D., Ji, D., Klocke, D., Qian, Y., et al. (2017) · Bulletin of the American Meteorological Society · doi:10.1175/bams-d-15-00135.1 · Cited by 611
Self-citationNumerical Methods for Fluid Dynamics
Durran, D. R. (2010) · Texts in Applied Mathematics · doi:10.1007/978-1-4419-6412-0 · Cited by 549
Could Machine Learning Break the Convection Parameterization Deadlock?
Gentine, P., Pritchard, M., Rasp, S., Reinaudi, G., & Yacalis, G. (2018) · Geophysical Research Letters · doi:10.1029/2018gl078202 · Cited by 497 · cited 2×
“Early results include the results of [105], using NNs to emulate a ‘super-parameterized’ model.”
Enforcing Analytic Constraints in Neural Networks Emulating Physical Systems
Beucler, T., Pritchard, M., Rasp, S., Ott, J., Baldi, P., & Gentine, P. (2021) · Physical Review Letters · doi:10.1103/physrevlett.126.098302 · Cited by 451
O'Gorman, P. A., & Dwyer, J. G. (2018) · Journal of Advances in Modeling Earth Systems · doi:10.1029/2018ms001351 · Cited by 419
Underspecification Presents Challenges for Credibility in Modern Machine Learning
D'Amour, A., Heller, K., Moldovan, D., Adlam, B., Alipanahi, B., Beutel, A., Chen, C., Deaton, J., Eisenstein, J., Hoffman, M. D., et al. (2020) · arXiv · doi:10.48550/arxiv.2011.03395 · Cited by 398 · cited 1×
“With a lack of good data coverage, the possible underspecification [67] and shortcut learning [103] are important to keep in mind, where a model can seemingly perform well for example in the current climate but will fail in a future scenario as something physical was not learned.”
Towards neural Earth system modelling by integrating artificial intelligence in Earth system science
Irrgang, C., Boers, N., Sonnewald, M., Barnes, E. A., Kadow, C., Staneva, J., & Saynisch-Wagner, J. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00374-3 · Cited by 308
Self-citationData‐Driven Equation Discovery of Ocean Mesoscale Closures
Zanna, L., & Bolton, T. (2020) · Geophysical Research Letters · doi:10.1029/2020gl088376 · Cited by 259 · cited 6×
“[269] proposes to use an equation discovery algorithm, namely Relevance Vector Machines (RVM), for ocean eddy parameterizations.”
InfluentialCouvreux, F., Hourdin, F., Williamson, D., Roehrig, R., Volodina, V., Villefranque, N., Rio, C., Audouin, O., Salter, J., Bazile, E., et al. (2021) · Journal of Advances in Modeling Earth Systems · doi:10.1029/2020ms002217 · Cited by 121 · cited 2×
“[63] Couvreux F et al 2020 Process-based climate model”
Hourdin, F., Williamson, D., Rio, C., Couvreux, F., Roehrig, R., Villefranque, N., Musat, I., Fairhead, L., Diallo, F. B., & Volodina, V. (2021) · Journal of Advances in Modeling Earth Systems · doi:10.1029/2020ms002225 · Cited by 83
Balaji, V. (2021) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2020.0085 · Cited by 57
Self-citationReconstructing Global Chlorophyll-a Variations Using a Non-linear Statistical Approach
Martinez, E., Gorgues, T., Lengaigne, M., Sauzède, R., Menkes, C., Uitz, J., Di Lorenzo, E., & Fablet, R. (2020) · Frontiers in Marine Science · doi:10.3389/fmars.2020.00464 · Cited by 43 · cited 2×
“More recently, ML algorithms have been used to fuse several satellite products [116] and also satellite and in-situ data [52, 70, 142, 170, 185].”
Cited by
Towards neural Earth system modelling by integrating artificial intelligence in Earth system science
Irrgang, C., Boers, N., Sonnewald, M., Barnes, E. A., Kadow, C., Staneva, J., & Saynisch-Wagner, J. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00374-3 · Cited by 308
Self-citationMachine learning for the physics of climate
Bracco, A., Brajard, J., Dijkstra, H. A., Hassanzadeh, P., Lessig, C., & Monteleoni, C. (2024) · Nature Reviews Physics · doi:10.1038/s42254-024-00776-3 · Cited by 79
Self-citationDueben, P. D., Schultz, M. G., Chantry, M., Gagne, D. J., Hall, D. M., & McGovern, A. (2022) · Artificial Intelligence for the Earth Systems · doi:10.1175/aies-d-21-0002.1 · Cited by 64
Self-citation
Metadata
- Authors
- Sonnewald, M., Lguensat, R., Jones, D. C., Dueben, P. D., Brajard, J., & Balaji, V
- Venue
- Environmental Research Letters
- Publisher
- IOP Publishing
- Published
- 2021-07-01
- Volume
- 16
- Issue
- 7
- Pages
- 073008
- ISSN
- 1748-9326 (ISSN-L)
- OpenAlex
- W3157139700
- Cited by
- 164
- References
- 35
- FWCI
- 13.05
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.