The DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.
Physically Interpretable Neural Networks for the Geosciences: Applications to Earth System Variability
Open accessAbstract
Neural networks have become increasingly prevalent within the geosciences, although a common limitation of their usage has been a lack of methods to interpret what the networks learn and how they make decisions. As such, neural networks have often been used within the geosciences to most accurately identify a desired output given a set of inputs, with the interpretation of what the network learns used as a secondary metric to ensure the network is making the right decision for the right reason. Neural network interpretation techniques have become more advanced in recent years, however, and we therefore propose that the ultimate objective of using a neural network can also be the interpretation of what the network has learned rather than the output itself. We show that the interpretation of neural networks can enable the discovery of scientifically meaningful connections within geoscientific data. In particular, we use two methods for neural network interpretation called backward optimization and layerwise relevance propagation, both of which project the decision pathways of a network back onto the original input dimensions. To the best of our knowledge, LRP has not yet been applied to geoscientific research, and we believe it has great potential in this area. We show how these interpretation techniques can be used to reliably infer scientifically meaningful information from neural networks by applying them to common climate patterns. These results suggest that combining interpretable neural networks with novel scientific hypotheses will open the door to many new avenues in neural network‐related geoscience research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Neural Networks: A Comprehensive Foundation
Haykin, S. (1998) · Cited by 30,070
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
Deep learning and process understanding for data-driven Earth system science
Reichstein, M., Camps-Valls, G., Stevens, B., Jung, M., Denzler, J., Carvalhais, N., & Prabhat (2019) · Nature · doi:10.1038/s41586-019-0912-1 · Cited by 5,673
Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370
An overview of gradient descent optimization algorithms
Ruder, S. (2016) · arXiv · doi:10.48550/arxiv.1609.04747 · Cited by 4,962
On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation
Bach, S., Binder, A., Montavon, G., Klauschen, F., Müller, K.-R., & Samek, W. (2015) · PLOS ONE · doi:10.1371/journal.pone.0130140 · Cited by 4,524
El Niño Modoki and its possible teleconnection
Ashok, K., Behera, S. K., Rao, S. A., Weng, H., & Yamagata, T. (2007) · Journal of Geophysical Research: Oceans · doi:10.1029/2006jc003798 · Cited by 2,721
Methods for interpreting and understanding deep neural networks
Montavon, G., Samek, W., & Müller, K.-R. (2018) · Digital Signal Processing · doi:10.1016/j.dsp.2017.10.011 · Cited by 2,665
Learning to forget: continual prediction with LSTM
Gers, F. A. (1999) · 9th International Conference on Artificial Neural Networks: ICANN '99 · doi:10.1049/cp:19991218 · Cited by 2,337
Explainable AI: Interpreting, Explaining and Visualizing Deep Learning
(2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-28954-6 · Cited by 1,377
Understanding Neural Networks Through Deep Visualization
Yosinski, J., Clune, J., Nguyen, A. M., Fuchs, T. J., & Lipson, H. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.06579 · Cited by 1,358
Explaining nonlinear classification decisions with deep taylor decomposition
Montavon, G., Lapuschkin, S., Binder, A., Samek, W., & Müller, K.-R. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2016.11.008 · Cited by 1,357
Ropelewski, C. F., & Halpert, M. S. (1986) · Monthly Weather Review · doi:10.1175/1520-0493(1986)114<2352:napatp>2.0.co;2 · Cited by 1,331
Deep learning for multi-year ENSO forecasts
Ham, Y.-G., Kim, J.-H., & Luo, J.-J. (2019) · Nature · doi:10.1038/s41586-019-1559-7 · Cited by 1,261
Machine learning for data-driven discovery in solid Earth geoscience
Bergen, K. J., Johnson, P. A., de Hoop, M. V., & Beroza, G. C. (2019) · Science · doi:10.1126/science.aau0323 · Cited by 1,249
Unmasking Clever Hans predictors and assessing what machines really learn
Lapuschkin, S., Wäldchen, S., Binder, A., Montavon, G., Samek, W., & Müller, K.-R. (2019) · Nature Communications · doi:10.1038/s41467-019-08987-4 · Cited by 1,047
Deep learning to represent subgrid processes in climate models
Rasp, S., Pritchard, M. S., & Gentine, P. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1810286115 · Cited by 1,044
Meteorological Aspects of the El Niño/Southern Oscillation
Rasmusson, E. M., & Wallace, J. M. (1983) · Science · doi:10.1126/science.222.4629.1195 · Cited by 920
Olah, C., Mordvintsev, A., & Schubert, L. (2017) · Distill · doi:10.23915/distill.00007 · Cited by 880
A method for unconstrained convex minimization problem with the rate of convergence o(1/k^2)
Nesterov, Y. E. (1983) · Medical Entomology and Zoology · Cited by 865
Increasing intensity of El Niño in the central‐equatorial Pacific
Lee, T., & McPhaden, M. J. (2010) · Geophysical Research Letters · doi:10.1029/2010gl044007 · Cited by 767
El Niño Southern Oscillation phenomena
Philander, S. G. H. (1983) · Nature · doi:10.1038/302295a0 · Cited by 701
Machine Learning for the Geosciences: Challenges and Opportunities
Karpatne, A., Ebert-Uphoff, I., Ravela, S., Babaie, H. A., & Kumar, V. (2019) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2018.2861006 · Cited by 661
Self-citationCentennial-Scale Sea Surface Temperature Analysis and Its Uncertainty
Hirahara, S., Ishii, M., & Fukuda, Y. (2014) · Journal of Climate · doi:10.1175/jcli-d-12-00837.1 · Cited by 653
A New Estimate of the Average Earth Surface Land Temperature Spanning 1753 to 2011
A. Muller, R., Rohde, R., Jacobsen, R., Muller, E., & Wickham, C. (2013) · Geoinformatics & Geostatistics: An Overview · doi:10.4172/2327-4581.1000101 · Cited by 593
Unmasking Clever Hans predictors and assessing what machines really learn
Lapuschkin, S., Wäldchen, S., Binder, A., Montavon, G., Samek, W., & Müller, K. (2019) · RePEc: Research Papers in Economics · Cited by 580
Making the Black Box More Transparent: Understanding the Physical Implications of Machine Learning
McGovern, A., Lagerquist, R., John Gagne, D., Jergensen, G. E., Elmore, K. L., Homeyer, C. R., & Smith, T. (2019) · Bulletin of the American Meteorological Society · doi:10.1175/bams-d-18-0195.1 · Cited by 558
Feng, X., Li, Q., Zhu, Y., Hou, J., Jin, L., & Wang, J. (2015) · Atmospheric Environment · doi:10.1016/j.atmosenv.2015.02.030 · Cited by 556
Seasonal climate predictability and forecasting: status and prospects
Doblas‐Reyes, F. J., García‐Serrano, J., Lienert, F., Biescas, A. P., & Rodrigues, L. R. L. (2013) · WIREs Climate Change · doi:10.1002/wcc.217 · Cited by 478
Using Artificial Intelligence to Improve Real-Time Decision-Making for High-Impact Weather
McGovern, A., Elmore, K. L., Gagne, D. J., Haupt, S. E., Karstens, C. D., Lagerquist, R., Smith, T., & Williams, J. K. (2017) · Bulletin of the American Meteorological Society · doi:10.1175/bams-d-16-0123.1 · Cited by 443
Applications of Deep Learning to Ocean Data Inference and Subgrid Parameterization
Bolton, T., & Zanna, L. (2019) · Journal of Advances in Modeling Earth Systems · doi:10.1029/2018ms001472 · Cited by 399
A Neural Network Approach for a Fast and Accurate Computation of a Longwave Radiative Budget
Chevallier, F., Chéruy, F., Scott, N. A., & Chédin, A. (1998) · Journal of Applied Meteorology · doi:10.1175/1520-0450(1998)037<1385:annafa>2.0.co;2 · Cited by 362
Prognostic Validation of a Neural Network Unified Physics Parameterization
Brenowitz, N. D., & Bretherton, C. S. (2018) · Geophysical Research Letters · doi:10.1029/2018gl078510 · Cited by 352
Tackling climate change with machine learning
Rolnick, D., Donti, P. L., Kaack, L. H., Kochanski, K., Lacoste, A., Sankaran, K., Ross, A. S., Milojevic-Dupont, N., Jaques, N., Waldman-Brown, A., et al. (2023) · ACM Computing Surveys · doi:10.1145/3485128 · Cited by 336
Analysis of the non-linearity in the pattern and time evolution of El Niño southern oscillation
Dommenget, D., Bayr, T., & Frauen, C. (2013) · Climate Dynamics · doi:10.1007/s00382-012-1475-0 · Cited by 252
Spatially Extended Tests of a Neural Network Parametrization Trained by Coarse‐Graining
Brenowitz, N. D., & Bretherton, C. S. (2019) · Journal of Advances in Modeling Earth Systems · doi:10.1029/2019ms001711 · Cited by 231
Interpretable Deep Learning for Spatial Analysis of Severe Hailstorms
Gagne II, D. J., Haupt, S. E., Nychka, D. W., & Thompson, G. (2019) · Monthly Weather Review · doi:10.1175/mwr-d-18-0316.1 · Cited by 215
Krasnopolsky, V. M., Fox-Rabinovitz, M. S., & Chalikov, D. V. (2005) · Monthly Weather Review · doi:10.1175/mwr2923.1 · Cited by 197
Machine intelligence and the data-driven future of marine science
Malde, K., Handegard, N. O., Eikvil, L., & Salberg, A.-B. (2020) · ICES Journal of Marine Science · doi:10.1093/icesjms/fsz057 · Cited by 187
Viewing forced climate patterns through an AI Lens
Barnes, E. A., Hurrell, J. W., Ebert‐Uphoff, I., Anderson, C., & Anderson, D. (2019) · Geophysical Research Letters · doi:10.1029/2019gl084944 · Cited by 179
Self-citationClimate predictability on interannual to decadal time scales: the initial value problem
M., C. (2002) · Climate Dynamics · doi:10.1007/s00382-002-0254-8 · Cited by 174
Different impacts of various El Niño events on the Indian Ocean Dipole
Wang, X., & Wang, C. (2013) · Climate Dynamics · doi:10.1007/s00382-013-1711-2 · Cited by 162
Is Climate Variability over the North Pacific a Linear Response to ENSO?
Zhang, Y., Wallace, J. M., & Iwasaka, N. (1996) · Journal of Climate · Cited by 157
Gershunov, A. (1998) · Journal of Climate · doi:10.1175/1520-0442(1998)011<3192:eioier>2.0.co;2 · Cited by 155
Long-lead predictions of eastern United States hot days from Pacific sea surface temperatures
McKinnon, K. A., Rhines, A. N., Tingley, M. P., & Huybers, P. (2016) · Nature Geoscience · doi:10.1038/ngeo2687 · Cited by 134
Deep Learning for Spatially Explicit Prediction of Synoptic-Scale Fronts
Lagerquist, R., McGovern, A., & Gagne, D. J. (2019) · Weather and Forecasting · doi:10.1175/waf-d-18-0183.1 · Cited by 133
Intelligent systems for geosciences: an essential research agenda
Gil, Y., Pierce, S. A., Babaie, H. A., Banerjee, A., Borne, K. D., Bust, G. S., Cheatham, M., Ebert‐Uphoff, I., Gomes, C. P., Hill, M. C., et al. (2018) · Communications of the ACM · doi:10.1145/3192335 · Cited by 125
Self-citationDunstone, N., Smith, D. M., & Eade, R. (2011) · Geophysical Research Letters · doi:10.1029/2011gl047949 · Cited by 119
Explaining and Interpreting LSTMs
Arras, L., Arjona-Medina, J., Widrich, M., Montavon, G., Gillhofer, M., Müller, K.-R., Hochreiter, S., & Samek, W. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-28954-6_11 · Cited by 111
Toward Interpretable Machine Learning: Transparent Deep Neural Networks and BeyondPreprint
Samek, W., Montavon, G., Lapuschkin, S., Anders, C. J., & Müller, K. (2020) · arXiv (Cornell University) · Cited by 70
Predictability of US West Coast Ocean Temperatures is not solely due to ENSO
Capotondi, A. M., Sardeshmukh, P. D., Lorenzo, E. D., Subramanian, A. C., & Miller, A. J. (2019) · Scientific Reports · doi:10.1038/s41598-019-47400-4 · Cited by 61
Prognostic validation of a neural network unified physics parameterizationPreprint
Brenowitz, N., & Bretherton, C. S. (2018) · doi:10.31223/osf.io/eu3ax · Cited by 60
Understanding Deep Neural Networks for Regression in Leaf Counting
Dobrescu, A., Giuffrida, M. V., & Tsaftaris, S. A. (2019) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00316 · Cited by 45
Toms, B. A., Kashinath, K., Prabhat, & Yang, D. (2019) · arXiv (Cornell University) · Cited by 10
Self-citation(2001) · doi:10.1175/1520-0442(2001)013<0219:npcati>2.0.co;2
Cited by
Artificial intelligence: A powerful paradigm for scientific research
Xu, Y., Liu, X., Cao, X., Huang, C., Liu, E., Qian, S., Liu, X., Wu, Y., Dong, F., Qiu, C.-W., et al. (2021) · The Innovation · doi:10.1016/j.xinn.2021.100179 · Cited by 1,726
WeatherBench: A Benchmark Data Set for Data‐Driven Weather Forecasting
Rasp, S., Dueben, P. D., Scher, S., Weyn, J. A., Mouatadid, S., & Thuerey, N. (2020) · Journal of Advances in Modeling Earth Systems · doi:10.1029/2020ms002203 · Cited by 663
Physics-informed machine learning: case studies for weather and climate modelling
Kashinath, K., Mustafa, M., Albert, A., Wu, J.-L., Jiang, C., Esmaeilzadeh, S., Azizzadenesheli, K., Wang, R., Chattopadhyay, A., Singh, A., et al. (2021) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2020.0093 · Cited by 662
Differentiable modelling to unify machine learning and physical models for geosciences
Shen, C., Appling, A. P., Gentine, P., Bandai, T., Gupta, H., Tartakovsky, A., Baity-Jesi, M., Fenicia, F., Kifer, D., Li, L., et al. (2023) · Nature Reviews Earth & Environment · doi:10.1038/s43017-023-00450-9 · Cited by 468
Tackling climate change with machine learning
Rolnick, D., Donti, P. L., Kaack, L. H., Kochanski, K., Lacoste, A., Sankaran, K., Ross, A. S., Milojevic-Dupont, N., Jaques, N., Waldman-Brown, A., et al. (2023) · ACM Computing Surveys · doi:10.1145/3485128 · Cited by 336
Metadata
- Authors
- Toms, B. A., Barnes, E. A., & Ebert‐Uphoff, I.
- Venue
- Journal of Advances in Modeling Earth Systems
- Publisher
- American Geophysical Union (AGU)
- Published
- 2020-08-27
- Volume
- 12
- Issue
- 9
- ISSN
- 1942-2466 (ISSN-L)
- OpenAlex
- W2993514765
- Cited by
- 311
- References
- 57
- FWCI
- 17.43
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.