Deep learning to represent subgrid processes in climate models
Open accessAbstract
The representation of nonlinear subgrid processes, especially clouds, has been a major source of uncertainty in climate models for decades. Cloud-resolving models better represent many of these processes and can now be run globally but only for short-term simulations of at most a few years because of computational limitations. Here we demonstrate that deep learning can be used to capture many advantages of cloud-resolving modeling at a fraction of the computational cost. We train a deep neural network to represent all atmospheric subgrid processes in a climate model by learning from a multiscale model in which convection is treated explicitly. The trained neural network then replaces the traditional subgrid parameterizations in a global general circulation model in which it freely interacts with the resolved dynamics and the surface-flux scheme. The prognostic multiyear simulations are stable and closely reproduce not only the mean climate of the cloud-resolving simulation but also key aspects of variability, including precipitation extremes and the equatorial wave spectrum. Furthermore, the neural network approximately conserves energy despite not being explicitly instructed to. Finally, we show that the neural network parameterization generalizes to new surface forcing patterns but struggles to cope with temperatures far outside its training manifold. Our results show the feasibility of using deep learning for climate model parameterization. In a broader context, we anticipate that data-driven Earth system model development could play a key role in reducing climate prediction uncertainty in the coming decade.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Methods based on various forms of artificial intelligence are already today being applied in a number of research fields related to climate change and environmental monitoring.
“Methods based on various forms of artificial intelligence are already today being applied in a number of research fields related to climate change and environmental monitoring.”
From Artificial intelligence, systemic risks, and sustainability (2021) · cites this paper as [25]
The Discussion demonstrates an existing deep-learning application in climate modeling and notes that random forests have also been applied to model subgrid convection. It does not document applications in environmental monitoring or establish that AI is already being applied across a number of climate-related research fields; it describes uses beyond the atmosphere as possibilities. (LLM, conf=0.85)
Experimental — accuracy not yet measuredSo far, hybrid models have mostly been limited to idealized scenarios such as aquaplanets.
“So far, hybrid models have mostly been limited to idealized scenarios such as aquaplanets22,23.”
From Neural general circulation models for weather and climate (2024) · cites this paper as [22]
Gentine et al. trained a deep neural network to emulate the behavior of a high-resolution cloud simulation, and found that the network gave similar results for a fraction of the cost and was stable in a simplified global model.
“Gentine et al. trained a deep neural network to emulate the behavior of a high-resolution cloud simulation, and found that the network gave similar results for a fraction of the cost [275] and was stable in a simplified global model [670].”
From Tackling climate change with machine learning (2023) · cites this paper as [670]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538 · see citing works
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · see citing works
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126 · see citing works
(2014) · Cited by 33,419 · see citing works
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate ShiftPreprint
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 15,273 · see citing works
(2016) · Cited by 11,679 · see citing works
The quiet revolution of numerical weather prediction
Bauer, P., Thorpe, A., & Brunet, G. (2015) · Nature · doi:10.1038/nature14956 · Cited by 2,729 · see citing works
Zhang, C. (2005) · Reviews of Geophysics · doi:10.1029/2004rg000158 · Cited by 2,178 · see citing works
Zhang, G. J., & McFarlane, N. A. (1995) · ATMOSPHERE-OCEAN · doi:10.1080/07055900.1995.9649539 · Cited by 2,026 · see citing works
Marine boundary layer clouds at the heart of tropical cloud feedback uncertainties in climate models
Bony, S., & Dufresne, J. (2005) · Geophysical Research Letters · doi:10.1029/2005gl023851 · Cited by 1,306 · see citing works
Searching for exotic particles in high-energy physics with deep learning
Baldi, P., Sadowski, P., & Whiteson, D. (2014) · Nature Communications · doi:10.1038/ncomms5308 · Cited by 1,164 · see citing works
Clouds, circulation and climate sensitivity
Bony, S., Stevens, B., Frierson, D. M. W., Jakob, C., Kageyama, M., Pincus, R. L., Shepherd, T. G., Sherwood, S. C., Siebesma, A. P., Sobel, A. H., et al. (2015) · Nature Geoscience · doi:10.1038/ngeo2398 · Cited by 987 · see citing works
Neural Networks and Deep Learning
Aggarwal, C. (2018) · Cambridge International Law Journal · doi:10.1007/978-3-319-94463-0 · Cited by 932 · see citing works
The Formulation and Atmospheric Simulation of the Community Atmosphere Model Version 3 (CAM3)
Collins, W. D., Rasch, P. J., Boville, B. A., Hack, J. J., McCaa, J. R., Williamson, D. L., Briegleb, B. P., Bitz, C. M., Lin, S., & Zhang, M. (2006) · Journal of Climate · doi:10.1175/jcli3760.1 · Cited by 922 · see citing works
Deep learning for computational chemistry
Goh, G. B., Hodas, N. O., & Vishnu, A. (2017) · Journal of Computational Chemistry · doi:10.1002/jcc.24764 · Cited by 809 · see citing works
Spread in model climate sensitivity traced to atmospheric convective mixing
Sherwood, S. C., Bony, S., & Dufresne, J.-L. (2014) · Nature · doi:10.1038/nature12829 · Cited by 762 · see citing works
The Art and Science of Climate Model Tuning
Hourdin, F., Mauritsen, T., Gettelman, A., Golaz, J.-C., Balaji, V., Duan, Q., Folini, D., Ji, D., Klocke, D., Qian, Y., et al. (2017) · Bulletin of the American Meteorological Society · doi:10.1175/bams-d-15-00135.1 · Cited by 611 · see citing works
What Are Climate Models Missing?
Stevens, B., & Bony, S. (2013) · Science · doi:10.1126/science.1237554 · Cited by 559 · see citing works
Could Machine Learning Break the Convection Parameterization Deadlock?
Gentine, P., Pritchard, M., Rasp, S., Reinaudi, G., & Yacalis, G. (2018) · Geophysical Research Letters · doi:10.1029/2018gl078202 · Cited by 497 · see citing works
Self-citationKhairoutdinov, M. F., & Randall, D. A. (2001) · Geophysical Research Letters · doi:10.1029/2001gl013552 · Cited by 493 · see citing works
The Soil Moisture–Precipitation Feedback in Simulations with Explicit and Parameterized Convection
Hohenegger, C., Brockhaus, P., Bretherton, C. S., et al. (2009) · Journal of Climate · doi:10.1175/2009jcli2604.1 · Cited by 453 · see citing works
O'Gorman, P. A., & Dwyer, J. G. (2018) · Journal of Advances in Modeling Earth Systems · doi:10.1029/2018ms001351 · Cited by 419 · see citing works
Schneider, T., Lan, S., Stuart, A., & Teixeira, J. (2017) · Geophysical Research Letters · doi:10.1002/2017gl076101 · Cited by 391 · see citing works
Prognostic Validation of a Neural Network Unified Physics Parameterization
Brenowitz, N., & Bretherton, C. S. (2018) · Geophysical Research Letters · doi:10.1029/2018gl078510 · Cited by 387 · see citing works
Hwang, Y., & Frierson, D. M. W. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1213302110 · Cited by 386 · see citing works
O’Gorman, P. A., & Dwyer, J. G. (2018) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 374 · see citing works
Climate goals and computing the future of clouds
Schneider, T., Teixeira, J., Bretherton, C. S., Brient, F., Pressel, K. G., Schär, C., & Siebesma, A. P. (2017) · Nature Climate Change · doi:10.1038/nclimate3190 · Cited by 294 · see citing works
Large‐eddy simulations over Germany using ICON: a comprehensive evaluation
Heinze, R., Dipankar, A., Henken, C. C., Moseley, C., Sourdeval, O., Trömel, S., Xie, X., Adamidis, P., Ament, F., Baars, H., et al. (2016) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.2947 · Cited by 293 · see citing works
Andersen, J. A., & Kuang, Z. (2011) · Journal of Climate · doi:10.1175/jcli-d-11-00168.1 · Cited by 275 · see citing works
Parameterizing Convective Organization to Escape the Entrainment Dilemma
Mapes, B. E., & Neale, R. (2011) · Journal of Advances in Modeling Earth Systems · doi:10.1029/2011ms000042 · Cited by 226 · see citing works
What favors convective aggregation and why?
Muller, C. J., & Bony, S. (2015) · Geophysical Research Letters · doi:10.1002/2015gl064260 · Cited by 225 · see citing works
Short-Range Ensemble Forecasting of Quantitative Precipitation
Du, J., Mullen, S., & Sanders, F. (1997) · Monthly Weather Review · doi:10.1175/1520-0493(1997)125 · Cited by 216 · see citing works
Krasnopolsky, V. M., Fox‐Rabinovitz, M. S., & Belochitski, A. A. (2013) · Advances in Artificial Neural Systems · doi:10.1155/2013/485913 · Cited by 208 · see citing works
Structure of the Madden–Julian Oscillation in the Superparameterized CAM
Benedict, J. J., & Randall, D. A. (2009) · Journal of the Atmospheric Sciences · doi:10.1175/2009jas3030.1 · Cited by 202 · see citing works
Deep moist atmospheric convection in a subkilometer global simulation
Miyamoto, Y., Kajikawa, Y., Yoshida, R., et al. (2013) · Geophysical Research Letters · doi:10.1002/grl.50944 · Cited by 201 · see citing works
Evaluation of the convection‐resolving climate modeling approach on continental scales
Leutwyler, D., Lüthi, D., Ban, N., et al. (2017) · Journal of Geophysical Research Atmospheres · doi:10.1002/2016jd026013 · Cited by 188 · see citing works
Oueslati, B., & Bellon, G. (2015) · Climate Dynamics · doi:10.1007/s00382-015-2468-6 · Cited by 170 · see citing works
Global‐scale convective aggregation: Implications for the Madden‐Julian Oscillation
Arnold, N., & Randall, D. A. (2015) · Journal of Advances in Modeling Earth Systems · doi:10.1002/2015ms000498 · Cited by 167 · see citing works
The vertical distribution of cloud feedback in coupled ocean-atmosphere models
Soden, B. J., & Vecchi, G. A. (2011) · Geophysical Research Letters · doi:10.1029/2011gl047632 · Cited by 159 · see citing works
A Density Current Parameterization Coupled with Emanuel’s Convection Scheme. Part I: The Models
Grandpeix, J., & Lafore, J. (2009) · Journal of the Atmospheric Sciences · doi:10.1175/2009jas3044.1 · Cited by 159 · see citing works
Jiang, X. (2017) · Journal of Geophysical Research Atmospheres · doi:10.1002/2016jd025955 · Cited by 138 · see citing works
Ensemble‐based simultaneous state and parameter estimation with MM5
Aksoy, A., Zhang, F., & Nielsen‐Gammon, J. W. (2006) · Geophysical Research Letters · doi:10.1029/2006gl026186 · Cited by 126 · see citing works
Rediscovery of the doldrums in storm-resolving simulations over the tropical Atlantic
Klocke, D., Brueck, M., Hohenegger, C., & Stevens, B. (2017) · Nature Geoscience · doi:10.1038/s41561-017-0005-4 · Cited by 116 · see citing works
Convective self‐aggregation feedbacks in near‐global cloud‐resolving simulations of an aquaplanet
Bretherton, C. S., & Khairoutdinov, M. F. (2015) · Journal of Advances in Modeling Earth Systems · doi:10.1002/2015ms000499 · Cited by 115 · see citing works
Simon, E., Samuelsen, A., Bertino, L., et al. (2015) · Journal of Marine Systems · doi:10.1016/j.jmarsys.2015.07.004 · Cited by 60 · see citing works
Kooperman, G. J., Pritchard, M. S., O'Brien, T. A., & Timmermans, B. W. (2018) · Journal of Advances in Modeling Earth Systems · doi:10.1002/2017ms001188 · Cited by 55 · see citing works
Self-citationToward low‐cloud‐permitting cloud superparameterization with explicit boundary layer turbulence
Parishani, H., Pritchard, M. S., Bretherton, C. S., Wyant, M. C., & Khairoutdinov, M. F. (2017) · Journal of Advances in Modeling Earth Systems · doi:10.1002/2017ms000968 · Cited by 54 · see citing works
Self-citationCouvreux, F., Roehrig, R., Rio, C., et al. (2015) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.2517 · Cited by 46 · see citing works
Pritchard, M. S., Bretherton, C. S., & DeMott, C. A. (2014) · Journal of Advances in Modeling Earth Systems · doi:10.1002/2014ms000340 · Cited by 43 · see citing works
Self-citationEffects of explicit convection on global land‐atmosphere coupling in the superparameterized CAM
Sun, J., & Pritchard, M. S. (2016) · Journal of Advances in Modeling Earth Systems · doi:10.1002/2016ms000689 · Cited by 37 · see citing works
Self-citationYashiro, H., Kajikawa, Y., Miyamoto, Y., Yamaura, T., Yoshida, R., & Tomita, H. (2016) · SOLA · doi:10.2151/sola.2016-053 · Cited by 36 · see citing works
Kooperman, G. J., Pritchard, M. S., Burt, M., Branson, M., & Randall, D. A. (2016) · Journal of Advances in Modeling Earth Systems · doi:10.1002/2016ms000715 · Cited by 35 · see citing works
Self-citationA Probabilistic Bulk Model of Coupled Mixed Layer and Convection. Part I: Clear-Sky Case
Gentine, P., Betts, A. K., Lintner, B. R., et al. (2013) · Journal of the Atmospheric Sciences · doi:10.1175/jas-d-12-0145.1 · Cited by 28 · see citing works
Self-citationMcHugh, M. (2004) · doi:10.1175/1520-0442(2004)017
Flagged first, then by citations
Cited by
Sorted by citations
Cowls, J., Tsamados, A., Taddeo, M., & Floridi, L. (2021) · doi:10.2139/ssrn.3804983 · Cited by 552 · see citing works
Artificial intelligence, systemic risks, and sustainability
Galaz, V., Centeno, M. A., Callahan, P. W., Causevic, A., Patterson, T., Brass, I., Baum, S., Farber, D., Fischer, J., Garcia, D., et al. (2021) · Technology in Society · doi:10.1016/j.techsoc.2021.101741 · Cited by 497 · see citing works
Cowls, J., Tsamados, A., Taddeo, M., & Floridi, L. (2023) · AI & SOCIETY · doi:10.1007/s00146-021-01294-x · Cited by 552 · see citing works
Neural general circulation models for weather and climate
Kochkov, D., Yuval, J., Langmore, I., Norgaard, P., Smith, J., Mooers, G., Klöwer, M., Lottes, J., Rasp, S., Düben, P., et al. (2024) · Nature · doi:10.1038/s41586-024-07744-y · Cited by 454 · see citing works
“9–22.”
BackgroundSelf-citationHeat Waves: Physical Understanding and Scientific Challenges
Barriopedro, D., García‐Herrera, R., Ordóñez, C., Miralles, D. G., & Salcedo‐Sanz, S. (2023) · Reviews of Geophysics · doi:10.1029/2022rg000780 · Cited by 404 · see citing works
Towards neural Earth system modelling by integrating artificial intelligence in Earth system science
Irrgang, C., Boers, N., Sonnewald, M., Barnes, E. A., Kadow, C., Staneva, J., & Saynisch-Wagner, J. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00374-3 · Cited by 308 · see citing works
Deploying artificial intelligence for climate change adaptation
Leal Filho, W., Wall, T., Rui Mucova, S. A., Nagy, G. J., Balogun, A.-L., Luetz, J. M., Ng, A. W., Kovaleva, M., Safiul Azam, F. M., Alves, F., et al. (2022) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2022.121662 · Cited by 266 · see citing works
Data‐Driven Equation Discovery of Ocean Mesoscale Closures
Zanna, L., & Bolton, T. (2020) · Geophysical Research Letters · doi:10.1029/2020gl088376 · Cited by 259 · see citing works
Spatially Extended Tests of a Neural Network Parametrization Trained by Coarse‐Graining
Brenowitz, N. D., & Bretherton, C. S. (2019) · Journal of Advances in Modeling Earth Systems · doi:10.1029/2019ms001711 · Cited by 231 · see citing works
Analog forecasting of extreme-causing weather patterns using deep learning
Chattopadhyay, A., Nabizadeh, E., & Hassanzadeh, P. (2020) · Journal of Advances in Modeling Earth Systems · doi:10.1029/2019ms001958 · Cited by 224 · see citing works
Tackling climate change with machine learning
Rolnick, D., Donti, P. L., Kaack, L. H., Kochanski, K., Lacoste, A., Sankaran, K., Ross, A. S., Milojevic-Dupont, N., Jaques, N., Waldman-Brown, A., et al. (2023) · ACM Computing Surveys · doi:10.1145/3485128 · Cited by 336 · see citing works
Fiedler, S., Crueger, T., D’Agostino, R., Peters, K., Becker, T., Leutwyler, D., Paccini, L., Burdanowitz, J., Buehler, S. A., Cortes, A. U., et al. (2020) · Monthly Weather Review · doi:10.1175/mwr-d-19-0404.1 · Cited by 166 · see citing works
Interpretable machine learning for weather and climate prediction: A review
Yang, R., Hu, J., Li, Z., Mu, J., Yu, T., Xia, J., Li, X., Dasgupta, A., & Xiong, H. (2024) · Atmospheric Environment · doi:10.1016/j.atmosenv.2024.120797 · Cited by 139 · see citing works
Materia, S., García, L. P., van Straaten, C., O, S., Mamalakis, A., Cavicchia, L., Coumou, D., de Luca, P., Kretschmer, M., & Donat, M. (2024) · WIREs Climate Change · doi:10.1002/wcc.914 · Cited by 130 · see citing works
“…issue can considerably degrade model performance, especially under a warming climate that shifts spatial and temporal distributions of Earth system variables, as current relationships may no longer be valid in the future (D'Amour et al., 2020; O'Gorman & Dwyer, 2018; Rasp et al., 2018).”
Deep learning for bias correction of MJO prediction
Kim, H., Ham, Y. G., Joo, Y. S., & Son, S. W. (2021) · Nature Communications · doi:10.1038/s41467-021-23406-3 · Cited by 92 · see citing works
Machine learning for the physics of climate
Bracco, A., Brajard, J., Dijkstra, H. A., Hassanzadeh, P., Lessig, C., & Monteleoni, C. (2024) · Nature Reviews Physics · doi:10.1038/s42254-024-00776-3 · Cited by 79 · see citing works
Dueben, P. D., Schultz, M. G., Chantry, M., Gagne, D. J., Hall, D. M., & McGovern, A. (2022) · Artificial Intelligence for the Earth Systems · doi:10.1175/aies-d-21-0002.1 · Cited by 64 · see citing works
Shaw, T. A., & Stevens, B. (2025) · Nature · doi:10.1038/s41586-025-08680-1 · Cited by 37 · see citing works
Machine learning applications for weather and climate need greater focus on extremes
Watson, P. A. G. (2022) · Environmental Research Letters · doi:10.1088/1748-9326/ac9d4e · Cited by 32 · see citing works
Differentiable programming for Earth system modeling
Gelbrecht, M., White, A., Bathiany, S., & Boers, N. (2023) · Geoscientific Model Development · doi:10.5194/gmd-16-3123-2023 · Cited by 31 · see citing works
Arcomano, T., Szunyogh, I., Wikner, A., Hunt, B. R., & Ott, E. (2023) · Geophysical Research Letters · doi:10.1029/2022gl102649 · Cited by 28 · see citing works
Toms, B. A., Kashinath, K., Prabhat, & Yang, D. (2021) · Geoscientific Model Development · doi:10.5194/gmd-14-4495-2021 · Cited by 20 · see citing works
Barahona, D., Breen, K. H., Kalesse-Los, H., & Röttenbacher, J. (2024) · Artificial Intelligence for the Earth Systems · doi:10.1175/aies-d-23-0025.1 · Cited by 4 · see citing works
- Authors
- Rasp, S., Pritchard, M. S., & Gentine, P.
- Affiliations
- University of California, Irvine (US)
- Columbia University (US)
- Corresponding author
- Rasp, Stephan
- Venue
- Proceedings of the National Academy of Sciences
- Publisher
- National Academy of Sciences
- Published
- 2018-09-06
- Volume
- 115
- Issue
- 39
- Pages
- 9684-9689
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- PMC
- PMC6166853
- OpenAlex
- W2808559252
- Cited by
- 1,044
- References
- 55
- Citations by year
- 2026: 127 · 2025: 104 · 2024: 167 · 2023: 211 · 2022: 130 · 2021: 174 · 2020: 86 · 2019: 38 · 2018: 7
- FWCI
- 37.15
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Proceedings of the National Academy of Sciences (publishedVersion, cc-by-nc-nd)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- eScholarship (California Digital Library) (submittedVersion, cc-by)
- OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Columbia Academic Commons (Columbia University)
- AGU Fall Meeting Abstracts
- Funders
- Deutsche Forschungsgemeinschaft (SFB/TRR 165)
- DOE | Office of Science (DE-SC0012152, DE-SC00-12548, DE-SC0014203)
- NSF | GEO | Division of Atmospheric and Geospace Sciences (AGS-1419518, AGS-1734164, AGS-1734156, AGS-1649770)
- National Aeronautics and Space Administration (NNX14AI36G)
- Topics
- Physical Sciences › Earth and Planetary Sciences › Atmospheric Science › Meteorological Phenomena and Simulations
- Physical Sciences › Environmental Science › Global and Planetary Change › Climate variability and models
- Physical Sciences › Environmental Science › Global and Planetary Change › Climate Change and Geoengineering
- Keywords
- deep learning, subgrid-scale modeling, cloud parameterization, cloud-resolving model, global climate models, multiscale modeling, convection, heavy rainfall, equatorial waves, energy conservation (physics), climate prediction uncertainty
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review