The Art and Science of Climate Model Tuning
Open accessAbstract
The process of parameter estimation targeting a chosen set of observations is an essential aspect of numerical modeling. This process is usually named tuning in the climate modeling community. In climate models, the variety and complexity of physical processes involved, and their interplay through a wide range of spatial and temporal scales, must be summarized in a series of approximate submodels. Most submodels depend on uncertain parameters. Tuning consists of adjusting the values of these parameters to bring the solution as a whole into line with aspects of the observed climate. Tuning is an essential aspect of climate modeling with its own scientific issues, which is probably not advertised enough outside the community of model developers. Optimization of climate models raises important questions about whether tuning methods a priori constrain the model results in unintended ways that would affect our confidence in climate projections. Here, we present the definition and rationale behind model tuning, review specific methodological aspects, and survey the diversity of tuning approaches used in current climate models. We also discuss the challenges and opportunities in applying so-called objective methods in climate model tuning. We discuss how tuning methodologies may affect fundamental results of climate models, such as climate sensitivity. The article concludes with a series of recommendations to make the process of climate model tuning more transparent.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Objective methods such as history matching cannot replace the expertise and subjectivity inherent to the tuning process.
“This underlines that objective methods such as history matching cannot and should not replace the expertise and subjectivity inherent to the tuning process (23).”
From Toward machine-assisted tuning avoiding the underestimation of uncertainty in climate change projections (2023) · cites this paper as [23]
Cites
Model selection and multimodel inference: a practical information-theoretic approach.
Guthery, F. S., Burnham, K. P., & Anderson, D. R. (2003) · The Journal of Wildlife Management · doi:10.2307/3802723 · Cited by 41,495 · see citing works
The use of the multi-model ensemble in probabilistic climate projections
Tebaldi, C., & Knutti, R. (2007) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2007.2076 · Cited by 1,862 · see citing works
Quantification of modelling uncertainties in a large ensemble of climate change simulations.
Murphy, J. M., Sexton, D. M. H., Barnett, D. N., Jones, G. S., Webb, M. J., Collins, M., & Stainforth, D. A. (2004) · Nature · doi:10.1038/nature02771 · Cited by 1,655 · see citing works
Probabilistic inference for future climate using an ensemble of climate model evaluations.
Rougier, J. (2007) · Climatic Change · doi:10.1007/s10584-006-9156-9 · Cited by 218 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Deep learning to represent subgrid processes in climate models
Rasp, S., Pritchard, M. S., & Gentine, P. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1810286115 · Cited by 1,044 · see citing works
Neural general circulation models for weather and climate
Kochkov, D., Yuval, J., Langmore, I., Norgaard, P., Smith, J., Mooers, G., Klöwer, M., Lottes, J., Rasp, S., Düben, P., et al. (2024) · Nature · doi:10.1038/s41586-024-07744-y · Cited by 454 · see citing works
LMDZ6A: The Atmospheric Component of the IPSL Climate Model With Improved and Better Tuned Physics
Hourdin, F., Rio, C., Grandpeix, J., Madeleine, J., Cheruy, F., Rochetin, N., Jam, A., Musat, I., Idelkadi, A., Fairhead, L., et al. (2020) · Journal of Advances in Modeling Earth Systems · doi:10.1029/2019ms001892 · Cited by 268 · see citing works
Self-citationTackling climate change with machine learning
Rolnick, D., Donti, P. L., Kaack, L. H., Kochanski, K., Lacoste, A., Sankaran, K., Ross, A. S., Milojevic-Dupont, N., Jaques, N., Waldman-Brown, A., et al. (2023) · ACM Computing Surveys · doi:10.1145/3485128 · Cited by 336 · see citing works
Aerosols in the Pre-industrial Atmosphere
Carslaw, K. S., Gordon, H., Hamilton, D. S., Johnson, J. S., Regayre, L. A., Yoshioka, M., & Pringle, K. J. (2017) · Current Climate Change Reports · doi:10.1007/s40641-017-0061-2 · Cited by 129 · see citing works
Couvreux, F., Hourdin, F., Williamson, D., Roehrig, R., Volodina, V., Villefranque, N., Rio, C., Audouin, O., Salter, J., Bazile, E., et al. (2021) · Journal of Advances in Modeling Earth Systems · doi:10.1029/2020ms002217 · Cited by 121 · see citing works
Self-citationAre general circulation models obsolete?
Balaji, V., Couvreux, F., Deshayes, J., Gautrais, J., Hourdin, F., & Rio, C. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2202075119 · Cited by 84 · see citing works
Self-citationHourdin, F., Williamson, D., Rio, C., Couvreux, F., Roehrig, R., Villefranque, N., Musat, I., Fairhead, L., Diallo, F. B., & Volodina, V. (2021) · Journal of Advances in Modeling Earth Systems · doi:10.1029/2020ms002225 · Cited by 83 · see citing works
Self-citationMachine Learning Predictions of a Multiresolution Climate Model Ensemble
Anderson, G. J., & Lucas, D. D. (2018) · Geophysical Research Letters · doi:10.1029/2018gl077049 · Cited by 60 · see citing works
Hourdin, F., Ferster, B., Deshayes, J., Mignot, J., Musat, I., & Williamson, D. (2023) · Science Advances · doi:10.1126/sciadv.adf2758 · Cited by 49 · see citing works
Self-citationThe Tuning Strategy of IPSL‐CM6A‐LR
Mignot, J., Hourdin, F., Deshayes, J., Boucher, O., Gastineau, G., Musat, I., Vancoppenolle, M., Servonnat, J., Caubel, A., Chéruy, F., et al. (2021) · Journal of Advances in Modeling Earth Systems · doi:10.1029/2020ms002340 · Cited by 36 · see citing works
Self-citationRobustness of Competing Climatic States
Ragon, C., Lembo, V., Lucarini, V., Vérard, C., Kasparian, J., & Brunetti, M. (2022) · Journal of Climate · doi:10.1175/jcli-d-21-0148.1 · Cited by 27 · see citing works
Differentiable programming for Earth system modeling
Gelbrecht, M., White, A., Bathiany, S., & Boers, N. (2023) · Geoscientific Model Development · doi:10.5194/gmd-16-3123-2023 · Cited by 31 · see citing works
Convective Boundary Layer Control of the Sea Surface Temperature in the Tropics
Hourdin, F., Rio, C., Jam, A., Traore, A., & Musat, I. (2020) · Journal of Advances in Modeling Earth Systems · doi:10.1029/2019ms001988 · Cited by 24 · see citing works
Self-citationFletcher, C. G., Kravitz, B., & Badawy, B. (2018) · Atmospheric Chemistry and Physics · doi:10.5194/acp-18-17529-2018 · Cited by 20 · see citing works
- Authors
- Hourdin, F., Mauritsen, T., Gettelman, A., Golaz, J.-C., Balaji, V., Duan, Q., Folini, D., Ji, D., Klocke, D., Qian, Y., Rauser, F., Rio, C., Tomassini, L., Watanabe, M., & Williamson, D.
- Affiliations
- Centre National de la Recherche Scientifique (FR)
- Max Planck Institute for Meteorology (DE)
- NSF National Center for Atmospheric Research (US)
- NOAA Geophysical Fluid Dynamics Laboratory (US)
- Princeton University (US)
- Beijing Normal University (CN)
- ETH Zurich (CH)
- Deutscher Wetterdienst (DE)
- Pacific Northwest National Laboratory (US)
- The University of Tokyo (JP)
- University of Exeter (GB)
- ORCID
- Venue
- Bulletin of the American Meteorological Society
- Publisher
- American Meteorological Society
- Published
- 2017-03-01
- Volume
- 98
- Issue
- 3
- Pages
- 589-602
- ISSN
- 0003-0007 (ISSN-L)
- 1520-0477
- OpenAlex
- W2495412896
- Cited by
- 611
- References
- 4
- Citations by year
- 2026: 30 · 2025: 62 · 2024: 62 · 2023: 78 · 2022: 90 · 2021: 78 · 2020: 80 · 2019: 49 · 2018: 51 · 2017: 26 · 2016: 4
- FWCI
- 32.13
- Type
- journal article
- Language
- en
- Open access
- Licence
- Locations
- Bulletin of the American Meteorological Society (publishedVersion)
- Open Research Exeter (University of Exeter) (publishedVersion)
- NOAA Institutional Repository (submittedVersion, other-oa)
- OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) (submittedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion, other-oa)
- Figshare (submittedVersion)
- Funders
- National Science Foundation (DE-AC52-07-NA27344, DEAC05–76RL01830, 76RL01830)
- U.S. Department of Energy (DE-AC05–76RL01830, DEAC5207NA27344, AC52‐07NA27344, 76RL01830, AC05-76RL01830, DE-AC05?, Contract DE-AC05-76RL01830)
- Battelle (AC05-76RL01830, DE- AC05-76RL01830, DE-AC05, DE-AC52-07NA27344)
- National Center for Atmospheric Research
- Agence Nationale de la Recherche (ANR-10-LABX-0018)
- Office of Science (DE-AC52-07NA27344, DE‐AC05‐76 RL01830)
- Engineering and Physical Sciences Research Council (EP/K019112/1)
- Japan Society for the Promotion of Science (26247079)
- Lawrence Livermore National Laboratory (DE‐AC5207NA27344, DE-AC05-76RL01830, AC52-07NA27344)
- Pacific Northwest National Laboratory (DEAC0576RL01830, 76RL01830, DE-AC52-07NA27344)
- Topics
- Physical Sciences › Environmental Science › Global and Planetary Change › Climate variability and models
- Physical Sciences › Earth and Planetary Sciences › Atmospheric Science › Meteorological Phenomena and Simulations
- Physical Sciences › Environmental Science › Global and Planetary Change › Climate Change and Geoengineering
- Keywords
- climate model tuning, parameter estimation, parameter uncertainty, climate sensitivity, model optimization, climate change projections, model validation against observations
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review