On the interpretation of constrained climate model ensembles
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
An ensemble of models can be interpreted in two ways. The first treats each model as an approximation of the true system with some random error. Alternatively, the true system can be interpreted as a sample drawn from a distribution of models, such that model and truth are statistically indistinguishable. Both interpretations are ubiquitous and have different consequences for the uncertainty of model projections, but are rarely defended. Here we argue that the two seemingly conflicting views are in fact complementary, and the interpretation of the ensemble may evolve seamlessly from the former to the latter. We show some ‘truth plus error’ like properties exist for historical and present day climate simulations in the CMIP archive, and that they can be explained by the ensemble design and tuning to observations, although both models and tuning are imperfect. For future projections, structural differences in model response arise which are independent of the present day state and thus the ‘indistinguishable’ interpretation is increasingly favored. Our inability to define performance metrics that identify ‘good’ and ‘bad’ models can be explained by the models having largely exploited the available observations. The remaining model error is largely structural and the observations are often uninformative to further reduce model biases or reduce the range of projections covered by the ensemble. The discussion here is motivated by the use of multi model ensembles in climate projections, but the arguments are generic to any situation where multiple different models constrained by observations are used to describe the same system.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The use of the multi-model ensemble in probabilistic climate projections
Tebaldi, C., & Knutti, R. (2007) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2007.2076 · Cited by 1,862 · cited 3×
“The resulting ensemble is neither sampled randomly nor systematically and is often called an “ensemble of opportunity” [Tebaldi and Knutti, 2007].”
BackgroundSelf-citationPerformance metrics for climate models.
Gleckler, P. J., Taylor, K. E., & Doutriaux, C. (2008) · Journal of Geophysical Research: Atmospheres · doi:10.1029/2007jd008972 · Cited by 1,328 · cited 3×
“mance, resolution, as well as the degree of complexity by which the different models describe various processes vary substantially [Gleckler et al., 2008; Reichler and Kim, 2008].”
BackgroundChallenges in combining projections from multiple climate models.
Knutti, R., Furrer, R., Tebaldi, C., Cermak, J., & Meehl, G. A. (2010) · Journal of Climate · doi:10.1175/2009jcli3361.1 · Cited by 1,270 · cited 8×
“Indeed, correlations between the simulated current and future climate are generally weak [Knutti et al., 2010a].”
BackgroundResultSelf-citationUsing the current seasonal cycle to constrain snow albedo feedback in future climate change
Hall, A., & Qu, X. (2006) · Geophysical Research Letters · doi:10.1029/2005gl025127 · Cited by 469 · cited 1×
“Except for a few cases (e.g., for the Arctic) [Boe et al., 2009; Hall and Qu, 2006; Mahlstein and Knutti, 2011] such constraints are rarely found, implying that any outcome in the ensemble range is as plausible as the others, often referred to as ‘model democracy’ [Knutti, 2010].”
BackgroundShould we believe model predictions of future climate change?
Knutti, R. (2008) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2008.0169 · Cited by 279 · cited 3×
“…justification for the latter is that each model is a plausible representation of the system given our incomplete understanding of the processes, limited computational capacity, uncertainty in observations, and noise from natural variability [Knutti, 2008; Knutti et al., 2010a; Parker, 2006].”
BackgroundSelf-citationBayesian Modeling of Uncertainty in Ensembles of Climate Models
Smith, R. L., Tebaldi, C., Nychka, D., & Mearns, L. O. (2009) · Journal of the American Statistical Association · doi:10.1198/jasa.2009.0007 · Cited by 225 · cited 2×
“, random samples from a distribution of plausible models centered about the true climate [Buser et al., 2009; Furrer et al., 2007; Smith et al., 2009; Tebaldi et al., 2005].”
BackgroundBayesian multi-model projection of climate: bias assumptions and interannual variability
Buser, C. M., Künsch, H. R., Lüthi, D., Wild, M., & Schär, C. (2009) · Climate Dynamics · doi:10.1007/s00382-009-0588-6 · Cited by 181 · cited 1×
“The models can be interpreted as ‘truth plus error’, e.g., random samples from a distribution of plausible models centered about the true climate [Buser et al., 2009; Furrer et al., 2007; Smith et al., 2009; Tebaldi et al., 2005].”
Background
Cited by
A climate model projection weighting scheme accounting for performance and interdependence
Knutti, R., Sedláček, J., Sanderson, B. M., Lorenz, R., Fischer, E. M., & Eyring, V. (2017) · Geophysical Research Letters · doi:10.1002/2016gl072012 · Cited by 491
Self-citationA Representative Democracy to Reduce Interdependency in a Multimodel Ensemble
Sanderson, B. M., Knutti, R., & Caldwell, P. (2015) · Journal of Climate · doi:10.1175/jcli-d-14-00362.1 · Cited by 407
Self-citationBeyond equilibrium climate sensitivity
Knutti, R., Rugenstein, M. A. A., & Hegerl, G. C. (2017) · Nature Geoscience · doi:10.1038/ngeo3017 · Cited by 333
Self-citationThe shifting influence of drought and heat stress for crops in northeast Australia
Lobell, D. B., Hammer, G. L., Chenu, K., Zheng, B., McLean, G., & Chapman, S. C. (2015) · Global Change Biology · doi:10.1111/gcb.13022 · Cited by 310
“…based on evidence that it tends to outperform individual GCMs when simulating past climate (Gleckler et al., 2008), treating each projection as equally likely is more conservative, in that it assumes past observations cannot adequately reveal structural uncertainties (Sanderson & Knutti, 2012).”
BackgroundPattern scaling: Its strengths and limitations, and an update on the latest model simulations
Tebaldi, C., & Arblaster, J. M. (2014) · Climatic Change · doi:10.1007/s10584-013-1032-9 · Cited by 274
Metadata
- Authors
- Sanderson, B. M., & Knutti, R.
- Venue
- Geophysical Research Letters
- Publisher
- American Geophysical Union (AGU)
- Published
- 2012-08-28
- Volume
- 39
- Issue
- 16
- ISSN
- 0094-8276 (ISSN-L)
- 1944-8007
- OpenAlex
- W1590559368
- Cited by
- 94
- References
- 7
- FWCI
- 6.52
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.