Climate model dependence and the replicate Earth paradigm
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
Multi-model ensembles are commonly used in climate prediction to create a set of independent estimates, and so better gauge the likelihood of particular outcomes and better quantify prediction uncertainty. Yet researchers share literature, datasets and model code—to what extent do different simulations constitute independent estimates? What is the relationship between model performance and independence? We show that error correlation provides a natural empirical basis for defining model dependence and derive a weighting strategy that accounts for dependence in experiments where the multi-model mean would otherwise be used. We introduce the “replicate Earth” ensemble interpretation framework, based on theoretically derived statistical relationships between ensembles of perfect models (replicate Earths) and observations. We transform an ensemble of (imperfect) climate projections into an ensemble whose mean and variance have the same statistical relationship to observations as an ensemble of replicate Earths. The approach can be used with multi-model ensembles that have varying numbers of simulations from different models, accounting for model dependence. We use HadCRUT3 data and the CMIP3 models to show that in out of sample tests, the transformed ensemble has an ensemble mean with significantly lower error and much flatter rank frequency histograms than the original ensemble.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The use of the multi-model ensemble in probabilistic climate projections
Tebaldi, C., & Knutti, R. (2007) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2007.2076 · Cited by 1,862 · cited 1×
“…100 groups share data sets, parametrisations and even sections of model code, so there are reasons to 101 suspect that the assumption of statistical independence of every climate prediction may not be 102 appropriate (Tebaldi and Knutti, 2007; Jewson and Hawkins, 2009; Knutti et al, 2010a).”
BackgroundPerformance metrics for climate models.
Gleckler, P. J., Taylor, K. E., & Doutriaux, C. (2008) · Journal of Geophysical Research: Atmospheres · doi:10.1029/2007jd008972 · Cited by 1,328 · cited 4×
“2005) or sub-selecting (e.g. Perkins et al. 2007; Gleckler et al. 2008) different simulations or models, based on their”
BackgroundInfluentialChallenges in combining projections from multiple climate models.
Knutti, R., Furrer, R., Tebaldi, C., Cermak, J., & Meehl, G. A. (2010) · Journal of Climate · doi:10.1175/2009jcli3361.1 · Cited by 1,270
Weather Forecasting with Ensemble Methods
Gneiting, T., & Raftery, A. E. (2005) · Science · doi:10.1126/science.1115255 · Cited by 636 · cited 1×
“…between weather and climate, we now 717 contrast the CPDF that we wish to extract from an ensemble of climate predictions with the 718 Weather PDF (WPDF) that forecasters attempt to infer from ensembles of 1-15 day weather 719 forecasts (Gneiting and Raftery, 2005, and references therein).”
Risks of Model Weighting in Multimodel Climate Projections
Weigel, A. P., Knutti, R., Liniger, M. A., & Appenzeller, C. (2010) · Journal of Climate · doi:10.1175/2010jcli3594.1 · Cited by 386
Doblas-Reyes, F. J., Hagedorn, R., & Palmer, T. N. (2005) · Tellus A: Dynamic Meteorology and Oceanography · doi:10.3402/tellusa.v57i3.14658 · Cited by 340
Bayesian Modeling of Uncertainty in Ensembles of Climate Models
Smith, R. L., Tebaldi, C., Nychka, D., & Mearns, L. O. (2009) · Journal of the American Statistical Association · doi:10.1198/jasa.2009.0007 · Cited by 225
Spatial Analysis to Quantify Numerical Model Bias and Dependence: How Many Climate Models Are There?
Jun, M., Knutti, R., & Nychka, D. W. (2008) · Journal of the American Statistical Association · doi:10.1198/016214507000001265 · Cited by 214
Climate projections: Past performance no guarantee of future skill?
Reifen, C., & Toumi, R. (2009) · Geophysical Research Letters · doi:10.1029/2009gl038082 · Cited by 144 · cited 1×
“Using a historical evaluation period to remove model biases is 288 common in weather forecasting (e.g. Glahn and Lowry, 1972; Wilson and Vallée, 2002) and 289 climate research (Meehl et al, 2007b; Reifen and Toumi, 2009).”
Method
Cited by
Taking climate model evaluation to the next level
Eyring, V., Cox, P. M., Flato, G. M., Gleckler, P. J., Abramowitz, G., Caldwell, P., Collins, W. D., Gier, B. K., Hall, A. D., Hoffman, F. M., et al. (2019) · Nature Climate Change · doi:10.1038/s41558-018-0355-y · Cited by 748
Self-citationA Representative Democracy to Reduce Interdependency in a Multimodel Ensemble
Sanderson, B. M., Knutti, R., & Caldwell, P. (2015) · Journal of Climate · doi:10.1175/jcli-d-14-00362.1 · Cited by 407
Reduced global warming from CMIP6 projections when weighting models by performance and independence
Brunner, L., Pendergrass, A. G., Lehner, F., Merrifield, A. L., Lorenz, R., & Knutti, R. (2020) · Earth System Dynamics · doi:10.5194/esd-11-995-2020 · Cited by 362
Beyond equilibrium climate sensitivity
Knutti, R., Rugenstein, M. A. A., & Hegerl, G. C. (2017) · Nature Geoscience · doi:10.1038/ngeo3017 · Cited by 333
(2023) · Climate Change 2021 – The Physical Science Basis · doi:10.1017/9781009157896.003 · Cited by 298
Metadata
- Authors
- Bishop, C. H., & Abramowitz, G.
- Venue
- Climate Dynamics
- Published
- 2012-12-11
- Volume
- 41
- Issue
- 3-4
- Pages
- 885-900
- ISSN
- 0930-7575 (ISSN-L)
- 1432-0894
- OpenAlex
- W2045641046
- Cited by
- 193
- References
- 9
- FWCI
- 6.52
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.