A Bayesian approach to climate model evaluation and multi‐model averaging with an application to global mean surface temperatures from IPCC AR4 coupled climate models
The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
A Bayesian approach is introduced to model evaluation and multi‐model averaging with a systematic consideration of model uncertainty, and its application to global mean surface air temperature (SAT) changes is shown from multi‐AOGCM ensembles of IPCC AR4 simulations. The Bayes factor or likelihood ratio of each model to the reference model (where mean is identical to the observation) provides a skill ranging from 0 to 1. Four categories of model skill are derived on the basis of the previous studies. Legendre series expansions are used to get a temporally refined model evaluation, which allow efficient analyses of time mean (scale) and linear trend. Application results show that all AOGCMs with natural plus anthropogenic forcing can simulate well the scale and trend of observed global mean SAT changes over the 20th century and its first and second halves. However, more than 50% of the models with anthropogenic‐only forcing cannot reproduce the observed warming reasonably. This indicates the important role of natural forcing although other factors like different climate sensitivity, forcing uncertainty, and a climate drift might be responsible for the discrepancy in anthropogenic‐only models. Besides, Bayesian and conventional skill comparisons demonstrate that a skill‐weighted average with the Bayes factors (Bayesian model averaging, BMA) overwhelms the arithmetic ensemble mean and three other weighted averages based on conventional statistics, illuminating future applicability of BMA to climate predictions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hoeting, J. A., Madigan, D., Raftery, A. E., & Volinsky, C. T. (1999) · Statistical Science · doi:10.1214/ss/1009212519 · Cited by 4,118
Using Bayesian model averaging to calibrate forecast ensembles.
Raftery, A. E., Gneiting, T., Balabdaoui, F., & Polakowski, M. (2005) · Monthly Weather Review · doi:10.1175/mwr2906.1 · Cited by 1,915 · cited 2×
“This corresponds to the method of Raftery et al. [2005], who used posterior probability as a weighting”
MethodResultHoeting, J. A., Madigan, D., Raftery, A. E., & Volinsky, C. T. (2000) · Statistical Science · doi:10.1214/ss/1009212814 · Cited by 152
Cited by
The use of the multi-model ensemble in probabilistic climate projections
Tebaldi, C., & Knutti, R. (2007) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2007.2076 · Cited by 1,862
“For a given metric and for presentday climate, weighted averages of models were shown to compare better to observations than to raw averages with equal weights ( Min & Hense 2006 ).”
MethodChallenges in combining projections from multiple climate models.
Knutti, R., Furrer, R., Tebaldi, C., Cermak, J., & Meehl, G. A. (2010) · Journal of Climate · doi:10.1175/2009jcli3361.1 · Cited by 1,270
How Well Do Coupled Models Simulate Today's Climate?
Reichler, T., & Kim, J. (2008) · Bulletin of the American Meteorological Society · doi:10.1175/bams-89-3-303 · Cited by 881
Use of models in detection and attribution of climate change
Hegerl, G., & Zwiers, F. (2011) · WIREs Climate Change · doi:10.1002/wcc.121 · Cited by 345
Ahmed, K., Sachindra, D. A., Shahid, S., Demirel, M. C., & Chung, E.-S. (2019) · Hydrology and Earth System Sciences · doi:10.5194/hess-23-4803-2019 · Cited by 309
Evaluation of CMIP6 GCM rainfall in mainland Southeast Asia
Iqbal, Z., Shahid, S., Ahmed, K., Ismail, T., Ziarh, G. F., Chung, E.-S., & Wang, X. (2021) · Atmospheric Research · doi:10.1016/j.atmosres.2021.105525 · Cited by 214
Pour, S. H., Shahid, S., Chung, E.-S., & Wang, X.-J. (2018) · Atmospheric Research · doi:10.1016/j.atmosres.2018.06.006 · Cited by 183
Khan, N., Shahid, S., Ahmed, K., Ismail, T., Nawaz, N., & Son, M. (2018) · Water · doi:10.3390/w10121793 · Cited by 183
“Various attempts have been conducted to determine the performance of GCMs in respect to gridded data using different types of filters which include weighted skill score [13,14], clustering hierarchy approach [15,16], spectral analysis [17], Bayesian weighting [18], different performance indicators [19,20] and so on.”
BackgroundGarcia, R. A., Burgess, N. D., Cabeza, M., Rahbek, C., & Araújo, M. B. (2012) · Global Change Biology · doi:10.1111/j.1365-2486.2011.02605.x · Cited by 164
“They have been shown not to systematically change the results in some cases (e.g. Pierce et al. , 2009) and to improve them in other cases (e.g. Min & Hense, 2006).”
BackgroundImproving Predictions using Ensemble Bayesian Model Averaging
Montgomery, J. M., Hollenbach, F. M., & Ward, M. D. (2012) · Political Analysis · doi:10.1093/pan/mps002 · Cited by 158
McMahon, T. A., Peel, M. C., & Karoly, D. J. (2015) · Hydrology and Earth System Sciences · doi:10.5194/hess-19-361-2015 · Cited by 89
“Several other assessment tools not included in Table 2b are the climate prediction index (Murphy et al., 2004) and Bayesian approaches (Min and Hense, 2006).”
BackgroundMethod
Metadata
- Authors
- Min, S., & Hense, A.
- Venue
- Geophysical Research Letters
- Publisher
- American Geophysical Union (AGU)
- Published
- 2006-04
- Volume
- 33
- Issue
- 8
- ISSN
- 0094-8276 (ISSN-L)
- 1944-8007
- OpenAlex
- W1980081218
- Cited by
- 98
- References
- 3
- FWCI
- 4.56
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.