The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Climate projections: Past performance no guarantee of future skill?
Abstract
The principle of selecting climate models based on their agreement with observations has been tested for surface temperature using 17 of the IPCC AR4 models. Those models simulating global mean, Siberian and European 20th Century surface temperature with a lower error than the total ensemble for one period on average do not do so for a subsequent period. Error in the ensemble mean decreases systematically with ensemble size, N, and for a random selection as approximately 1/Nα, where α lies between 0.6 and 1. This is larger than the exponent of a random sample (α = 0.5) and appears to be an indicator of systematic bias in the model simulations. There is no evidence that any subset of models delivers significant improvement in prediction accuracy compared to the total ensemble.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“and only a slight persistence of model skill during the past century (Reifen and Toumi 2009).”
From Risks of Model Weighting in Multimodel Climate Projections (2010) · cites this paper as Reifen and Toumi 2009
Citations
Cites
Climate change 2001 : the scientific basis
Houghton, J., Ding, Y., Griggs, D., Noguer, M., van der Linden, P. V. D., Dai, X., Maskell, K., & Johnson, C. (2001) · Foreign Affairs · doi:10.2307/20033020 · Cited by 14,162
(2007) · Medical Entomology and Zoology · Cited by 9,612
Change, I. P. O. C. (2007) · Cambridge University Press eBooks · doi:10.1017/cbo9780511546013 · Cited by 7,742
Uncertainty estimates in regional and global observed temperature changes: A new data set from 1850
Brohan, P., Kennedy, J. J., Harris, I., Tett, S. F. B., & Jones, P. D. (2006) · Journal of Geophysical Research: Atmospheres · doi:10.1029/2005jd006548 · Cited by 2,040
The use of the multi-model ensemble in probabilistic climate projections
Tebaldi, C., & Knutti, R. (2007) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2007.2076 · Cited by 1,862
Improving the Detection and Tracking of Tropical Cyclones in Atmospheric General Circulation Models
Camargo, S. J., & Zebiak, S. E. (2002) · Weather and Forecasting · doi:10.1175/1520-0434(2002)017 · Cited by 173
Constraints on climate change from a multi‐thousand member ensemble of simulations
Piani, C., Frame, D. J., Stainforth, D. A., & Allen, M. R. (2005) · Geophysical Research Letters · doi:10.1029/2005gl024452 · Cited by 152
Whetton, P., Macadam, I., Bathols, J., & O'Grady, J. (2007) · Geophysical Research Letters · doi:10.1029/2007gl030025 · Cited by 104 · cited 2×
“studied in terms of pattern-scaling using the ‘‘perfect model assumption’’ [Whetton et al., 2007].”
MethodClimate model fidelity and projections of climate change
Shukla, J., DelSole, T., Fennessy, M. J., Kinter, J. L., & Paolino, D. A. (2006) · Geophysical Research Letters · doi:10.1029/2005gl025579 · Cited by 88
Comparison of observed and multimodeled trends in annual extremes of temperature and precipitation
Kiktev, D. B., Caesar, J., Alexander, L. V., Shiogama, H., & Collier, M. A. (2007) · Geophysical Research Letters · doi:10.1029/2007gl029539 · Cited by 73
Flagged first, then by citations
Cited by
Sorted by citations
Items 101–144 of 144
Zhang, X., & Yan, X. (2014) · Tellus A Dynamic Meteorology and Oceanography · doi:10.3402/tellusa.v66.24846 · Cited by 10
Wang, L., Rohli, R. V., Yan, X., & Li, Y. (2017) · International Journal of Climatology · doi:10.1002/joc.5150 · Cited by 9
Dittes, B., Kaiser, M. K., Špačková, O., Rieger, W., Disse, M., & Straub, D. (2018) · Natural hazards and earth system sciences · doi:10.5194/nhess-18-1327-2018 · Cited by 9
Managing climate change scenarios for societal impact studies
Carbone, G. J. (2014) · Physical Geography · doi:10.1080/02723646.2013.869714 · Cited by 9
On judging the credibility of climate predictions
Otto, F. E. L., Ferro, C. A. T., Fricker, T. E., & Suckling, E. B. (2013) · Climatic Change · doi:10.1007/s10584-013-0813-5 · Cited by 9
Modelling the Impact of Climate Change on Water Systems and Implications for Decision-Makers
Adeloye, A. J., Nawaz, N. R., & Bellerby, T. J. (2013) · American Society of Civil Engineers eBooks · doi:10.1061/9780784412718.ch11 · Cited by 9
Jonko, A., Urban, N. M., & Nadiga, B. T. (2018) · Climatic Change · doi:10.1007/s10584-018-2232-0 · Cited by 9
Cantalejo, M., Cobos, M., Millares, A., & Baquerizo, A. (2024) · Scientific Reports · doi:10.1038/s41598-024-76848-2 · Cited by 9
Olschewski, P., Laux, P., Wei, J., Böker, B., Tian, Z., Sun, L., & Kunstmann, H. G. (2022) · Weather and Climate Extremes · doi:10.1016/j.wace.2022.100531 · Cited by 9
Kaspar‐Ott, I., Hertig, E., Kaspar, S., Pollinger, F., Ring, C., Paeth, H., & Jacobeit, J. (2019) · International Journal of Climatology · doi:10.1002/joc.6045 · Cited by 7
Mignot, J., Mejía, C., Sorror, C., Sylla, A., Crépon, M., & Thiria, S. (2020) · Geoscientific model development · doi:10.5194/gmd-13-2723-2020 · Cited by 8
Raju, K. S., Kumar, D. N., & Naga Babu, I. (2016) · Springer eBooks · doi:10.1007/978-981-10-2051-3_4 · Cited by 6
Criteria to evaluate the validity of multi‐model ensemble methods
Zhang, X., & Yan, X. (2018) · International Journal of Climatology · doi:10.1002/joc.5486 · Cited by 6
Climate prediction via matrix completion
Ghafarianzadeh, M., & Monteleoni, C. (2013) · National Conference on Artificial Intelligence · Cited by 6
Määttänen, A., Lameille, T., Klöck, C., Boucher, O., & Ravetta, F. (2024) · Oxford Open Climate Change · doi:10.1093/oxfclm/kgae007 · Cited by 8
Ensemble mean forecast skill and applications with the T213 ensemble prediction system
Li, S., Wang, Y., Yuan, H., Song, J., & Xu, X. Y. (2016) · Advances in Atmospheric Sciences · doi:10.1007/s00376-016-6155-2 · Cited by 5
Peßenteiner, S., Hohmann, C., Kirchengast, G., & Schöner, W. (2021) · Journal of Hydrology Regional Studies · doi:10.1016/j.ejrh.2021.100962 · Cited by 5
Ersoy, Z. B., Fıstıkoğlu, O., & Okkan, U. (2025) · Water · doi:10.3390/w17202919 · Cited by 4
Grenier, P., de Elía, R., & Chaumont, D. (2015) · Journal of Climate · doi:10.1175/jcli-d-14-00224.1 · Cited by 4
Narrowing the surface temperature range in CMIP5 simulations over the Arctic
Hao, M., Huang, J., Luo, Y. M., Chen, X., Lin, Y., Zhao, Z., & Xu, Y. (2017) · Theoretical and Applied Climatology · doi:10.1007/s00704-017-2161-2 · Cited by 4
Lackstrom, K., Carbone, G. J., Tufford, D. L., & Patel, A. (2016) · Journal of South Carolina water resources · doi:10.34068/jscwr.03.06 · Cited by 3
European wind storms, related loss potentials and changes in multi-model climate simulations
Donat, M. G. (2010) · Universitätsbibliothek der FU Berlin Hochschulschriftenstelle u. Dokumentenserver · doi:10.17169/refubium-10389 · Cited by 3
Gaba, O. U., Gaba, Y. U., & Diekkrüger, B. (2022) · Sustainability · doi:10.3390/su141912093 · Cited by 2
Gnatiuk, N. V., Radchenko, I., Davy, R., Zhao, J., & Bobylev, L. (2025) · GEOGRAPHY ENVIRONMENT SUSTAINABILITY · doi:10.24057/2071-9388-2025-3694 · Cited by 2
Zhi, X., & Ji, L. (2018) · AIP conference proceedings · doi:10.1063/1.5045425 · Cited by 2
From Many to One: Consensus Inference in a MIP
Cressie, N., Bertolacci, M., & Zammit‐Mangion, A. (2022) · Geophysical Research Letters · doi:10.1029/2022gl098277 · Cited by 2
Christiansen, B., Yang, S., & Drews, A. (2025) · Journal of Climate · doi:10.1175/jcli-d-24-0310.1 · Cited by 1
On the Concept of Climate-Resilient Design of Civil Infrastructure Systems
Laskar, J. I., & Dutta, S. (2024) · Lecture notes in civil engineering · doi:10.1007/978-3-031-63276-1_9 · Cited by 1
Majhi, A., Dhanya, C. T., Pattanayak, S., & Chakma, S. (2024) · International Journal of Climatology · doi:10.1002/joc.8665 · Cited by 1
Lanen, H. A. J. V., Prudhomme, C., Wanders, N., & Huijgevoort, M. H. J. V. (2018) · doi:10.1002/9781119017073.ch4 · Cited by 1
Identifying Coherence Across End-of-Century Montane Snow Projections in the Western United StatesPreprint
Pflug, J. M., Kumar, S. V., Livneh, B., Gutmann, E. D., Gangrade, S., & Kao, S. (2023) · doi:10.22541/essoar.169203069.91400498/v1 · Cited by 1
Impacts of climate change on thermal stratification and water quality of ReservoirsPreprint
Najari, S., & Heidarzadeh, N. (2024) · Research Square · doi:10.21203/rs.3.rs-3917984/v1 · Cited by 1
Characterizing uncertainty in expert assessments
O’Reilly, J., Brysse, K., Oppenheimer, M., & Орескес, Н. (2011)
On the Number of Effective Climate Models
Pennell, C., & Reichler, T. J. (2010)
An Enhanced Approach on Projections on Climate and Land Analysis using ARIMA Modelling
Namratha, V., & BANGALORE, U. (2020) · International Journal of Engineering Research and · doi:10.17577/ijertv9is070507
High-Resolution Gridded Climate Dataset for Data-Scarce Region
Nashwan, M. S. (2020) · doi:10.13140/rg.2.2.20199.78244
Estimating the gain of increasing the ensemble size from analytical considerations
Christiansen, B. (2024) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.4815
How Ominous is the Premonition of Future Global Warming?
Chatterjee, D., & Bhattacharya, S. (2025) · Sankhya B · doi:10.1007/s13571-025-00390-y
Szabó, A. I., Holtanová, E., & Belda, M. (2026) · Climate Services · doi:10.1016/j.cliser.2026.100721
Metadata
- Authors
- Reifen, C., & Toumi, R.
- Affiliations
- Imperial College London (GB)
- ORCID
- Toumi, R.
- Venue
- Geophysical Research Letters
- Publisher
- American Geophysical Union (AGU)
- Published
- 2009-07
- Volume
- 36
- Issue
- 13
- ISSN
- 0094-8276 (ISSN-L)
- 1944-8007
- OpenAlex
- W2064730812
- Cited by
- 144
- References
- 12
- Citations by year
- 2026: 1 · 2025: 4 · 2024: 7 · 2023: 3 · 2022: 5 · 2021: 5 · 2020: 9 · 2019: 6 · 2018: 11 · 2017: 10 · 2016: 11 · 2015: 14 · 2014: 8 · 2013: 11 · 2012: 12
- FWCI
- 10.85
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Geophysical Research Letters (publishedVersion)
- Topics
- Physical Sciences › Environmental Science › Global and Planetary Change › Climate variability and models
- Physical Sciences › Earth and Planetary Sciences › Atmospheric Science › Meteorological Phenomena and Simulations
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Climate Change Policy and Economics
- Keywords
- climate model selection, model skill, surface temperature, ensemble size, model bias, climate change projections
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review