How reliable are climate models?
Open accessAbstract
How much can we trust model-based projections of future anthropogenic climate change? This review attempts to give an overview of this important but difficult topic by using three main lines of evidence: the skill of models in simulating present-day climate, intermodel agreement on future climate changes, and the ability of models to simulate climate changes that have already occurred. A comparison of simulated and observed present-day climates shows good agreement for many basic variables, particularly at large horizontal scales, and a tendency for biases to vary in sign between different models, but there is a risk that these features might be partly a result of tuning. Overall, the connection between model skill in simulating present-day climate and the skill in simulating future climate changes is poorly known. An intercomparison of future climate changes between models shows a better agreement for changes in temperature than that for precipitation and sea level pressure, but some aspects of change in the latter two variables are also quite consistent between models. A comparison of simulations with observed climate changes is, in principle, a good test for the models, but there are several complications. Nonetheless, models have skilfully simulated many large-scale aspects of observed climate changes, including but not limited to the evolution of the global mean surface air temperature in the 20th century. Furthermore, although there is no detailed agreement between the simulated and observed geographical patterns of change, the grid box scale temperature, precipitation and pressure changes observed during the past half-century generally fall within the range of model results. Considering the difficulties associated with other sources of information, the variation of climate changes between different models is probably the most meaningful measure of uncertainty that is presently available. In general, however, this measure is more likely to underestimate than overestimate the actual uncertainty.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
A weak link between current model performance and future projections has been reported in many studies.
“many studies have found only a weak relation between present-day model performance and future projections (Ra ¨isa ¨nen 2007; Whetton et al. 2007;Jun et al. 2008;Knutti et al. 2010;Scherrer 2010)”
From Risks of Model Weighting in Multimodel Climate Projections (2010) · cites this paper as Ra ¨isa ¨nen 2007
Section 3.3 finds little evidence of a relationship between simulated present-day mean temperatures and projected temperature changes outside high-latitude sea areas, and says earlier simulations support that conclusion. The paper describes the broader connection between present-day model performance and future-change skill as poorly understood, rather than establishing that many studies found a weak relationship across future projections generally. (LLM, conf=0.84)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
No references could be resolved yet.
Research works printed but not linked: 36
- J. Climate, in press.
- Annan, J. D., Hargreaves, J. C., Ohgaito, R., Abe-Ouchi, A. and Emori, S. 2005. Efficiently constraining climate sensitivity with paleocli- mate simulations. Scientific Online Letters on the Atmosphere 1, 181- 184.
- Braganza, K., Karoly, D. J. and Arblaster, J. M. 2004. Diurnal tem- perature range as an index of global climate change during the twentieth century. Geophys. Res. Lett. 31, D13217, doi:10.1029/ 2004GL019998. · DOI
- Broccoli, A. J., Dixon, K. W., Delworth, T. L., Knutson, T. R., Stouffer, R. J. and Zeng, F. 2003. Twentieth-century temperature and precipitation trends in ensemble climate simulations including natural and anthropogenic forcing. J. Geophys. Res. 108, D4798, doi:10.1029/2003JD003812. · DOI
- Cubasch, U., Meehl, G. A., Boer, G. J., Stouffer, R. J., Dix, M. and co-authors. 2001. Projections of future climate change. In: Climate change 2001. The Scientific Basis (eds J. T. Houghton, Y. Ding, D. J. Griggs, M. Noguer, P. J. van der Linden, X. Dai, K. Maskell and C. A. Johnson). Cambridge University Press, Cambridge, United Kingdom and New York, NY, USA, 525-582.
- Folland, C. K., Karl, T. R., Christy, J. R., Clarke, R. A., Gruza, G. V. and co-authors. 2001a. Observed climate variability and change. In: Climate change 2001. The Scientific Basis (eds J. T. Houghton, Y. Ding, D. J. Griggs, M. Noguer, P. J. van der Linden, X. Dai, K. Maskell, and C. A. Johnson). Cambridge University Press, Cambridge, United Kingdom and New York, NY, USA, 99-181.
- Forest, C. E., Stone, P. H. and Sokolov, A. P. 2006. Estimated PDFs of cli- mate system properties including natural and anthropogenic forcing. Geophys. Res. Lett. 33, L01705, doi:10.1029/2005GL023977. · DOI
- Frame, D. J., Booth, B. B., Kettleborough, J. A., Stainforth, D. A., Gregory, J. M. and co-authors. 2005. Constraining climate fore- casts: the role of prior assumptions. Geophys. Res. Lett. 32, L09702, doi:10.1029/2004GL022241. · DOI
- Gillett, N. P., Weaver, A. J., Zwiers, F. W. and Wehner, M. F. 2004. Detection of volcanic influence on global precipitation. Geophys. Res. Lett. 31, L12217, doi: 10.1029/2004GL020044. · DOI
- Gillett, N. P., Allan, R. J. and Ansell, T. J. 2005. Detection of external influence on sea level pressure with a multimodel ensemble. Geophys. Res. Lett. 32, L19714, doi: 10.1029/2005GL023640. · DOI
- Giorgi, F. and Mearns, L. O. 2003. Probability of regional climate change based on the Reliability Ensemble Averaging (REA) method. Geo- phys. Res. Lett. 30, L1629, doi:10.1029/2003GL017130. · DOI · Paper page
- Giorgi, F., Hewitson, B., Christensen, J., Hulme, M., Von Storch, H. and co-authors. 2001. Regional climate information -evaluation and projections. In: Climate change 2001. The Scientific Basis (eds J. T. Houghton, Y. Ding, D. J. Griggs, M. Noguer, P. J. van der Linden, X. Dai, K. Maskell and C. A. Johnson). Cambridge University Press, Cambridge, United Kingdom and New York, NY, USA, 583-638.
- Gregory, J. M., Stott, P. A., Cresswell, D. J., Rayner, N. A., Gordon, C. and Sexton, D. M. H. 2002a. Recent and future changes in Arctic sea ice simulated by the HadCM3 AOGCM. Geophys. Res. Lett. 29, L2175, doi:10.1029/2001GL014575. · DOI · Paper page
- Hansen, J., Sato, M., Ruedy, R., Nazarenko, L., Lacis, A. and co-authors. 2005. Efficacy of climate forcings. J. Geophys. Res. 110, D18104, doi:10.1029/2005JD005776. · DOI
- Hartmann, D. L. 1994. Global Physical Climatology. Academic Press, San Diego, CA, USA, 411 pp.
- Houghton, J. 2004. Global Warming. The Complete Briefing, 3rd Edition. Cambridge University Press, Cambridge, 382 pp.
- Houghton, J. T., Ding, Y., Griggs, D. J., Noguer, M., van der Linden P. J. and Xiaosu, D. (eds) 2001. Climate Change 2001. The Scientific Basis. Cambridge University Press, Cambridge, United Kingdom and New York, NY, USA, 881 pp.
- IPCC WG1 2004. Workshop report, IPCC Working Group I Workshop on Climate Sensitivity, Paris, France, 26-29 July 2004, 177 pp.
- Kattenberg, A., Giorgi, F., Grassl, H., Meehl, G. A., Mitchell, J. F. B. and co-authors. 1996. Climate models -projections of future cli- mate. Climate change 1995. The Science of Climate Change (eds J. T. Houghton, L. G. Meira Filho, B. A. Cllander, N. Harris, A. Kattenberg and K. Maskell). Cambridge University Press, Cambridge, 285-357.
- Lambert, F. H., Stott, P. A., Allen, M. R. and Palmer, M. A. 2004. De- tection and attribution of changes in 20 th century land precipitation. Geophys. Res. Lett. 31, L10203, doi:10.1029/2004GL019545. · DOI
- Lambert, F. H., Gillett, N. P., Stone, D. A. and Huntingford, C. 2005. Attribution studies of observed land precipitation changes with nine coupled models. Geophys. Res. Lett. 32, L18704, doi:10.1029/2005GL023654. · DOI
- Levitus, S., Antonov, J. and Boyer, T. 2005. Warming of the world ocean, 1955-2003. Geophys. Res. Lett. 32, L02604, doi:10.1029/2004GL021592. · DOI
- McAvaney, B. J., Covey, C., Joussaume, S., Kattsov, V., Kitoh, A. and co-authors. 2001. Model evaluation. In: Climate change 2001. The Scientific Basis (eds J. T. Houghton, Y. Ding, D. J. Griggs, M. Noguer, P. J. van der Linden, X. Dai, K. Maskell and C. A. Johnson). Cambridge University Press, Cambridge, United Kingdom and New York, NY, USA, 471-523.
- McGuffie, K. and Henderson-Sellers, A. 2005. A Climate Modelling Primer, 3rd Edition. John Wiley & Sons, Chichester, 296 pp.
- Mitchell, J. F. B., Manabe, S., Tokioka, T. and Meleshko, V. 1990. Equi- librium climate change -and its implications for the future. In: Cli- mate Change. The IPCC Scientific Assessment (eds J. T. Houghton, G. J. Jenkins and J. J. Ephraums). Cambridge University Press, Cam- bridge, United Kingdom, 131-172.
- Nakićenović, N. and Swart, R. (eds) 2000. Emissions Scenarios. A Spe- cial Report of Working Group III of the Intergovernmental Panel on Climate Change. Cambridge University Press, Cambridge, United Kingdom and New York, NY, USA, 599 pp.
- Neelin, J. D., Münnich, M., Su, H., Meyerson, J. E. and Holloway, C. E. 2006. Tropical drying trends in global warming models and observa- tions. Proc. Nat. Acd. Sci. 103, 6110-6115.
- Piani, C., Frame, D. J., Stainforth, D. A. and Allen, M. R. 2005. Constraints on climate change from a multi-thousand mem- ber ensemble of simulations. Geophys. Res. Lett. 32, L23825, doi:10.1029/2005GL024452. · DOI
- Ramaswamy, V., Boucher, O., Haigh, J., Hauglustaine, D., Haywood, J. and co-authors. 2001. Radiative forcing of climate change. In: Climate change 2001. The Scientific Basis (eds J. T. Houghton, Y. Ding, D. J. Griggs, M. Noguer, P. J. van der Linden, X. Dai, K. Maskell, and C. A. Johnson), Cambridge University Press, Cambridge, United Kingdom and New York, NY, USA, 349-416.
- Santer, B. D., Wigley, T. M. L., Simmons, A. J., Kållberg, P. W., Kelly, G. A. and co-authors. 2004. Identification of anthropogenic climate change using a second-generation reanalysis. J. Geophys. Res. 109, D21104, doi:10.1029/2004JD005075. · DOI
- Selten, F. M., Branstator, G. W., Dijkstra, H. A. and Kliphuis, M. 2004. Tropical origins for recent and future Northern Hemisphere climate change. Geophys. Res. Lett. 31, L21205, doi:10.1029/2004GL020739. · DOI
- Stott, P. A., Kettleborough, J. A. and Allen, M. R. 2006b. Uncertainty in continental-scale temperature predictions. Geophys. Res. Lett. 33, L02708, doi:10.1029/2005GL024423. · DOI
- Trenberth, K. E. (ed.) 1992. Climate System Modeling. Cambridge Uni- versity Press, Cambridge, 788 pp.
- Vose, R. S., Easterling, D. R. and Gleason, B. 2005. Maximum and minimum temperature trends for the globe: an update through 2004. Geophys. Res. Lett. 32, L23822, doi:10.1029/2005GL024379. · DOI
- Wigley, T. M. L., Ammann, C. M., Santer, B. D. and Raper, S. C. B. 2005. Effect of climate sensitivity on the response to volcanic forcing. J. Geophys. Res. 110, D09107, doi:10.1029/2004JD005557. · DOI
- Yin, J. H., 2005. A consistent poleward shift of the storm tracks in simulations of 21st century climate. Geophys. Res. Lett. 32, L18701, doi:10.1029/2005GL023684. · DOI
Cited by
Sorted by citations
Risks of Model Weighting in Multimodel Climate Projections
Weigel, A. P., Knutti, R., Liniger, M. A., & Appenzeller, C. (2010) · Journal of Climate · doi:10.1175/2010jcli3594.1 · Cited by 386 · see citing works
- Authors
- Räisänen, J.
- Affiliations
- University of Helsinki (FI)
- Corresponding author
- Räisänen, Jouni
- ORCID
- Räisänen, Jouni
- Venue
- Tellus A: Dynamic Meteorology and Oceanography
- Publisher
- Stockholm University Press
- Published
- 2007-01-01
- Volume
- 59
- Issue
- 1
- Pages
- 2
- ISSN
- 0280-6495 (ISSN-L)
- 1600-0870
- OpenAlex
- W2075532188
- Cited by
- 356
- References
- 0
- Citations by year
- 2026: 8 · 2025: 16 · 2024: 16 · 2023: 11 · 2022: 13 · 2021: 16 · 2020: 7 · 2019: 18 · 2018: 7 · 2017: 22 · 2016: 18 · 2015: 26 · 2014: 21 · 2013: 33 · 2012: 28
- FWCI
- 10.68
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Tellus A Dynamic Meteorology and Oceanography (publishedVersion, cc-by)
- Funders
- U.S. Department of Energy
- Office of Science
- Lawrence Livermore National Laboratory
- Topics
- Physical Sciences › Environmental Science › Global and Planetary Change › Climate variability and models
- Physical Sciences › Earth and Planetary Sciences › Atmospheric Science › Meteorological Phenomena and Simulations
- Physical Sciences › Environmental Science › Global and Planetary Change › Climate Change and Environmental Impact
- Keywords
- model skill, model calibration, climate change detection, model uncertainty, global mean surface air temperature, precipitation change, sea level pressure, 20th century climate change, model validation against observations
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
