Cited by 918Climate variability and modelsMeteorological Phenomena and SimulationsClimate Change Policy and Economics

Climate model genealogy: Generation CMIP5 and how we got there

Open access
Knutti, Reto, Masson, David, Gettelman, Andrew·2013·Geophysical Research Letters

Abstract

A new ensemble of climate models is becoming available and provides the basis for climate change projections. Here, we show a first analysis indicating that the models in the new ensemble agree better with observations than those in older ones and that the poorest models have been eliminated. Most models are strongly tied to their predecessors, and some also exchange ideas and code with other models, thus supporting an earlier hypothesis that the models in the new ensemble are neither independent of each other nor independent of the earlier generation. On the basis of one atmosphere model, we show how statistical methods can identify similarities between model versions and complement process understanding in characterizing how and why a model has changed. We argue that the interdependence of models complicates the interpretation of multimodel ensembles but largely goes unnoticed.

Verified 2026-10-06 · 6 references not checked yet

Integrity signals

Registry

Crossref · 10.1002/grl.50256

Cites

11 of 17 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

0 of 9 cited sources checked · 0 supported · 0 flagged

  • Findingnone given

    Some CMIP5 models exchange ideas and code with other models.

    “and some also exchange ideas and code with other models”
    Quote in the paperSubstantial claim
  • Findingown data

    The CMIP5 models agree better with observations than the older CMIP2 and CMIP3 models.

    “Here, we show a first analysis indicating that the models in the new ensemble agree better with observations than those in older ones”
    • Also stated in: § 2. Results · plain
      “CMIP5 continues the trend of better agreement with observations [Reichler and Kim, 2008], with the mean distance from observations reduced by approximately 20% from CMIP3 to CMIP5.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Reichler and Kim, 2008

      Not checked in the free run.

  • Findingnone given

    Most CMIP5 models are strongly tied to their predecessors.

    “Most models are strongly tied to their predecessors”
    Quote in the paperSubstantial claim
  • Findingown data

    Statistical methods can identify similarities between model versions and complement process understanding in characterizing how and why a model has changed.

    “On the basis of one atmosphere model, we show how statistical methods can identify similarities between model versions and complement process understanding in characterizing how and why a model has changed.”
    Quote in the paperSubstantial claim
  • Findingnone given

    The distance between models from the same institutions is often a factor of three to ten smaller than the distance to other models.

    “The distance between models from the same institutions is often a factor of three to ten smaller than that to other models.”
    Quote in the paperSubstantial claim
  • May combine two claims. 10
  • The quote only partly states this claim. 1
  • Classified as probably not a substantial claim. 7
  • May combine two claims. The quote only partly states this claim.

    Findingnone given

    The poorest models in the CMIP ensemble have been eliminated or have improved the most.

    “and that the poorest models have been eliminated”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The CAM5 experiments cluster together, with three single perturbation experiments similar to the base CAM5 experiment.

    “As is clear from the tree shown in Figure 2a, the CAM5 experiments cluster together, with three single perturbation experiments similar to the base CAM5 experiment.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingcitation

    Different observation and reanalysis data sets cluster together, and the rankings are nearly identical irrespective of the chosen data set.

    “as shown already by MK11, the different observation and reanalysis data set cluster together (see Figure 1a), and the rankings in Figure 3 are nearly identical irrespective of the chosen data set.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Masson and Knutti, 2011

      Not checked in the free run.

  • May combine two claims.

    Findingreasoning

    For projected changes, some models remain close, while other similarities do not persist.

    “For the projected changes, some models remain close (e.g., those which share a similar atmosphere), whereas other similarities do not persist (e.g., if the new version of a model has a different climate sensitivity).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The final change in the shallow convection introduces the largest change, although it brings CAM5 closer to the original CAM4 in some variables.

    “The final change in the shallow convection introduces the largest change (last step in panel c), although it brings CAM5 closer to the original CAM4 in some variables (panel b).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    The CMIP5 models are neither independent of each other nor independent of the earlier generation of models.

    “thus supporting an earlier hypothesis that the models in the new ensemble are neither independent of each other nor independent of the earlier generation”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    The results point to remarkable consistency and robustness in many aspects of simulated present-day and future climate, but also suggest that convergence to reality is slow and radical breakthroughs are hard to achieve.

    “The results point to a remarkable consistency and robustness in many aspects of simulated present day and future climate, but it also suggests that convergence to reality is slow and radical breakthroughs are hard to achieve.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    Confidence is greatest in those aspects of climate change that we understand and can link back to known physical processes and simpler models and concepts.

    “Confidence is greatest in those aspects of climate change that we understand and can link back to known physical processes and simpler models and concepts (e.g., the global energy balance).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Transparency in the model development process is helpful in understanding model evaluation and projections.

    “We argue that transparency in the model development process is helpful in understanding model evaluation and projections and contributes to that insight.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductnone given

    All results are based only on model output and assume no knowledge about the structure, parameterizations, or code of any model.

    “Note that all results presented here are only based on model output; they assume no knowledge about the structure, parameterizations, or code of any model.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Study design and conductnone given

    The methodological choices made for the similarity metric do not affect the main conclusions.

    “None of those choices affect the main conclusions.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Interpretationreasoning

    Confidence in model projections does not come from the sheer amount of code and data and cannot be demonstrated by repeated verification.

    “Confidence in model projections does not come from the sheer amount of code and data and cannot be demonstrated by repeated verification.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Linking model performance metrics to model quality or skill is difficult, subjective, and strongly metric dependent.

    “but with the strong caveat that linking model performance metrics to model quality or skill is difficult, subjective, and strongly metric dependent [Gleckler et al., 2008]”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Gleckler et al., 2008

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    One reason some models are so similar is because they share common code.

    “We propose that one reason some models are so similar is because they share common code.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    Model similarities result from models evolving from their ancestors by modification and by exchange of ideas and code with other groups.

    “MK11 argued that such similarities result from the fact that models evolve from their ancestors by modification and by exchange of ideas and code with other groups.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Masson and Knutti, 2011

      Not checked in the free run.

15 of 15
  • The authors state this as an assumption.

    The models in an ensemble are approximately a representative sample of uncertainty in how to best describe the climate system given limited observations, imperfect understanding, and finite computational resources.

    “This assumes that the models are approximately a representative sample of our uncertainty in how to best describe the climate system given limited observations, imperfect understanding, and finite computational resources [Knutti, 2008;Yokohata et al., 2012].”
  • The authors state this as an assumption.

    There are not too many similarities among models that would bias the results of an ensemble.

    “It also assumes that there are not too many similarities that would bias the results.”
2 of 2

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Overall distance metric is described two different ways

    Minor

    The methods section says the combined temperature-precipitation distance used for Figure 3 is a mean square, while the Figure 3 caption calls it a root mean square. Taking the square root changes the reported distance values.

1 of 1

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Knutti, R., Masson, D., & Gettelman, A.
Affiliations
  • ETH Zurich (CH)
  • Federal Office of Meteorology and Climatology MeteoSwiss (CH)
  • NSF National Center for Atmospheric Research (US)
Corresponding author
Knutti, Reto
Venue
Geophysical Research Letters
Published
2013-03-26
Volume
40
Issue
6
Pages
1194-1199
ISSN
  • 0094-8276 (ISSN-L)
  • 1944-8007
OpenAlex
W1796961055
Cited by
918
References
17
Citations by year
2026: 37 · 2025: 42 · 2024: 54 · 2023: 73 · 2022: 114 · 2021: 126 · 2020: 109 · 2019: 64 · 2018: 76 · 2017: 67 · 2016: 51 · 2015: 55 · 2014: 42 · 2013: 7
FWCI
39.41
Type
journal article
Language
en
Open access
Locations
  • Geophysical Research Letters (publishedVersion)
  • Repository for Publications and Research Data (ETH Zurich) (submittedVersion, other-oa)
  • ETH Zürich Research Collection
Topics
  • Physical Sciences › Environmental Science › Global and Planetary Change › Climate variability and models
  • Physical Sciences › Earth and Planetary Sciences › Atmospheric Science › Meteorological Phenomena and Simulations
  • Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Climate Change Policy and Economics
Keywords
CMIP5, multi-model ensemble, model validation against observations, climate change projections, statistical model comparison

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-06.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-06.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review