Earth System Model Evaluation Tool (ESMValTool) v2.0 – an extended set of large-scale diagnostics for quasi-operational and comprehensive evaluation of Earth system models in CMIP
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
The Earth System Model Evaluation Tool (ESMValTool) is a community diagnostics and performance metrics tool designed to improve comprehensive and routine evaluation of Earth system models (ESMs) participating in the Coupled Model Intercomparison Project (CMIP). It has undergone rapid development since the first release in 2016 and is now a well-tested tool that provides end-to-end provenance tracking to ensure reproducibility. It consists of (1) an easy-to-install, well-documented Python package providing the core functionalities (ESMValCore) that performs common preprocessing operations and (2) a diagnostic part that includes tailored diagnostics and performance metrics for specific scientific applications. Here we describe large-scale diagnostics of the second major release of the tool that supports the evaluation of ESMs participating in CMIP Phase 6 (CMIP6). ESMValTool v2.0 includes a large collection of diagnostics and performance metrics for atmospheric, oceanic, and terrestrial variables for the mean state, trends, and variability. ESMValTool v2.0 also successfully reproduces figures from the evaluation and projections chapters of the Intergovernmental Panel on Climate Change (IPCC) Fifth Assessment Report (AR5) and incorporates updates from targeted analysis packages, such as the NCAR Climate Variability Diagnostics Package for the evaluation of modes of variability, the Thermodynamic Diagnostic Tool (TheDiaTo) to evaluate the energetics of the climate system, as well as parts of AutoAssess that contains a mix of top–down performance metrics. The tool has been fully integrated into the Earth System Grid Federation (ESGF) infrastructure at the Deutsches Klimarechenzentrum (DKRZ) to provide evaluation results from CMIP6 model simulations shortly after the output is published to the CMIP archive. A result browser has been implemented that enables advanced monitoring of the evaluation results by a broad user community at much faster timescales than what was possible in CMIP5.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Eyring, V., Bony, S., Meehl, G. A., Senior, C. A., Stevens, B., Stouffer, R. J., & Taylor, K. E. (2016) · Geoscientific Model Development · doi:10.5194/gmd-9-1937-2016 · Cited by 11,981
Self-citationPrimary production of the biosphere: Integrating terrestrial and oceanic components
Field, C. B., Behrenfeld, M. J., Randerson, J. T., & Falkowski, P. (1998) · Science · doi:10.1126/science.281.5374.237 · Cited by 6,371
Climate–Carbon Cycle Feedback Analysis: Results from the C4MIP Model Intercomparison
Friedlingstein, P., Cox, P., Betts, R., Bopp, L., von Bloh, W., Brovkin, V., Cadule, P., Doney, S., Eby, M., Fung, I., et al. (2006) · Journal of Climate · doi:10.1175/jcli3800.1 · Cited by 2,902 · cited 1×
“These sinks are affected by atmospheric CO2 and climate change, thus introducing feedbacks between the climate system and the carbon cycle (Arora et al., 2013; Friedlingstein et al., 2006).”
BackgroundCoumou, D., & Rahmstorf, S. (2012) · Nature Climate Change · doi:10.1038/nclimate1452 · Cited by 2,289 · cited 1×
“Model Dev., 13, 3383–3438, 2020 Models are indeed characterized by large negative bias over the Euro-Atlantic sector, a region where blocking is often at the origin of extreme events, leading to cold spells in winter and heat waves in summer (Coumou and Rahmstorf, 2012; Sillmann et al., 2011).”
BackgroundMorice, C. P., Kennedy, J. J., Rayner, N. A., & Jones, P. D. (2012) · Journal of Geophysical Research: Atmospheres · doi:10.1029/2011jd017187 · Cited by 1,657 · cited 2×
“…06.ncl ipcc_ar5/ch09_fig09_ 06_collect.ncl ipcc_ar5/ch09_ fig09_14.py tas ERA-Interim (Tier 3; Dee et al., 2011) HadCRUT4 (Tier 2; Morice et al., 2012) tos HadISST (Tier 2; Rayner et al., 2003) swcre lwcre netcre rlut CERES-EBAF (Tier 2; Loeb et al., 2018) pr GPCP-SG (Tier 1;…”
MethodAvailable potential energy and the maintenance of the general circulation.
Lorenz, E. N. (1955) · Tellus A Dynamic Meteorology and Oceanography · doi:10.3402/tellusa.v7i2.8796 · Cited by 1,227 · cited 1×
“11 shows the baroclinic conversion of the available potential energy (APE) to kinetic energy (KE) and ultimately its dissipation through frictional heating (Lorenz, 1955; Lucarini et al., 2014).”
BackgroundSea Surface Temperature Variability: Patterns and Mechanisms
Deser, C., Alexander, M. A., Xie, S.-P., & Phillips, A. S. (2010) · Annual Review of Marine Science · doi:10.1146/annurev-marine-120408-151453 · Cited by 1,135
Self-citationTaking climate model evaluation to the next level
Eyring, V., Cox, P. M., Flato, G. M., Gleckler, P. J., Abramowitz, G., Caldwell, P., Collins, W. D., Gier, B. K., Hall, A. D., Hoffman, F. M., et al. (2019) · Nature Climate Change · doi:10.1038/s41558-018-0355-y · Cited by 748
Self-citationVersion 2 of the EUMETSAT OSI SAF and ESA CCI sea-ice concentration climate data records
Lavergne, T., Sørensen, A. M., Kern, S., Tonboe, R., Notz, D., Aaboe, S., Bell, L., Dybkjær, G., Eastwood, S., Gabarro, C., et al. (2019) · The Cryosphere · doi:10.5194/tc-13-49-2019 · Cited by 542 · cited 3×
“…et al., 2009) recipe_sea_ ice_drift.yml 3.3.4 Recipe for sea ice drift–strength evaluation. seaice_drift/ seaice_drift.py siconc OSI-450-nh (Tier 2; Lavergne et al., 2019) sivol PIOMAS (Tier 2; Zhang and Rothrock, 2003) sispeed IABP (Tier 2; Tschudi et al., 2016) recipe_SeaIce.yml 3.3.4 Recipe…”
BackgroundInfluentialSustained ocean changes contributed to sudden Antarctic sea ice retreat in late 2016
Meehl, G. A., Arblaster, J. M., Chung, C. T. Y., Holland, M. M., DuVivier, A., Thompson, L., Yang, D., & Bitz, C. M. (2019) · Nature Communications · doi:10.1038/s41467-018-07865-9 · Cited by 341
Cited by
The Community Earth System Model Version 2 (CESM2)
Danabasoglu, G., Lamarque, J. ‐., Bacmeister, J., Bailey, D. A., DuVivier, A. K., Edwards, J., Emmons, L. K., Fasullo, J., Garcia, R., Gettelman, A., et al. (2020) · Journal of Advances in Modeling Earth Systems · doi:10.1029/2019ms001916 · Cited by 3,070
Self-citationClimate model projections from the Scenario Model Intercomparison Project (ScenarioMIP) of CMIP6
Tebaldi, C., Debeire, K., Eyring, V., Fischer, E., Fyfe, J., Friedlingstein, P., Knutti, R., Lowe, J., O'Neill, B., Sanderson, B., et al. (2021) · Earth System Dynamics · doi:10.5194/esd-12-253-2021 · Cited by 843
Self-citationMeehl, G. A., Senior, C. A., Eyring, V., Flato, G., Lamarque, J.-F., Stouffer, R. J., Taylor, K. E., & Schlund, M. (2020) · Science Advances · doi:10.1126/sciadv.aba1981 · Cited by 823
Self-citationThe physics of climate variability and climate change
Ghil, M., & Lucarini, V. (2020) · Reviews of Modern Physics · doi:10.1103/revmodphys.92.035002 · Cited by 416
Self-citationThe three major axes of terrestrial ecosystem function
Migliavacca, M., Musavi, T., Mahecha, M. D., Nelson, J. A., Knauer, J., Baldocchi, D. D., Perez-Priego, O., Christiansen, R., Peters, J., Anderson, K., et al. (2021) · Nature · doi:10.1038/s41586-021-03939-9 · Cited by 299
Self-citation
Metadata
- Authors
- Eyring, V., Bock, L., Lauer, A., Righi, M., Schlund, M., Andela, B., Arnone, E., Bellprat, O., Brötz, B., Caron, L.-P., Carvalhais, N., Cionni, I., Cortesi, N., Crezee, B., Davin, E. L., Davini, P., Debeire, K., de Mora, L., Deser, C., Docquier, D., Earnshaw, P., Ehbrecht, C., Gier, B. K., Gonzalez-Reviriego, N., Goodman, P., Hagemann, S., Hardiman, S., Hassler, B., Hunter, A., Kadow, C., Kindermann, S., Koirala, S., Koldunov, N., Lejeune, Q., Lembo, V., Lovato, T., Lucarini, V., Massonnet, F., Müller, B., Pandde, A., Pérez-Zanón, N., Phillips, A., Predoi, V., Russell, J., Sellar, A., Serva, F., Stacke, T., Swaminathan, R., Torralba, V., Vegas-Regidor, J., von Hardenberg, J., Weigel, K., & Zimmermann, K.
- Venue
- Geoscientific Model Development
- Publisher
- Copernicus GmbH
- Published
- 2020-07-30
- Volume
- 13
- Issue
- 7
- Pages
- 3383-3438
- ISSN
- 1991-959X (ISSN-L)
- 1991-9603
- OpenAlex
- W3046387308
- Cited by
- 153
- References
- 10
- FWCI
- 9.27
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Earth System Model Evaluation Tool (ESMValTool) v2.0 – an extended set of large-scale diagnostics for quasi-operational and comprehensive evaluation of Earth system models in CMIP. https://app.cochat.ai/papers/10.5194/gmd-13-3383-2020
- The paper
- Eyring, V., Bock, L., Lauer, A., Righi, M., Schlund, M., Andela, B., Arnone, E., Bellprat, O., Brötz, B., Caron, L.-P., Carvalhais, N., Cionni, I., Cortesi, N., Crezee, B., Davin, E. L., Davini, P., Debeire, K., de Mora, L., Deser, C., . . . Zimmermann, K. (2020). Earth System Model Evaluation Tool (ESMValTool) v2.0 – an extended set of large-scale diagnostics for quasi-operational and comprehensive evaluation of Earth system models in CMIP. Geoscientific Model Development. https://doi.org/10.5194/gmd-13-3383-2020
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.