The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
A comprehensive benchmarking system for evaluating global vegetation models
Open accessAbstract
We present a benchmark system for global vegetation models. This system provides a quantitative evaluation of multiple simulated vegetation properties, including primary production; seasonal net ecosystem production; vegetation cover; composition and height; fire regime; and runoff. The benchmarks are derived from remotely sensed gridded datasets and site-based observations. The datasets allow comparisons of annual average conditions and seasonal and inter-annual variability, and they allow the impact of spatial and temporal biases in means and variability to be assessed separately. Specifically designed metrics quantify model performance for each process, and are compared to scores based on the temporal or spatial mean value of the observations and a "random" model produced by bootstrap resampling of the observations. The benchmark system is applied to three models: a simple light-use efficiency and water-balance model (the Simple Diagnostic Biosphere Model: SDBM), the Lund-Potsdam-Jena (LPJ) and Land Processes and eXchanges (LPX) dynamic global vegetation models (DGVMs). In general, the SDBM performs better than either of the DGVMs. It reproduces independent measurements of net primary production (NPP) but underestimates the amplitude of the observed CO2 seasonal cycle. The two DGVMs show little difference for most benchmarks (including the inter-annual variability in the growth rate and seasonal cycle of atmospheric CO2), but LPX represents burnt fraction demonstrably more accurately. Benchmarking also identified several weaknesses common to both DGVMs. The benchmarking system provides a quantitative approach for evaluating how adequately processes are represented in a model, identifying errors and biases, tracking improvements in performance through model development, and discriminating among models. Adoption of such a system would do much to improve confidence in terrestrial model predictions of climate change impacts and feedbacks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Ecological and Evolutionary Responses to Recent Climate Change
Parmesan, C. (2006) · Annual Review of Ecology, Evolution, and Systematics · doi:10.1146/annurev.ecolsys.37.091305.110100 · Cited by 8,652
Climate–Carbon Cycle Feedback Analysis: Results from the C4MIP Model Intercomparison
Friedlingstein, P., Cox, P., Betts, R., Bopp, L., von Bloh, W., Brovkin, V., Cadule, P., Doney, S., Eby, M., Fung, I., et al. (2006) · Journal of Climate · doi:10.1175/jcli3800.1 · Cited by 2,902
Interannual variability in global biomass burning emissions from 1997 to 2004
van der Werf, G. R., Randerson, J. T., Giglio, L., Collatz, G. J., Kasibhatla, P. S., & Arellano, A. F. (2006) · Atmospheric Chemistry and Physics · doi:10.5194/acp-6-3423-2006 · Cited by 1,656 · cited 1×
“The GFED3 burnt fraction dataset, used here, is a comparatively recent update of an earlier burnt fraction dataset (GFED2: van der Werf et al., 2006 the annual average burnt fraction changes from 1.58 (against GFED3) to 1.91 (against GFED2) for LPJ and from 0.85 (GFED3) to 0.92 (GFED2) for LPX…”
MethodInfluentialQuantification of modelling uncertainties in a large ensemble of climate change simulations.
Murphy, J. M., Sexton, D. M. H., Barnett, D. N., Jones, G. S., Webb, M. J., Collins, M., & Stainforth, D. A. (2004) · Nature · doi:10.1038/nature02771 · Cited by 1,655
A climate-change risk analysis for world ecosystems
Scholze, M., Knorr, W., Arnell, N. W., & Prentice, I. C. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0601816103 · Cited by 756
Self-citationThonicke, K., Venevsky, S., Sitch, S., & Cramer, W. (2001) · Global Ecology and Biogeography · doi:10.1046/j.1466-822x.2001.00175.x · Cited by 684
Giglio, L., Csiszar, I., & Justice, C. O. (2006) · Journal of Geophysical Research: Biogeosciences · doi:10.1029/2005jg000142 · Cited by 662
Cited by
The status and challenge of global fire modelling
Hantson, S., Arneth, A., Harrison, S. P., Kelley, D. I., Prentice, I. C., Rabin, S. S., Archibald, S., Mouillot, F., Arnold, S. R., Artaxo, P., et al. (2016) · Biogeosciences · doi:10.5194/bg-13-3359-2016 · Cited by 460
Self-citationThe International Land Model Benchmarking (ILAMB) System: Design, Theory, and Implementation
Collier, N., Hoffman, F. M., Lawrence, D. M., Keppel‐Aleks, G., Koven, C. D., Riley, W. J., Mu, M., & Randerson, J. T. (2018) · Journal of Advances in Modeling Earth Systems · doi:10.1029/2018ms001354 · Cited by 447
Global gridded crop model evaluation: benchmarking, skills, deficiencies and implications
Müller, C., Elliott, J., Chryssanthacopoulos, J., Arneth, A., Balkovic, J., Ciais, P., Deryng, D., Folberth, C., Glotter, M., Hoek, S., et al. (2017) · Geoscientific Model Development · doi:10.5194/gmd-10-1403-2017 · Cited by 358
Fisher, R. A., Muszala, S., Verteinstein, M., Lawrence, P., Xu, C., McDowell, N. G., Knox, R. G., Koven, C., Holm, J., Rogers, B. M., et al. (2015) · Geoscientific Model Development · doi:10.5194/gmd-8-3593-2015 · Cited by 337
LPJmL4 – a dynamic global vegetation model with managed land – Part 1: Model description
(2018) · doi:10.5194/gmd-11-1343-2018 · Cited by 333
Metadata
- Authors
- Kelley, D. I., Prentice, I. C., Harrison, S. P., Wang, H., Simard, M., Fisher, J. B., & Willis, K. O.
- Venue
- Biogeosciences
- Publisher
- Copernicus GmbH
- Published
- 2013-05-17
- Volume
- 10
- Issue
- 5
- Pages
- 3313-3340
- ISSN
- 1726-4170 (ISSN-L)
- 1726-4189
- OpenAlex
- W2010689314
- Cited by
- 163
- References
- 7
- FWCI
- 11.08
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A comprehensive benchmarking system for evaluating global vegetation models. https://app.cochat.ai/papers/10.5194/bg-10-3313-2013
- The paper
- Kelley, D. I., Prentice, I. C., Harrison, S. P., Wang, H., Simard, M., Fisher, J. B., & Willis, K. O. (2013). A comprehensive benchmarking system for evaluating global vegetation models. Biogeosciences. https://doi.org/10.5194/bg-10-3313-2013
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.