The DOI matches its Crossref record; 123 of the 123 references it cites were found in a registry or an index.
A framework for benchmarking land models
Open accessAbstract
Abstract. Land models, which have been developed by the modeling community in the past few decades to predict future states of ecosystems and climate, have to be critically evaluated for their performance skills of simulating ecosystem responses and feedback to climate change. Benchmarking is an emerging procedure to measure performance of models against a set of defined standards. This paper proposes a benchmarking framework for evaluation of land model performances and, meanwhile, highlights major challenges at this infant stage of benchmark analysis. The framework includes (1) targeted aspects of model performance to be evaluated, (2) a set of benchmarks as defined references to test model performance, (3) metrics to measure and compare performance skills among models so as to identify model strengths and deficiencies, and (4) model improvement. Land models are required to simulate exchange of water, energy, carbon and sometimes other trace gases between the atmosphere and land surface, and should be evaluated for their simulations of biophysical processes, biogeochemical cycles, and vegetation dynamics in response to climate change across broad temporal and spatial scales. Thus, one major challenge is to select and define a limited number of benchmarks to effectively evaluate land model performance. The second challenge is to develop metrics of measuring mismatches between models and benchmarks. The metrics may include (1) a priori thresholds of acceptable model performance and (2) a scoring system to combine data–model mismatches for various processes at different temporal and spatial scales. The benchmark analyses should identify clues of weak model performance to guide future development, thus enabling improved predictions of future states of ecosystems and climate. The near-future research effort should be on development of a set of widely acceptable benchmarks that can be used to objectively, effectively, and reliably evaluate fundamental properties of land models to improve their prediction performance skills.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A biochemical model of photosynthetic CO2 assimilation in leaves of C3 species
Farquhar, G. D., von Caemmerer, S., & Berry, J. A. (1980) · Planta · doi:10.1007/bf00386231 · Cited by 8,796
Summarizing multiple aspects of model performance in a single diagram
Taylor, K. E. (2001) · Journal of Geophysical Research: Atmospheres · doi:10.1029/2000jd900719 · Cited by 8,477
Forests and Climate Change: Forcings, Feedbacks, and the Climate Benefits of Forests
Bonan, G. B. (2008) · Science · doi:10.1126/science.1155121 · Cited by 6,238
Tree allometry and improved estimation of carbon stocks and balance in tropical forests
Chave, J., Andalo, C., Brown, S., Cairns, M. A., Chambers, J. Q., Eamus, D., Fölster, H., Fromard, F., Higuchi, N., Kira, T., et al. (2005) · Oecologia · doi:10.1007/s00442-005-0100-x · Cited by 3,533
Sitch, S., Smith, B., Prentice, I. C., Arneth, A., Bondeau, A., Cramer, W., Kaplan, J. O., Levis, S., Lucht, W., Sykes, M. T., et al. (2003) · Global Change Biology · doi:10.1046/j.1365-2486.2003.00569.x · Cited by 3,238
Self-citationOn the relation between NDVI, fractional vegetation cover, and leaf area index
Carlson, T. N., & Ripley, D. A. (1997) · Remote Sensing of Environment · doi:10.1016/s0034-4257(97)00104-1 · Cited by 3,125
Climate–Carbon Cycle Feedback Analysis: Results from the C4MIP Model Intercomparison
Friedlingstein, P., Cox, P., Betts, R., Bopp, L., von Bloh, W., Brovkin, V., Cadule, P., Doney, S., Eby, M., Fung, I., et al. (2006) · Journal of Climate · doi:10.1175/jcli3800.1 · Cited by 2,902
Self-citationImprovements to a MODIS global terrestrial evapotranspiration algorithm
Mu, Q., Zhao, M., & Running, S. W. (2011) · Remote Sensing of Environment · doi:10.1016/j.rse.2011.02.019 · Cited by 2,816
Soil organic carbon pools in the northern circumpolar permafrost region
Tarnocai, C., Canadell, J. G., Schuur, E. A. G., Kuhry, P., Mazhitova, G., & Zimov, S. (2009) · Global Biogeochemical Cycles · doi:10.1029/2008gb003327 · Cited by 2,502
Recent decline in the global land evapotranspiration trend due to limited moisture supply
Jung, M., Reichstein, M., Ciais, P., Seneviratne, S. I., Sheffield, J., Goulden, M. L., Bonan, G., Cescatti, A., Chen, J., de Jeu, R., et al. (2010) · Nature · doi:10.1038/nature09396 · Cited by 2,280
Self-citation
Cited by
Deep learning and process understanding for data-driven Earth system science
Reichstein, M., Camps-Valls, G., Stevens, B., Jung, M., Denzler, J., Carvalhais, N., & Prabhat (2019) · Nature · doi:10.1038/s41586-019-0912-1 · Cited by 5,673
Self-citationVegetation demographics in Earth System Models: A review of progress and priorities
Fisher, R. A., Koven, C. D., Anderegg, W. R. L., Christoffersen, B. O., Dietze, M. C., Farrior, C. E., Holm, J. A., Hurtt, G. C., Knox, R. G., Lawrence, P. J., et al. (2018) · Global Change Biology · doi:10.1111/gcb.13910 · Cited by 768
Self-citationTaking climate model evaluation to the next level
Eyring, V., Cox, P. M., Flato, G. M., Gleckler, P. J., Abramowitz, G., Caldwell, P., Collins, W. D., Gier, B. K., Hall, A. D., Hoffman, F. M., et al. (2019) · Nature Climate Change · doi:10.1038/s41558-018-0355-y · Cited by 748
Self-citationObserving terrestrial ecosystems and the carbon cycle from space
Schimel, D., Pavlick, R., Fisher, J. B., Asner, G. P., Saatchi, S., Townsend, P., Miller, C., Frankenberg, C., Hibbard, K., & Cox, P. (2015) · Global Change Biology · doi:10.1111/gcb.12822 · Cited by 585
Self-citationLawrence, D. M., Hurtt, G. C., Arneth, A., Brovkin, V., Calvin, K. V., Jones, A. D., Jones, C. D., Lawrence, P. J., de Noblet-Ducoudré, N., Pongratz, J., et al. (2016) · Geoscientific Model Development · doi:10.5194/gmd-9-2973-2016 · Cited by 543
Self-citation
Metadata
- Authors
- Luo, Y. Q., Randerson, J. T., Abramowitz, G., Bacour, C., Blyth, E., Carvalhais, N., Ciais, P., Dalmonech, D., Fisher, J. B., Fisher, R., Friedlingstein, P., Hibbard, K., Hoffman, F., Huntzinger, D., Jones, C. D., Koven, C., Lawrence, D., Li, D. J., Mahecha, M., Niu, S. L., Norby, R., Piao, S. L., Qi, X., Peylin, P., Prentice, I. C., Riley, W., Reichstein, M., Schwalm, C., Wang, Y. P., Xia, J. Y., Zaehle, S., & Zhou, X. H.
- Venue
- Biogeosciences
- Publisher
- Copernicus GmbH
- Published
- 2012-10-09
- Volume
- 9
- Issue
- 10
- Pages
- 3857-3874
- ISSN
- 1726-4170 (ISSN-L)
- 1726-4189
- OpenAlex
- W2104043570
- Cited by
- 344
- References
- 123
- FWCI
- 21.64
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A framework for benchmarking land models. https://app.cochat.ai/papers/10.5194/bg-9-3857-2012
- The paper
- Luo, Y. Q., Randerson, J. T., Abramowitz, G., Bacour, C., Blyth, E., Carvalhais, N., Ciais, P., Dalmonech, D., Fisher, J. B., Fisher, R., Friedlingstein, P., Hibbard, K., Hoffman, F., Huntzinger, D., Jones, C. D., Koven, C., Lawrence, D., Li, D. J., Mahecha, M., . . . Zhou, X. H. (2012). A framework for benchmarking land models. Biogeosciences. https://doi.org/10.5194/bg-9-3857-2012
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
