The DOI matches its Crossref record; 73 of the 73 references it cites were found in a registry or an index.
Global gridded crop model evaluation: benchmarking, skills, deficiencies and implications
Open accessAbstract
Abstract. Crop models are increasingly used to simulate crop yields at the global scale, but so far there is no general framework on how to assess model performance. Here we evaluate the simulation results of 14 global gridded crop modeling groups that have contributed historic crop yield simulations for maize, wheat, rice and soybean to the Global Gridded Crop Model Intercomparison (GGCMI) of the Agricultural Model Intercomparison and Improvement Project (AgMIP). Simulation results are compared to reference data at global, national and grid cell scales and we evaluate model performance with respect to time series correlation, spatial correlation and mean bias. We find that global gridded crop models (GGCMs) show mixed skill in reproducing time series correlations or spatial patterns at the different spatial scales. Generally, maize, wheat and soybean simulations of many GGCMs are capable of reproducing larger parts of observed temporal variability (time series correlation coefficients (r) of up to 0.888 for maize, 0.673 for wheat and 0.643 for soybean at the global scale) but rice yield variability cannot be well reproduced by most models. Yield variability can be well reproduced for most major producing countries by many GGCMs and for all countries by at least some. A comparison with gridded yield data and a statistical analysis of the effects of weather variability on yield variability shows that the ensemble of GGCMs can explain more of the yield variability than an ensemble of regression models for maize and soybean, but not for wheat and rice. We identify future research needs in global gridded crop modeling and for all individual crop modeling groups. In the absence of a purely observation-based benchmark for model evaluation, we propose that the best performing crop model per crop and region establishes the benchmark for all others, and modelers are encouraged to investigate how crop model performance can be increased. We make our evaluation system accessible to all crop modelers so that other modeling groups can also test their model performance against the reference data and the GGCMI benchmark.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Summarizing multiple aspects of model performance in a single diagram
Taylor, K. E. (2001) · Journal of Geophysical Research: Atmospheres · doi:10.1029/2000jd900719 · Cited by 8,477
The DSSAT cropping system model
Jones, J. W., Hoogenboom, G., Porter, C. H., Boote, K. J., Batchelor, W. D., Hunt, L. A., Wilkens, P. W., Singh, U., Gijsman, A. J., & Ritchie, J. T. (2003) · European Journal of Agronomy · doi:10.1016/s1161-0301(02)00107-7 · Cited by 4,465
Influence of extreme weather disasters on global crop production
Lesk, C., Rowhani, P., & Ramankutty, N. (2016) · Nature · doi:10.1038/nature16467 · Cited by 3,883
Climate Change Impacts on Global Food Security
Wheeler, T., & von Braun, J. (2013) · Science · doi:10.1126/science.1239402 · Cited by 3,487
Computer Models of Watershed Hydrology
Singh, V. P. (1995) · Medical Entomology and Zoology · Cited by 3,273
An overview of APSIM, a model designed for farming systems simulation
Keating, B. A., Carberry, P. S., Hammer, G. L., Probert, M. E., Robertson, M. J., Holzworth, D., Huth, N. I., Hargreaves, J. N. G., Meinke, H., Hochman, Z., et al. (2003) · European Journal of Agronomy · doi:10.1016/s1161-0301(02)00108-9 · Cited by 2,878
Closing yield gaps through nutrient and water management
Mueller, N. D., Gerber, J. S., Johnston, M., Ray, D. K., Ramankutty, N., & Foley, J. A. (2012) · Nature · doi:10.1038/nature11420 · Cited by 2,827
Self-citationRising temperatures reduce global wheat production
Asseng, S., Ewert, F., Martre, P., Rötter, R. P., Lobell, D. B., Cammarano, D., Kimball, B. A., Ottman, M. J., Wall, G. W., White, J. W., et al. (2015) · Nature Climate Change · doi:10.1038/nclimate2470 · Cited by 2,491
Self-citationRosenzweig, C., Elliott, J., Deryng, D., Ruane, A. C., Müller, C., Arneth, A., Boote, K. J., Folberth, C., Glotter, M., Khabarov, N., et al. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1222463110 · Cited by 2,319
Self-citationClimate variation explains a third of global crop yield variability
Ray, D. K., Gerber, J. S., MacDonald, G. K., & West, P. C. (2015) · Nature Communications · doi:10.1038/ncomms6989 · Cited by 2,046
Self-citation
Cited by
Climate impacts on global agriculture emerge earlier in new generation of climate and crop models
Jägermeyr, J., Müller, C., Ruane, A. C., Elliott, J., Balkovic, J., Castillo, O., Faye, B., Foster, I., Folberth, C., Franke, J. A., et al. (2021) · Nature Food · doi:10.1038/s43016-021-00400-y · Cited by 1,010
Self-citationClimate change has likely already affected global food production
Ray, D. K., West, P. C., Clark, M., Gerber, J. S., Prishchepov, A. V., & Chatterjee, S. (2019) · PLOS ONE · doi:10.1371/journal.pone.0217148 · Cited by 989
Self-citationZabel, F., Delzeit, R., Schneider, J. M., Seppelt, R., Mauser, W., & Václavík, T. (2019) · Nature Communications · doi:10.1038/s41467-019-10775-z · Cited by 743
Impact of extreme weather conditions on European crop production in 2018
Beillouin, D., Schauberger, B., Bastos, A., Ciais, P., & Makowski, D. (2020) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2019.0510 · Cited by 431
Self-citationDiverging importance of drought stress for maize and winter wheat in Europe
Webber, H., Ewert, F., Olesen, J. E., Müller, C., Fronzek, S., Ruane, A. C., Bourgault, M., Martre, P., Ababaei, B., Bindi, M., et al. (2018) · Nature Communications · doi:10.1038/s41467-018-06525-2 · Cited by 422
Self-citation
Metadata
- Authors
- Müller, C., Elliott, J., Chryssanthacopoulos, J., Arneth, A., Balkovic, J., Ciais, P., Deryng, D., Folberth, C., Glotter, M., Hoek, S., Iizumi, T., Izaurralde, R. C., Jones, C., Khabarov, N., Lawrence, P., Liu, W., Olin, S., Pugh, T. A. M., Ray, D. K., Reddy, A., Rosenzweig, C., Ruane, A. C., Sakurai, G., Schmid, E., Skalsky, R., Song, C. X., Wang, X., de Wit, A., & Yang, H.
- Venue
- Geoscientific Model Development
- Publisher
- Copernicus GmbH
- Published
- 2017-04-04
- Volume
- 10
- Issue
- 4
- Pages
- 1403-1422
- ISSN
- 1991-959X (ISSN-L)
- 1991-9603
- OpenAlex
- W2521677216
- Cited by
- 358
- References
- 73
- FWCI
- 32.70
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Global gridded crop model evaluation: benchmarking, skills, deficiencies and implications. https://app.cochat.ai/papers/10.5194/gmd-10-1403-2017
- The paper
- Müller, C., Elliott, J., Chryssanthacopoulos, J., Arneth, A., Balkovic, J., Ciais, P., Deryng, D., Folberth, C., Glotter, M., Hoek, S., Iizumi, T., Izaurralde, R. C., Jones, C., Khabarov, N., Lawrence, P., Liu, W., Olin, S., Pugh, T. A. M., Ray, D. K., . . . Yang, H. (2017). Global gridded crop model evaluation: benchmarking, skills, deficiencies and implications. Geoscientific Model Development. https://doi.org/10.5194/gmd-10-1403-2017
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.