The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Machine learning for large-scale crop yield forecasting
Open accessAbstract
Many studies have applied machine learning to crop yield prediction with a focus on specific case studies. The data and methods they used may not be transferable to other crops and locations. On the other hand, operational large-scale systems, such as the European Commission's MARS Crop Yield Forecasting System (MCYFS), do not use machine learning. Machine learning is a promising method especially when large amounts of data are being collected and published. We combined agronomic principles of crop modeling with machine learning to build a machine learning baseline for large-scale crop yield forecasting. The baseline is a workflow emphasizing correctness, modularity and reusability. For correctness, we focused on designing explainable predictors or features (in relation to crop growth and development) and applying machine learning without information leakage. We created features using crop simulation outputs and weather, remote sensing and soil data from the MCYFS database. We emphasized a modular and reusable workflow to support different crops and countries with small configuration changes. The workflow can be used to run repeatable experiments (e.g. early season or end of season predictions) using standard input data to obtain reproducible results. The results serve as a starting point for further optimizations. In our case studies, we predicted yield at regional level for five crops (soft wheat, spring barley, sunflower, sugar beet, potatoes) and three countries (the Netherlands (NL), Germany (DE), France (FR)). We compared the performance with a simple method with no prediction skill, which either predicted a linear yield trend or the average of the training set. We also aggregated the predictions to the national level and compared with past MCYFS forecasts. The normalized RMSE (NRMSE) for early season predictions (30 days after planting) were comparable for NL (all crops), DE (all except soft wheat) and FR (soft wheat, spring barley, sunflower). For example, NRMSE was 7.87 for soft wheat (NL) (6.32 for MCYFS) and 8.21 for sugar beet (DE) (8.79 for MCYFS). In contrast, NRMSEs for soft wheat (DE), sugar beet (FR) and potatoes (FR) were twice as much compared to MCYFS. NRMSEs for end of season were still comparable to MCYFS for NL, but worse for DE and FR. The baseline can be improved by adding new data sources, designing more predictive features and evaluating different machine learning algorithms. The baseline will motivate the use of machine learning in large-scale crop yield forecasting.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421 · cited 1×
“…Ridge Regression (Hoerl and Kennard 1970), (ii) K -nearest Neighbors Regression (Cover and Hart 1967; Aha et al. 1991), (iii) Support Vector Machines Regression (Boser et al. 1992; Cortes and Vapnik 1995), and (iv) Gradient Boosted Decision Trees Regression (see Friedman 2001; Hastie et al. 2009).”
Greedy function approximation: A gradient boosting machine
Friedman, J. H. (2001) · The Annals of Statistics · doi:10.1214/aos/1013203451 · Cited by 30,731
Nearest neighbor pattern classification
Cover, T., & Hart, P. (1967) · IEEE Transactions on Information Theory · doi:10.1109/tit.1967.1053964 · Cited by 16,936
The Elements of Statistical Learning: Data Mining, Inference, and Prediction
John Lu, Z. Q. (2010) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2010.00646_6.x · Cited by 12,390
An Introduction to Statistical Learning
James, G., Witten, D., Hastie, T., & Tibshirani, R. (2013) · Springer Texts in Statistics · doi:10.1007/978-1-4614-7138-7 · Cited by 12,106
A training algorithm for optimal margin classifiers
Boser, B. E., Guyon, I. M., & Vapnik, V. N. (1992) · Proceedings of the fifth annual workshop on Computational learning theory · doi:10.1145/130385.130401 · Cited by 11,992
(2016) · Cited by 11,679
Wold, S., Esbensen, K., & Geladi, P. (1987) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/0169-7439(87)80084-9 · Cited by 11,606
Ridge regression: Biased estimation for nonorthogonal problems
Hoerl, A. E., & Kennard, R. W. (1970) · Technometrics · doi:10.1080/00401706.1970.10488634 · Cited by 9,648
Global food demand and the sustainable intensification of agriculture
Tilman, D., Balzer, C., Hill, J., & Befort, B. L. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1116437108 · Cited by 7,692
Deep learning in agriculture: A survey
Kamilaris, A., & Prenafeta-Boldú, F. X. (2018) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2018.02.016 · Cited by 5,133
Machine Learning in Agriculture: A Review
Liakos, K., Busato, P., Moshou, D., Pearson, S., & Bochtis, D. (2018) · Sensors · doi:10.3390/s18082674 · Cited by 3,441
Apache Spark: A unified engine for big data processing
Zaharia, M., Xin, R. S., Wendell, P., Das, T., Armbrust, M., Dave, A., Meng, X., Rosen, J., Venkataraman, S., Franklin, M. J., et al. (2016) · Communications of the ACM · doi:10.1145/2934664 · Cited by 2,757
Instance-based learning algorithms
Aha, D. W., Kibler, D., & Albert, M. K. (1991) · Machine Learning · doi:10.1007/bf00153759 · Cited by 2,163
APSIM – evolution towards a new generation of agricultural systems simulation
Holzworth, D. P., Huth, N. I., deVoil, P. G., Zurcher, E. J., Herrmann, N. I., McLean, G., Chenu, K., van Oosterom, E. J., Snow, V., Murphy, C., et al. (2014) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2014.07.009 · Cited by 1,756 · cited 3×
“Reusability has not been a design goal in agricultural system modeling; more emphasis has been placed on the underlying science (Holzworth et al., 2014).”
BackgroundChlingaryan, A., Sukkarieh, S., & Whelan, B. (2018) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2018.05.012 · Cited by 1,577
Self-organization of orientation sensitive cells in the striate cortex
von der Malsburg, C. (1973) · Kybernetik · doi:10.1007/bf00288907 · Cited by 1,461
Semantic Compositionality through Recursive Matrix-Vector Spaces
Socher, R., Huval, B., Manning, C. D., & Ng, A. Y. (2012) · Cited by 1,259
Random Forests for Global and Regional Crop Yield Predictions
Jeong, J. H., Resop, J. P., Mueller, N. D., Fleisher, D. H., Yun, K., Butler, E. E., Timlin, D. J., Shim, K.-M., Gerber, J. S., Reddy, V. R., et al. (2016) · PLOS ONE · doi:10.1371/journal.pone.0156571 · Cited by 893
Introduction to Machine Learning with Python: A Guide for Data Scientists
Müller, A., & Guido, S. (2016) · Cited by 840
Ridge Regression: Biased Estimation for Nonorthogonal Problems
Hoerl, A. E., & Kennard, R. W. (2000) · Technometrics · doi:10.1080/00401706.2000.10485983 · Cited by 808
Bek, R. (1978) · Czech digital mathematics library · Cited by 787
WOFOST: a simulation model of crop production
van Diepen, C. A., Wolf, J., van Keulen, H., & Rappoldt, C. (1989) · Soil Use and Management · doi:10.1111/j.1475-2743.1989.tb00755.x · Cited by 779
Dorigo, W. A., Zurita-Milla, R., de Wit, A. J. W., Brazile, J., Singh, R., & Schaepman, M. E. (2007) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2006.05.003 · Cited by 637
Self-citationWheat yield prediction using machine learning and advanced sensing techniques
Pantazi, X. E., Moshou, D., Alexandridis, T., Whetton, R. L., & Mouazen, A. M. (2016) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2015.11.018 · Cited by 613
A scalable satellite-based crop yield mapper
Lobell, D. B., Thau, D., Seifert, C., Engle, E., & Little, B. (2015) · Remote Sensing of Environment · doi:10.1016/j.rse.2015.04.021 · Cited by 602
Cai, Y., Guan, K., Lobell, D., Potgieter, A. B., Wang, S., Peng, J., Xu, T., Asseng, S., Zhang, Y., You, L., et al. (2019) · Agricultural and Forest Meteorology · doi:10.1016/j.agrformet.2019.03.010 · Cited by 591
Deep Gaussian Process for Crop Yield Prediction Based on Remote Sensing Data
You, J., Li, X., Low, M., Lobell, D., & Ermon, S. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11172 · Cited by 558
Remote Sensing of Vegetation: Principles, Techniques, and Applications
Jones, H. G., & Vaughan, R. A. (2010) · Cited by 527
25 years of the WOFOST cropping systems model
de Wit, A., Boogaard, H., Fumagalli, D., Janssen, S., Knapen, R., van Kraalingen, D., Supit, I., van der Wijngaart, R., & van Diepen, K. (2019) · Agricultural Systems · doi:10.1016/j.agsy.2018.06.018 · Cited by 504
Self-citationCrane-Droesch, A. (2018) · Environmental Research Letters · doi:10.1088/1748-9326/aae159 · Cited by 492
Seasonal crop yield forecast: Methods, applications, and accuracies
Basso, B., & Liu, L. (2019) · Advances in Agronomy · doi:10.1016/bs.agron.2018.11.002 · Cited by 320
Prediction of Winter Wheat Yield Based on Multi-Source Data and Machine Learning in China
Han, J., Zhang, Z., Cao, J., Luo, Y., Zhang, L., Li, Z., & Zhang, J. (2020) · Remote Sensing · doi:10.3390/rs12020236 · Cited by 307
Definitions and determination of crop yield, yield gaps, and of rates of change
Fischer, R. A. (2015) · Field Crops Research · doi:10.1016/j.fcr.2014.12.006 · Cited by 253
Predictive ability of machine learning methods for massive crop yield prediction
Gonzalez-Sanchez, A., Frausto-Solis, J., & Ojeda-Bustamante, W. (2014) · Spanish Journal of Agricultural Research · doi:10.5424/sjar/2014122-4439 · Cited by 243
Janssen, S. J. C., Porter, C. H., Moore, A. D., Athanasiadis, I. N., Foster, I., Jones, J. W., & Antle, J. M. (2017) · Agricultural Systems · doi:10.1016/j.agsy.2016.09.017 · Cited by 235
Self-citationExtensive identification and analysis of conserved small ORFs in animals
Mackowiak, S. D., Zauber, H., Bielow, C., Thiel, D., Kutz, K., Calviello, L., Mastrobuoni, G., Rajewsky, N., Kempa, S., Selbach, M., et al. (2015) · Genome Biology · doi:10.1186/s13059-015-0742-x · Cited by 227 · cited 1×
“Machine learning has gained popularity in agricultural applications due to its success in other fields, such as medicine (e.g. Kang et al. (2015)), bioinformatics (e.g. Mackowiak et al. (2015)) and natural language processing (e.g. Socher et al. (2012)).”
BackgroundMaize yield and nitrate loss prediction with machine learning algorithms
Shahhosseini, M., Martinez-Feria, R. A., Hu, G., & Archontoulis, S. V. (2019) · Environmental Research Letters · doi:10.1088/1748-9326/ab5268 · Cited by 226
Agricultural production systems modelling and software: current status and future prospects
Holzworth, D. P., Snow, V., Janssen, S., Athanasiadis, I. N., Donatelli, M., Hoogenboom, G., White, J. W., & Thorburn, P. (2015) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2014.12.013 · Cited by 218 · cited 1×
“Among applications of shallow methods, Shah-hosseini et al. (2019) built machine learning metamodels from outputs of the APSIM crop model (Holzworth et al., 2015) to predict maize yield and nitrogen loss in the US; Jeong et al. (2016) applied Random Forests (Breiman 2001) to predict wheat yield…”
MethodSelf-citationMachine Learning Approaches for Predicting Radiation Therapy Outcomes: A Clinician's Perspective
Kang, J., Schwartz, R., Flickinger, J., & Beriwal, S. (2015) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2015.07.2286 · Cited by 215
Analysis of Big Data technologies for use in agro-environmental science
Lokers, R., Knapen, R., Janssen, S., van Randen, Y., & Jansen, J. (2016) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2016.07.017 · Cited by 210
Self-citationZhao, Y., Potgieter, A. B., Zhang, M., Wu, B., & Hammer, G. L. (2020) · Remote Sensing · doi:10.3390/rs12061024 · Cited by 194
Machine learning for ecosystem services
Willcock, S., Martínez-López, J., Hooftman, D. A. P., Bagstad, K. J., Balbi, S., Marzo, A., Prato, C., Sciandrello, S., Signorello, G., Voigt, B., et al. (2018) · Ecosystem Services · doi:10.1016/j.ecoser.2018.04.004 · Cited by 181
Self-citationChipanshi, A., Zhang, Y., Kouadio, L., Newlands, N., Davidson, A., Hill, H., Warren, R., Qian, B., Daneshfar, B., Bedard, F., et al. (2015) · Agricultural and Forest Meteorology · doi:10.1016/j.agrformet.2015.03.007 · Cited by 158
Lecerf, R., Ceglar, A., López‐Lozano, R., van der Velde, M., & Baruth, B. (2018) · Agricultural Systems · doi:10.1016/j.agsy.2018.03.002 · Cited by 158
Closing yield gaps: perils and possibilities for biodiversity conservation
Phalan, B., Green, R. E., & Balmford, A. P. (2014) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2012.0285 · Cited by 146
Newlands, N. K., Zamar, D., Kouadio, L. A., Zhang, Y., Chipanshi, A. C., Potgieter, A. B., Touré, S., & Hill, H. S. J. (2014) · Frontiers in Environmental Science · doi:10.3389/fenvs.2014.00017 · Cited by 115
van der Velde, M., & Nisini, L. (2018) · Agricultural Systems · doi:10.1016/j.agsy.2018.06.009 · Cited by 84
In-season performance of European Union wheat forecasts during extreme impacts
van der Velde, M., Baruth, B., Bussay, A., Ceglar, A., Condado, S. G., Karetsos, S., Lecerf, R., Lopez, R., Maiorano, A., Nisini, L., et al. (2018) · Scientific Reports · doi:10.1038/s41598-018-33688-1 · Cited by 36
Benchmarking Machine‐Learning Methods
Baskin, I. I., Marcou, G., Horvath, D., & Varnek, A. A. (2017) · Wiley eBooks · doi:10.1002/9781119161110.ch13 · Cited by 3
Metadata
- Authors
- Paudel, D., Boogaard, H., de Wit, A., Janssen, S., Osinga, S., Pylianidis, C., & Athanasiadis, I. N.
- Venue
- Agricultural Systems
- Publisher
- Elsevier BV
- Published
- 2021-02
- Volume
- 187
- Pages
- 103016
- ISSN
- 0308-521X (ISSN-L)
- OpenAlex
- W3112881537
- Cited by
- 357
- References
- 52
- FWCI
- 17.80
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.