The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
The influence of training sample size on the accuracy of deep learning models for the prediction of soil properties with near-infrared spectroscopy data
Open accessAbstract
The number of samples used in the calibration data set affects the quality of the generated predictive models using visible, near and shortwave infrared (VIS–NIR–SWIR) spectroscopy for soil attributes. Recently, the convolutional neural network (CNN) has been regarded as a highly accurate model for predicting soil properties on a large database. However, it has not yet been ascertained how large the sample size should be for CNN model to be effective. This paper investigates the effect of the training sample size on the accuracy of deep learning and machine learning models. It aims at providing an estimate of how many calibration samples are needed to improve the model performance of soil properties predictions with CNN as compared to conventional machine learning models. In addition, this paper also looks at a way to interpret the CNN models, which are commonly labelled as a black box. It is hypothesised that the performance of machine learning models will increase with an increasing number of training samples, but it will plateau when it reaches a certain number, while the performance of CNN will keep improving. The performances of two machine learning models (partial least squares regression – PLSR; Cubist) are compared against the CNN model. A VIS–NIR–SWIR spectra library from Brazil, containing 4251 unique sites with averages of two to three samples per depth (a total of 12 044 samples), was divided into calibration (3188 sites) and validation (1063 sites) sets. A subset of the calibration data set was then created to represent a smaller calibration data set ranging from 125, 300, 500, 1000, 1500, 2000, 2500 and 2700 unique sites, which is equivalent to a sample size of approximately 350, 840, 1400, 2800, 4200, 5600, 7000 and 7650. All three models (PLSR, Cubist and CNN) were generated for each sample size of the unique sites for the prediction of five different soil properties, i.e. cation exchange capacity, organic carbon, sand, silt and clay content. These calibration subset sampling processes and modelling were repeated 10 times to provide a better representation of the model performances. Learning curves showed that the accuracy increased with an increasing number of training samples. At a lower number of samples (< 1000), PLSR and Cubist performed better than CNN. The performance of CNN outweighed the PLSR and Cubist model at a sample size of 1500 and 1800, respectively. It can be recommended that deep learning is most efficient for spectra modelling for sample sizes above 2000. The accuracy of the PLSR and Cubist model seems to reach a plateau above sample sizes of 4200 and 5000, respectively, while the accuracy of CNN has not plateaued. A sensitivity analysis of the CNN model demonstrated its ability to determine important wavelengths region that affected the predictions of various soil attributes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Smoothing and Differentiation of Data by Simplified Least Squares Procedures.
Savitzky, A., & Golay, M. J. E. (1964) · Analytical Chemistry · doi:10.1021/ac60214a047 · Cited by 21,904
Visible and near infrared spectroscopy in soil science
Stenberg, B., Viscarra Rossel, R. A., Mouazen, A. M., & Wetterlind, J. (2010) · Advances in Agronomy · doi:10.1016/s0065-2113(10)07005-7 · Cited by 1,549
The multivariate calibration problem in chemistry solved by the PLS method
Wold, S., Martens, H., & Wold, H. (1983) · Lecture notes in mathematics · doi:10.1007/bfb0062108 · Cited by 1,185
Islam, K., Singh, B., & McBratney, A. (2003) · Australian Journal of Soil Research · doi:10.1071/sr02137 · Cited by 373
Cited by
Machine learning approaches to IoT security: A systematic literature review
Ahmad, R., & Alsmadi, I. (2021) · Internet of Things · doi:10.1016/j.iot.2021.100365 · Cited by 285
A Review of Machine Learning for Near-Infrared Spectroscopy
Zhang, W., Kasun, L. C., Wang, Q. J., Zheng, Y., & Lin, Z. (2022) · Sensors · doi:10.3390/s22249764 · Cited by 280
BFRT: Blockchained Federated Learning for Real-time Traffic Flow Prediction
Meese, C., Chen, H., Asif, S. A., Li, W., Shen, C.-C., & Nejad, M. (2022) · 2022 22nd IEEE International Symposium on Cluster, Cloud and Internet Computing (CCGrid) · doi:10.1109/ccgrid54584.2022.00041 · Cited by 41
Metadata
- Authors
- Ng, W., Minasny, B., Mendes, W. D. S., & Demattê, J. A. M.
- Venue
- SOIL
- Publisher
- Copernicus GmbH
- Published
- 2020-11-17
- Volume
- 6
- Issue
- 2
- Pages
- 565-578
- ISSN
- 2199-3971 (ISSN-L)
- 2199-398X
- OpenAlex
- W3102889971
- Cited by
- 240
- References
- 7
- FWCI
- 8.40
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The influence of training sample size on the accuracy of deep learning models for the prediction of soil properties with near-infrared spectroscopy data. https://app.cochat.ai/papers/10.5194/soil-6-565-2020
- The paper
- Ng, W., Minasny, B., Mendes, W. D. S., & Demattê, J. A. M. (2020). The influence of training sample size on the accuracy of deep learning models for the prediction of soil properties with near-infrared spectroscopy data. SOIL. https://doi.org/10.5194/soil-6-565-2020
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.