Modern practical convolutional neural networks for multivariate regression: Applications to NIR calibration
Open accessThe DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
In this study, we investigate the use of convolutional neural networks (CNN) for near infrared (NIR) calibration. We propose a unified CNN structure that can be used for general multivariate regression purpose. The comparison between the CNN method and the partial least squares regression (PLSR) method was done on three different NIR datasets of spectra and lab reference values. Datasets are from different sources and contain 6998, 1000 and 415 training and 618, 597 and 108 validation samples, respectively. Results indicated that compared to the PLSR models, the CNN models are more accurate and less noisy. The convolutional layer in the CNN model can automatically find the suitable spectral preprocessing filter on the dataset, which significantly saves efforts in training the model.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380 · cited 1×
“E Convolutional neural networks have recently become the popular solution for different machine learning tasks, including object detection [1], image classification [2], natural language processing [3], time series classification [4] and many other applications.”
Background(2014) · Cited by 33,419
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599
Proceedings of IEEE International Conference on Computer Vision
(1995) · Proceedings of IEEE International Conference on Computer Vision · doi:10.1109/iccv.1995.466933 · Cited by 12,860
Advances in Neural Information Processing Systems 25
Zhang, Y., Sutton, C. A., Storkey, A., & Zoubin Ghahramani, A. (2012) · Cited by 12,653
Partial least-squares regression: a tutorial
Geladi, P., & Kowalski, B. R. (1986) · Analytica Chimica Acta · doi:10.1016/0003-2670(86)80028-9 · Cited by 6,992
A unified architecture for natural language processing: deep neural networks with multitask learning
Collobert, R., & Weston, J. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390177 · Cited by 5,058
Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)
Clevert, D.-A., Unterthiner, T., & Hochreiter, S. (2015) · arXiv · doi:10.48550/arxiv.1511.07289 · Cited by 4,513 · cited 1×
“In addition, there is a negative saturation regime which makes it robust against some noises [19].”
BackgroundConvergence Results for Neural Networks via Electrodynamics
Panigrahy, R., Rahimi, A., Sachdeva, S., & Zhang, Q. (2018) · Leibniz international proceedings in informatics · doi:10.4230/lipics.itcs.2018.22 · Cited by 2,761
Neural Networks: Tricks of the Trade: Second Edition
(2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8 · Cited by 2,116
A user-friendly guide to Multivariate Calibration and Classification
Næs, T., Isaksson, T., Fearn, T., & Davies, T. (2017) · doi:10.1255/978-1-906715-25-0 · Cited by 1,401
Self-citationLeCun, Y., Bottou, L., Orr, G., & Müller, K. (1998) · neural information processing systems · Cited by 1,333
One weird trick for parallelizing convolutional neural networks
Krizhevsky, A. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1404.5997 · Cited by 919
Time Series Classification Using Multi-Channels Deep Convolutional Neural Networks
Zheng, Y., Liu, Q., Chen, E., Ge, Y., & Zhao, J. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-08010-9_33 · Cited by 652
Neural networks: A new method for solving chemical problems or just a passing phase?
Zupan, J., & Gasteiger, J. (1991) · Analytica Chimica Acta · doi:10.1016/s0003-2670(00)80865-x · Cited by 579
PITMAN, E. J. G. (1939) · Biometrika · doi:10.1093/biomet/31.1-2.9 · Cited by 480
One‐dimensional convolutional neural networks for spectroscopic signal regression
Malek, S., Melgani, F., & Bazi, Y. (2018) · Journal of Chemometrics · doi:10.1002/cem.2977 · Cited by 248
Artificial neural networks in chemometrics: History, examples and perspectives
Marini, F., Bucci, R., Magrì, A. L., & Magrì, A. D. (2008) · Microchemical Journal · doi:10.1016/j.microc.2007.11.008 · Cited by 186
Pedersen, D. K., Martens, H. A., Nielsen, J. P., & Engelsen, S. B. (2002) · Applied Spectroscopy · doi:10.1366/000370202760295467 · Cited by 135
Fearn, T. (1996) · NIR news · doi:10.1255/nirn.378 · Cited by 93
Self-citationUnit Tests for Stochastic OptimizationPreprint
Schaul, T., Antonoglou, I., & Silver, D. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1312.6055 · Cited by 85
Feed-forward artificial neural networks: applications to spectroscopy
Cirovic, D. A. (1997) · TrAC Trends in Analytical Chemistry · doi:10.1016/s0165-9936(97)00007-1 · Cited by 79
Cui, C., & Fearn, T. (2017) · Journal of Near Infrared Spectroscopy · doi:10.1177/0967033516678515 · Cited by 58
Self-citationHierarchical mixture of linear regressions for multivariate spectroscopic calibration
Cui, C., & Fearn, T. (2018) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2017.12.013 · Cited by 9
Self-citation
Cited by
Reluplex made more practical: Leaky ReLU
Xu, J., Li, Z., Du, B., Zhang, M., & Liu, J. (2020) · 2020 IEEE Symposium on Computers and Communications (ISCC) · doi:10.1109/iscc50000.2020.9219587 · Cited by 398
Chen, H., Chen, A., Xu, L., Xie, H., Qiao, H., Lin, Q., & Cai, K. (2020) · Agricultural Water Management · doi:10.1016/j.agwat.2020.106303 · Cited by 337
Wang, H.-P., Chen, P., Dai, J.-W., Liu, D., Li, J.-Y., Xu, Y.-P., & Chu, X.-L. (2022) · TrAC Trends in Analytical Chemistry · doi:10.1016/j.trac.2022.116648 · Cited by 326
Deep learning for vibrational spectral analysis: Recent progress and a practical guide
Yang, J., Xu, J., Zhang, X., Wu, C., Lin, T., & Ying, Y. (2019) · Analytica Chimica Acta · doi:10.1016/j.aca.2019.06.012 · Cited by 299
Metadata
- Authors
- Cui, C., & Fearn, T.
- Venue
- Chemometrics and Intelligent Laboratory Systems
- Publisher
- Elsevier BV
- Published
- 2018-11
- Volume
- 182
- Pages
- 9-20
- ISSN
- 0169-7439 (ISSN-L)
- OpenAlex
- W2883273084
- Cited by
- 316
- References
- 28
- FWCI
- 11.25
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.