The DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index.
Deep learning for vibrational spectral analysis: Recent progress and a practical guide
Abstract
The development of chemometrics aims to provide an effective analysis approach for data generated by advanced analytical instruments. The success of existing analytical approaches in spectral analysis still relies on preprocessing and feature selection techniques to remove signal artifacts based on prior experiences. Data-driven deep learning analysis has been developed and successfully applied in many domains in the last few years. How to integrate deep learning with spectral analysis received increased attention for chemometrics. Approximately 20 recently published studies demonstrate that deep neural networks can learn critical patterns from raw spectra, which significantly reduces the demand for feature engineering. The composition of multiple processing layers improves the fitting and feature extraction capability and makes them applicable to various analytical tasks. This advance offers a new solution for chemometrics toward resolving challenges related to spectral data with rapidly increased sample numbers from various sources. We further provide a practical guide to the development of a deep convolutional neural network-based analytical workflow. The design of the network structure, tuning the hyperparameters in the training process, and repeatability of results is mainly discussed. Future studies are needed on interpretability and repeatability of the deep learning approach in spectral analysis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Self-citationVery Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
(2014) · Cited by 33,419
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
Self-citationDeep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362
(2010) · Cited by 14,134
Wold, S., Esbensen, K., & Geladi, P. (1987) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/0169-7439(87)80084-9 · Cited by 11,606
Learning Deep Features for Discriminative Localization
Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., & Torralba, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.319 · Cited by 11,428
(2010) · Cited by 8,261
Recent advances in convolutional neural networks
Gu, J., Wang, Z., Kuen, J., Ma, L., Shahroudy, A., Shuai, B., Liu, T., Wang, X., Wang, G., Cai, J., et al. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.10.013 · Cited by 6,576
Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources
Zhu, X. X., Tuia, D., Mou, L., Xia, G.-S., Zhang, L., Xu, F., & Fraundorfer, F. (2017) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2017.2762307 · Cited by 3,400
Fleiss, J. L., & Cohen, J. (1973) · Educational and Psychological Measurement · doi:10.1177/001316447303300309 · Cited by 3,354
Review of the most common pre-processing techniques for near-infrared spectra
Rinnan, Å., Berg, F. V. D., & Engelsen, S. B. (2009) · TrAC Trends in Analytical Chemistry · doi:10.1016/j.trac.2009.07.007 · Cited by 3,057
Predicting the sequence specificities of DNA- and RNA-binding proteins by deep learning
Alipanahi, B., Delong, A., Weirauch, M. T., & Frey, B. J. (2015) · Nature Biotechnology · doi:10.1038/nbt.3300 · Cited by 2,873
A re-examination of text categorization methods
Yang, Y., & Liu, X. (1999) · Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/312624.312647 · Cited by 2,652
On the momentum term in gradient descent learning algorithms
Qian, N. (1999) · Neural Networks · doi:10.1016/s0893-6080(98)00116-6 · Cited by 2,312
A review of variable selection methods in Partial Least Squares Regression
Mehmood, T., Liland, K. H., Snipen, L., & Sæbø, S. (2012) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2012.07.010 · Cited by 1,591
The successive projections algorithm for variable selection in spectroscopic multicomponent analysis
Araújo, M. C. U., Saldanha, T. C. B., Galvão, R. K. H., Yoneyama, T., Chame, H. C., & Visani, V. (2001) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/s0169-7439(01)00119-8 · Cited by 1,320
(2015) · doi:10.1515/9783110417104-003 · Cited by 1,242
Near infrared spectroscopy: A mature analytical technique with new perspectives – A review
Pasquini, C. (2018) · Analytica Chimica Acta · doi:10.1016/j.aca.2018.04.004 · Cited by 1,153
A review of near infrared spectroscopy and chemometrics in pharmaceutical technologies
Roggo, Y., Chalus, P., Maurer, L., Lema-Martinez, C., Edmond, A., & Jent, N. (2007) · Journal of Pharmaceutical and Biomedical Analysis · doi:10.1016/j.jpba.2007.03.023 · Cited by 1,131
Handbook of Chemometrics and Qualimetrics
Massart, D. L., Vandeginste, B. G. M., Buydens, L. M. C., Lewi, P. J., Smeyers-Verbeke, J., & Jong, S. D. (1998) · Cited by 1,085
Variables selection methods in near-infrared spectroscopy
Xiaobo, Z., Jiewen, Z., Povey, M. J. W., Holmes, M., & Hanpin, M. (2010) · Analytica Chimica Acta · doi:10.1016/j.aca.2010.03.048 · Cited by 1,080
Auto-encoder based dimensionality reduction
Wang, Y., Yao, H., & Zhao, S. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.08.104 · Cited by 976
One weird trick for parallelizing convolutional neural networks
Krizhevsky, A. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1404.5997 · Cited by 919
An overview of variable selection methods in multivariate analysis of near-infrared spectra
Yun, Y.-H., Li, H.-D., Deng, B.-C., & Cao, D.-S. (2019) · TrAC Trends in Analytical Chemistry · doi:10.1016/j.trac.2019.01.018 · Cited by 564
Recent Advances in Recurrent Neural Networks
Salehinejad, H., Sankar, S., Barfett, J., Colak, E., & Valaee, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.01078 · Cited by 562
Breaking with trends in pre-processing?
Engel, J., Gerretzen, J., Szymańska, E., Jansen, J. J., Downey, G., Blanchet, L., & Buydens, L. M. C. (2013) · TrAC Trends in Analytical Chemistry · doi:10.1016/j.trac.2013.04.015 · Cited by 529
Deep convolutional neural networks for Raman spectrum recognition: a unified solution
Liu, J., Osadchy, M., Ashton, L., Foster, M., Solomon, C. J., & Gibson, S. J. (2017) · The Analyst · doi:10.1039/c7an01371j · Cited by 507
Large-Scale Transportation Network Congestion Evolution Prediction Using Deep Learning Theory
Ma, X., Yu, H., Wang, Y., & Wang, Y. (2015) · PLOS ONE · doi:10.1371/journal.pone.0119044 · Cited by 495
Morellos, A., Pantazi, X.-E., Moshou, D., Alexandridis, T., Whetton, R., Tziotzios, G., Wiebensohn, J., Bill, R., & Mouazen, A. M. (2016) · Biosystems Engineering · doi:10.1016/j.biosystemseng.2016.04.018 · Cited by 489
Convolutional neural networks for vibrational spectroscopic data analysis
Acquarelli, J., van Laarhoven, T., Gerretzen, J., Tran, T. N., Buydens, L. M. C., & Marchiori, E. (2017) · Analytica Chimica Acta · doi:10.1016/j.aca.2016.12.010 · Cited by 472
Using deep learning to predict soil properties from regional spectral data
Padarian, J., Minasny, B., & McBratney, A. B. (2019) · Geoderma Regional · doi:10.1016/j.geodrs.2018.e00198 · Cited by 451
Balabin, R. M., & Lomakina, E. I. (2011) · The Analyst · doi:10.1039/c0an00387e · Cited by 412
DeepSpectra: An end-to-end deep learning approach for quantitative spectral analysis
Zhang, X., Lin, T., Xu, J., Luo, X., & Ying, Y. (2019) · Analytica Chimica Acta · doi:10.1016/j.aca.2019.01.002 · Cited by 375
Self-citationCui, C., & Fearn, T. (2018) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2018.07.008 · Cited by 316
Bobelyn, E., Serban, A.-S., Nicu, M., Lammertyn, J., Nicolaï, B. M., & Saeys, W. (2009) · Postharvest Biology and Technology · doi:10.1016/j.postharvbio.2009.09.006 · Cited by 292
Balabin, R. M., Загидулловна, С. Р., & Lomakina, E. I. (2007) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2007.04.006 · Cited by 250
One‐dimensional convolutional neural networks for spectroscopic signal regression
Malek, S., Melgani, F., & Bazi, Y. (2018) · Journal of Chemometrics · doi:10.1002/cem.2977 · Cited by 248
Xu, S., Zhao, Y., Wang, M., & Shi, X. (2018) · Geoderma · doi:10.1016/j.geoderma.2017.09.013 · Cited by 223
Yu, X., Lu, H., & Wu, D. (2018) · Postharvest Biology and Technology · doi:10.1016/j.postharvbio.2018.02.013 · Cited by 202
Simple and Effective Way for Data Preprocessing Selection Based on Design of Experiments
Gerretzen, J., Szymańska, E., Jansen, J. J., Bart, J., van Manen, H.-J., van den Heuvel, E. R., & Buydens, L. M. C. (2015) · Analytical Chemistry · doi:10.1021/acs.analchem.5b02832 · Cited by 191
Artificial neural networks in chemometrics: History, examples and perspectives
Marini, F., Bucci, R., Magrì, A. L., & Magrì, A. D. (2008) · Microchemical Journal · doi:10.1016/j.microc.2007.11.008 · Cited by 186
The successive projections algorithm for spectral variable selection in classification problems
Pontes, M. J. C., Galvão, R. K. H., Araújo, M. C. U., Moreira, P. N. T., Neto, O. D. P., José, G. E., & Saldanha, T. C. B. (2005) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2004.12.001 · Cited by 177
Automatic Selection of Optimal Savitzky−Golay Smoothing
Vivó-Truyols, G., & Schoenmakers, P. J. (2006) · Analytical Chemistry · doi:10.1021/ac0600196 · Cited by 177
Ensemble preprocessing of near-infrared (NIR) spectra for multivariate calibration
Xu, L., Zhou, Y.-P., Tang, L.-J., Wu, H.-L., Jiang, J.-H., Shen, G.-L., & Yu, R.-Q. (2008) · Analytica Chimica Acta · doi:10.1016/j.aca.2008.04.031 · Cited by 167
Pre-processing in vibrational spectroscopy – when, why and how
Rinnan, Å. (2014) · Analytical Methods · doi:10.1039/c3ay42270d · Cited by 162
Hopke, P. K. (2003) · Analytica Chimica Acta · doi:10.1016/s0003-2670(03)00944-9 · Cited by 159
Food Safety Evaluation Based on Near Infrared Spectroscopy and Imaging: A Review
Fu, X., & Ying, Y. B. (2014) · Critical Reviews in Food Science and Nutrition · doi:10.1080/10408398.2013.807418 · Cited by 152
Self-citationLiu, L., Ji, M., & Buchroithner, M. F. (2018) · Sensors · doi:10.3390/s18093169 · Cited by 150
Chemometrics and qualitative analysis have a vibrant relationship
Szymańska, E., Gerretzen, J., Engel, J., Geurts, B., Blanchet, L., & Buydens, L. M. C. (2015) · TrAC Trends in Analytical Chemistry · doi:10.1016/j.trac.2015.02.015 · Cited by 135
Non-linear calibration models for near infrared spectroscopy
Ni, W., Nørgaard, L., & Mørup, M. (2013) · Analytica Chimica Acta · doi:10.1016/j.aca.2013.12.002 · Cited by 133
Yu, X., Lu, H., & Liu, Q. (2017) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2017.12.010 · Cited by 113
Yu, X., Wang, J., Wen, S., Yang, J., & Zhang, F. (2018) · Biosystems Engineering · doi:10.1016/j.biosystemseng.2018.11.018 · Cited by 110
Self-citationChen, Y., & Zhibin, W. (2018) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2018.08.001 · Cited by 103
Luypaert, J., Heuerding, S., Heyden, Y. V., & Massart, D. L. (2004) · Journal of Pharmaceutical and Biomedical Analysis · doi:10.1016/j.jpba.2004.06.023 · Cited by 102
A selective review and comparison for interval variable selection in spectroscopic modeling
Wang, L., Lin, Y., Wang, X., Xiao, N., Xu, Y., Li, H., & Xu, Q. (2017) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2017.11.008 · Cited by 73
Ni, C., Wang, D., & Tao, Y. (2018) · Spectrochimica Acta Part A Molecular and Biomolecular Spectroscopy · doi:10.1016/j.saa.2018.10.028 · Cited by 70
NIRS feature extraction based on deep auto-encoder neural network
Liu, T., Zhong-ren, L., Yu, C., & Qin, Y. (2017) · Infrared Physics & Technology · doi:10.1016/j.infrared.2017.07.015 · Cited by 66
Laxalde, J., Ruckebusch, C., Devos, O., Caillol, N., Wahl, F., & Duponchel, L. (2011) · Analytica Chimica Acta · doi:10.1016/j.aca.2011.05.048 · Cited by 65
Devos, O., & Duponchel, L. (2011) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2011.01.008 · Cited by 61
Yu, X. (2018) · Data Archiving and Networked Services (DANS) · doi:10.17632/ffkv2xj2m7.1 · Cited by 48
Krauß, S. D., Roy, R., Yosef, H. K., Lechtonen, T., El‐Mashtoly, S. F., Gerwert, K. B., & Mosig, A. (2018) · Journal of Biophotonics · doi:10.1002/jbio.201800022 · Cited by 41
Signoroni, A., Savardi, M., Pezzoni, M., Guerrini, F., Arrigoni, S., & Turra, G. (2018) · IET Computer Vision · doi:10.1049/iet-cvi.2018.5237 · Cited by 24
Cited by
Recent advances and applications of deep learning methods in materials science
Choudhary, K., DeCost, B., Chen, C., Jain, A., Tavazza, F., Cohn, R., Park, C. W., Choudhary, A., Agrawal, A., Billinge, S. J. L., et al. (2022) · npj Computational Materials · doi:10.1038/s41524-022-00734-6 · Cited by 1,172
“[221] Although most current DL work focuses on the inverse problem, i.”
BackgroundAdvancing Biosensors with Machine Learning
Cui, F., Yue, Y., Zhang, Y., Zhang, Z., & Zhou, H. S. (2020) · ACS Sensors · doi:10.1021/acssensors.0c01424 · Cited by 768
Deep learning and artificial intelligence methods for Raman and surface-enhanced Raman scattering
Lussier, F., Thibault, V., Charron, B., Wallace, G. Q., & Masson, J.-F. (2020) · TrAC Trends in Analytical Chemistry · doi:10.1016/j.trac.2019.115796 · Cited by 666
Recent Advances in Electrochemical Biosensors: Applications, Challenges, and Future Scope
Singh, A., Sharma, A., Ahmed, A., Sundramoorthy, A. K., Furukawa, H., Arya, S., & Khosla, A. (2021) · Biosensors · doi:10.3390/bios11090336 · Cited by 579
Machine Learning Applications for Mass Spectrometry-Based Metabolomics
Liebal, U. W., Phan, A. N. T., Sudhakar, M., Raman, K., & Blank, L. M. (2020) · Metabolites · doi:10.3390/metabo10060243 · Cited by 357
Metadata
- Authors
- Yang, J., Xu, J., Zhang, X., Wu, C., Lin, T., & Ying, Y.
- Venue
- Analytica Chimica Acta
- Publisher
- Elsevier BV
- Published
- 2019-11
- Volume
- 1081
- Pages
- 6-17
- ISSN
- 0003-2670 (ISSN-L)
- OpenAlex
- W2952266823
- Cited by
- 299
- References
- 71
- FWCI
- 15.49
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.