A review on spectral data preprocessing techniques for machine learning and quantitative analysis
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
Spectroscopic techniques are indispensable for material characterization, yet their weak signals remain highly prone to interference from environmental noise, instrumental artifacts, sample impurities, scattering effects, and radiation-based distortions (e.g., fluorescence and cosmic rays). These perturbations not only significantly degrade measurement accuracy but also impair machine learning-based spectral analysis by introducing artifacts and biasing feature extraction. This review provides a systematic evaluation of critical spectral preprocessing methods-encompassing cosmic ray removal, baseline correction, scattering correction, normalization, filtering and smoothing, spectral derivatives, and advanced techniques like 3D correlation analysis-highlighting their theoretical underpinnings, performance trade-offs, and optimal application scenarios. The field is undergoing a transformative shift driven by three key innovations: context-aware adaptive processing, physics-constrained data fusion, and intelligent spectral enhancement. These cutting-edge approaches enable unprecedented detection sensitivity achieving sub-ppm levels while maintaining >99% classification accuracy, with transformative applications spanning pharmaceutical quality control, environmental monitoring, and remote sensing diagnostics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
A New Approach to Linear Filtering and Prediction Problems
Kalman, R. E. (1960) · Journal of Basic Engineering · doi:10.1115/1.3662552 · Cited by 31,751
Smoothing and Differentiation of Data by Simplified Least Squares Procedures.
Savitzky, A., & Golay, M. J. E. (1964) · Analytical Chemistry · doi:10.1021/ac60214a047 · Cited by 21,904
PLS-regression: a basic tool of chemometrics
Wold, S., Sjöström, M., & Eriksson, L. (2001) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/s0169-7439(01)00155-1 · Cited by 10,084
Shin, H.-C., Roth, H. R., Gao, M., Lu, L., Xu, Z., Nogues, I., Yao, J., Mollura, D., & Summers, R. M. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2528162 · Cited by 5,759 · cited 1×
“…impairing both traditional analyses (e.g., Beer-Lambert–based quantification) and machine learning models (principal component analysis (PCA), 14 partial least squares (PLS), 15 support vector machines (SVMs), 16 k-nearest neighbors (KNN), 17 and convolutional neural networks (CNNs) 18 ).”
Martens, H., & Stark, E. (1991) · Journal of Pharmaceutical and Biomedical Analysis · doi:10.1016/0731-7085(91)80188-f · Cited by 515
Liu, X., Qiao, S., & Ma, Y. (2022) · Optics Express · doi:10.1364/oe.446294 · Cited by 97
Metadata
- Authors
- Yan, C.
- Venue
- iScience
- Publisher
- Elsevier BV
- Published
- 2025-07
- Volume
- 28
- Issue
- 7
- Pages
- 112759
- ISSN
- 2589-0042 (ISSN-L)
- OpenAlex
- W4410856291
- Cited by
- 193
- References
- 8
- FWCI
- 70.23
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A review on spectral data preprocessing techniques for machine learning and quantitative analysis. https://app.cochat.ai/papers/10.1016/j.isci.2025.112759
- The paper
- Yan, C. (2025). A review on spectral data preprocessing techniques for machine learning and quantitative analysis. iScience. https://doi.org/10.1016/j.isci.2025.112759
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.