Decomposition Methods for Machine Learning with Small, Incomplete or Noisy Datasets
Open accessThe DOI matches its Crossref record; 66 of the 66 references it cites were found in a registry or an index.
Abstract
In many machine learning applications, measurements are sometimes incomplete or noisy resulting in missing features. In other cases, and for different reasons, the datasets are originally small, and therefore, more data samples are required to derive useful supervised or unsupervised classification methods. Correct handling of incomplete, noisy or small datasets in machine learning is a fundamental and classic challenge. In this article, we provide a unified review of recently proposed methods based on signal decomposition for missing features imputation (data completion), classification of noisy samples and artificial generation of new data samples (data augmentation). We illustrate the application of these signal decomposition methods in diverse selected practical machine learning examples including: brain computer interface, epileptic intracranial electroencephalogram signals classification, face recognition/verification and water networks data analysis. We show that a signal decomposition approach can provide valuable tools to improve machine learning performance with low quality datasets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Donoho, D. L. (2006) · IEEE Transactions on Information Theory · doi:10.1109/tit.2006.871582 · Cited by 23,994
Huang, N. E., Shen, Z., Long, S. R., Wu, M. C., Shih, H. H., Zheng, Q., Yen, N.-C., Tung, C. C., & Liu, H. H. (1998) · Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rspa.1998.0193 · Cited by 23,564 · cited 1×
“in [45] as a new method to analyze nonlinear and non-stationary signals.”
MethodLIII. On lines and planes of closest fit to systems of points in space
Pearson, K. (1901) · The London, Edinburgh, and Dublin Philosophical Magazine and Journal of Science · doi:10.1080/14786440109462720 · Cited by 11,934
Tensor Decompositions and Applications
Kolda, T. G., & Bader, B. W. (2009) · SIAM Review · doi:10.1137/07070111x · Cited by 10,301 · cited 2×
“As a particular case, when core tensor is diagonal with R = R1 = R2 = R3 this model is reduced to the CANDECOMP/PARAFAC or CP(R) decomposition model (see Figure 1f), which has demonstrated to be very useful in a wide range of applications [47,48].”
BackgroundMethodAn Introduction To Compressive Sampling
Candes, E. J., & Wakin, M. B. (2008) · IEEE Signal Processing Magazine · doi:10.1109/msp.2007.914731 · Cited by 10,017 · cited 1×
“Sparse coding has to date a large record of successful applications in signal processing tasks like compressed sensing [41,42], blind source separation [43], denoising [39], inpainting [44] and others.”
BackgroundSignal Recovery From Random Measurements Via Orthogonal Matching Pursuit
Tropp, J. A., & Gilbert, A. C. (2007) · IEEE Transactions on Information Theory · doi:10.1109/tit.2007.909108 · Cited by 9,653 · cited 4×
“TK (Tucker) and CP (CANDECOMP/PARAFAC) indicate the decomposition model used by the algorithms.”
MethodInfluentialImage Denoising Via Sparse and Redundant Representations Over Learned Dictionaries
Elad, M., & Aharon, M. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.881969 · Cited by 5,321
Atomic Decomposition by Basis Pursuit
Chen, S. S., Donoho, D. L., & Saunders, M. A. (2001) · SIAM Review · doi:10.1137/s003614450037906x · Cited by 5,085
ADASYN: Adaptive synthetic sampling approach for imbalanced learning
He, H., Bai, Y., Garcia, E. A., & Li, S. (2008) · 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence) · doi:10.1109/ijcnn.2008.4633969 · Cited by 4,521 · cited 2×
“Akter et al. [56] successfully applied data augmentation based on an adaptive synthetic oversampling approach (ADASYN) [66] to balance an in-hospital dataset of epileptic interictal iEEG signals to identify the seizure onset zones automatically.”
MethodCoSaMP: Iterative signal recovery from incomplete and inaccurate samples
Needell, D., & Tropp, J. A. (2009) · Applied and Computational Harmonic Analysis · doi:10.1016/j.acha.2008.07.002 · Cited by 4,326
Research works printed but not linked: 4
- Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, MIT Press.
- Tomasi, C., and Manduchi, R. (1998, January 4–7). Bilateral filtering for gray and color images. Proceedings of the Sixth International Conference on Computer Vision, Washington, DC, USA.
- Gonzalez, R.C., and Woods, R.E. (2008). Digital Image Processing, Prentice Hall.
- Tukey, J.W. (1977). Exploratory Data Analysis, Addison-Wesley.
Cited by
Machine Learning for Perovskite Solar Cells and Component Materials: Key Technologies and Prospects
Liu, Y., Tan, X., Liang, J., Han, H., Xiang, P., & Yan, W. (2023) · Advanced Functional Materials · doi:10.1002/adfm.202214271 · Cited by 174
A Comprehensive Survey of Machine Learning Methodologies with Emphasis in Water Resources Management
Drogkoula, M., Kokkinos, K., & Samaras, N. (2023) · Applied Sciences · doi:10.3390/app132212147 · Cited by 208
“Our findings are depicted in the PRISMA diagram (Figure 3).”
MethodA Comparison of Machine Learning Methods to Forecast Tropospheric Ozone Levels in Delhi
Juarez, E. K., & Petersen, M. (2021) · Atmosphere · doi:10.3390/atmos13010046 · Cited by 64
“Additional preprocessing could also compensate for missing data with decomposition methods [43].”
MethodTower crane safety technologies: A synthesis of academic research and industry insights
Ali, A. H., Zayed, T. M., Wang, R. D., & Kit, M. Y. S. (2024) · Automation in Construction · doi:10.1016/j.autcon.2024.105429 · Cited by 58
Machine Learning Methods with Noisy, Incomplete or Small Datasets
Caiafa, C. F., Sun, Z., Tanaka, T., Martí-Puig, P., & Solé‐Casals, J. (2021) · Applied Sciences · doi:10.3390/app11094132 · Cited by 39
“In [1], the EMD method was applied to remove noise in face images, thus improving the classification accuracy of a machine learning classifier.”
BackgroundMethodSelf-citation
Metadata
- Authors
- Caiafa, C. F., Solé-Casals, J., Marti-Puig, P., Zhe, S., & Tanaka, T.
- Affiliations
- Consejo Nacional de Investigaciones Científicas y Técnicas (AR)
- Data and Signal Processing Research Group, University of Vic-Central University of Catalonia, 08500 Vic, Catalonia, Spain
- Computational Engineering Applications Unit, Head Office for Information Systems and Cybersecurity, RIKEN, Wako-Shi 351-0198, Japan
- Tokyo University of Agriculture and Technology (JP)
- Corresponding author
- Caiafa, Cesar Federico
- Venue
- Applied Sciences
- Publisher
- MDPI AG
- Published
- 2020-11-27
- Volume
- 10
- Issue
- 23
- Pages
- 8481
- ISSN
- 2076-3417 (ISSN-L)
- OpenAlex
- W3109443741
- Cited by
- 33
- References
- 66
- Citations by year
- 2026: 4 · 2025: 9 · 2024: 5 · 2023: 10 · 2022: 1 · 2021: 4
- FWCI
- 1.47
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Applied Sciences (publishedVersion, cc-by)
- LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) (submittedVersion, cc-by-nc-sa)
- CONICET Digital (CONICET) (submittedVersion, cc-by-nc-sa)
- Funders
- Japan Science and Technology Agency (JPMJCR1784)
- University of Vic (R0947)
- European Cooperation in Science and Technology (CA18106)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Imbalanced Data Classification Techniques
- Keywords
- signal decomposition, missing data imputation, noisy data classification, data augmentation, small datasets, missing data, brain-computer interface, epileptic EEG, face recognition, face verification, water networks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Decomposition Methods for Machine Learning with Small, Incomplete or Noisy Datasets. https://app.cochat.ai/papers/10.3390/app10238481
- The paper
- Caiafa, C. F., Solé-Casals, J., Marti-Puig, P., Zhe, S., & Tanaka, T. (2020). Decomposition Methods for Machine Learning with Small, Incomplete or Noisy Datasets. Applied Sciences. https://doi.org/10.3390/app10238481
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.