The DOI matches its Crossref record; 65 of the 65 references it cites were found in a registry or an index.
A Comprehensive Review of Dimensionality Reduction Techniques for Feature Selection and Feature Extraction
Open accessAbstract
Due to sharp increases in data dimensions, working on every data mining or machine learning (ML) task requires more efficient techniques to get the desired results. Therefore, in recent years, researchers have proposed and developed many methods and techniques to reduce the high dimensions of data and to attain the required accuracy. To ameliorate the accuracy of learning features as well as to decrease the training time dimensionality reduction is used as a pre-processing step, which can eliminate irrelevant data, noise, and redundant features. Dimensionality reduction (DR) has been performed based on two main methods, which are feature selection (FS) and feature extraction (FE). FS is considered an important method because data is generated continuously at an ever-increasing rate; some serious dimensionality problems can be reduced with this method, such as decreasing redundancy effectively, eliminating irrelevant data, and ameliorating result comprehensibility. Moreover, FE transacts with the problem of finding the most distinctive, informative, and decreased set of features to ameliorate the efficiency of both the processing and storage of data. This paper offers a comprehensive approach to FS and FE in the scope of DR. Moreover, the details of each paper, such as used algorithms/approaches, datasets, classifiers, and achieved results are comprehensively analyzed and summarized. Besides, a systematic discussion of all of the reviewed methods to highlight authors' trends, determining the method(s) has been done, which significantly reduced computational time, and selecting the most accurate classifiers. As a result, the different types of both methods have been discussed and analyzed the findings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
Zebari, D. A., Haron, H., Zeebaree, S. R. M., & Zeebaree, D. Q. (2019) · International Conference on Advanced Science and Engineering (ICOASE) · doi:10.1109/icoase.2019.8723779 · Cited by 46
Self-citationRetractedFeature selection for classification
DASH, M., & LIU, H. (1997) · Intelligent Data Analysis · doi:10.1016/s1088-467x(97)00008-5 · Cited by 3,574
Martínez, A. M. (1998) · CTIT technical reports series · Cited by 2,778
Parameterisation of a stochastic model for human face identification
Samaria, F. S., & Harter, A. C. (2002) · Proceedings of 1994 IEEE Workshop on Applications of Computer Vision · doi:10.1109/acv.1994.341300 · Cited by 2,593
The FERET database and evaluation procedure for face-recognition algorithms
Phillips, P. J., Wechsler, H., Huang, J., & Rauss, P. J. (1998) · Image and Vision Computing · doi:10.1016/s0262-8856(97)00070-x · Cited by 2,431
Encyclopedia of Database Systems
(2009) · Springer eBooks · doi:10.1007/978-0-387-39940-9 · Cited by 1,739
Potential of fecal microbiota for early-stage detection of colorectal cancer
Zeller, G., Tap, J., Voigt, A. Y., Sunagawa, S., Kultima, J. R., Costea, P. I., Amiot, A., Böhm, J., Brunetti, F., Habermann, N., et al. (2014) · Molecular Systems Biology · doi:10.15252/msb.20145645 · Cited by 1,375
A Review of Feature Selection and Feature Extraction Methods Applied on Microarray Data
Hira, Z. M., & Gillies, D. F. (2015) · Advances in Bioinformatics · doi:10.1155/2015/198363 · Cited by 936
The Curse of Dimensionality in Data Mining and Time Series Prediction
Verleysen, M., & François, D. (2005) · Lecture Notes in Computer Science · doi:10.1007/11494669_93 · Cited by 681
Stability of feature selection algorithm: A review
Khaire, U. M., & Dhanalakshmi, R. (2022) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2019.06.012 · Cited by 630
A survey on filter techniques for feature selection in gene expression microarray analysis
Lazar, C., Taminau, J., Meganck, S., Steenhoff, D., Coletta, A., Molter, C., de Schaetzen, V., Duque, R., Bersini, H., & Nowe, A. (2012) · IEEE/ACM Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2012.33 · Cited by 619
Overview and comparative study of dimensionality reduction techniques for high dimensional data
Ayesha, S., Hanif, M. K., & Talib, R. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.01.005 · Cited by 569
The human gut microbiome as a screening tool for colorectal cancer
Zackular, J. P., Rogers, M. A. M., Ruffin, M. T., & Schloss, P. D. (2014) · Cancer Prevention Research · doi:10.1158/1940-6207.capr-14-0129 · Cited by 551
Eesa, A. S., Orman, Z., & Brifcani, A. M. A. (2015) · Expert Systems with Applications · doi:10.1016/j.eswa.2014.11.009 · Cited by 376
A deep learning method with wrapper based feature extraction for wireless intrusion detection system
Kasongo, S. M., & Sun, Y. (2020) · Computers & Security · doi:10.1016/j.cose.2020.101752 · Cited by 373
Feature selection and classification systems for chronic disease prediction: A review
Jain, D., & Singh, V. (2018) · Egyptian Informatics Journal · doi:10.1016/j.eij.2018.03.002 · Cited by 368
A Review of Dimensionality Reduction Techniques for Efficient Computation
Velliangiri, S., Alagumuthukrishnan, S., & Thankumar joseph, S. I. (2019) · Procedia Computer Science · doi:10.1016/j.procs.2020.01.079 · Cited by 321
A novel feature selection approach for biomedical data classification
Peng, Y., Wu, Z., & Jiang, J. (2010) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2009.07.008 · Cited by 257
A new wrapper feature selection approach using neural network
Monirul Kabir, M., Monirul Islam, M., & Murase, K. (2010) · Neurocomputing · doi:10.1016/j.neucom.2010.04.003 · Cited by 233
Mohammed, M. A., Al-Khateeb, B., Rashid, A. N., Ibrahim, D. A., Abd Ghani, M. K., & Mostafa, S. A. (2018) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2018.01.033 · Cited by 180
A Review on Dimensionality Reduction Techniques
Huang, X., Wu, L., & Ye, Y. (2019) · International Journal of Pattern Recognition and Artificial Intelligence · doi:10.1142/s0218001419500174 · Cited by 178
Asadur Rahman, M., Foisal Hossain, M., Hossain, M., & Ahmmed, R. (2020) · Egyptian Informatics Journal · doi:10.1016/j.eij.2019.10.002 · Cited by 174
Dimension reduction of image deep feature using PCA
Ma, J., & Yuan, Y. (2019) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2019.102578 · Cited by 167
A Multiple-Filter-Multiple-Wrapper Approach to Gene Selection and Microarray Data Classification
Leung, Y., & Hung, Y. (2010) · IEEE/ACM Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2008.46 · Cited by 159
Visalakshi, S., & Radha, V. (2014) · IEEE International Conference on Computational Intelligence and Computing Research (ICCIC) · doi:10.1109/iccic.2014.7238499 · Cited by 151
Niu, T., Wang, J., Lu, H., Yang, W., & Du, P. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113237 · Cited by 150
Structured optimal graph based sparse feature extraction for semi-supervised learning
Liu, Z., Lai, Z., Ou, W., Zhang, K., & Zheng, R. (2020) · Signal Processing · doi:10.1016/j.sigpro.2020.107456 · Cited by 143
A review on feature selection and feature extraction for text classification
Shah, F., & Patel, V. D. (2016) · International Conference on Wireless Communications, Signal Processing and Networking (WiSPNET) · doi:10.1109/wispnet.2016.7566545 · Cited by 142
Integrating Conventional and Inverse Representation for Face Recognition
Xu, Y. J., Li, X., Yang, J. J., Lai, Z., & Zhang, D. D. (2014) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2013.2293391 · Cited by 138
Li, M., Wang, H., Yang, L., Liang, Y., Shang, Z., & Wan, H. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113277 · Cited by 124
Gene Selection and Classification of Microarray Data Using Convolutional Neural Network
Zeebaree, D. Q., Haron, H., & Abdulazeez, A. (2018) · 2018 International Conference on Advanced Science and Engineering (ICOASE) · doi:10.1109/icoase.2018.8548836 · Cited by 114
Self-citationKuncan, M., Kaplan, K., Mınaz, M. R., Kaya, Y., & Ertunç, H. M. (2019) · ISA Transactions · doi:10.1016/j.isatra.2019.11.006 · Cited by 100
Rabin, N., Kahlon, M., Malayev, S., & Ratnovsky, A. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113281 · Cited by 100
Online anomaly detection using dimensionality reduction techniques for HTTP log analysis
Juvonen, A., Sipola, T., & Hämäläinen, T. (2015) · Computer Networks · doi:10.1016/j.comnet.2015.07.019 · Cited by 99
Dimension reduction methods for microarray data: a review
Aziz, R. M., Verma, C. K., & Srivastava, N. (2017) · AIMS bioengineering · doi:10.3934/bioeng.2017.1.179 · Cited by 95
Hybrid fast unsupervised feature selection for high-dimensional data
Manbari, Z., Tab, F. A., & Salavati, C. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.01.016 · Cited by 92
Fatima, A., Maurya, R., Dutta, M. K., Bürget, R., & Mašek, J. (2019) · International Conference on Telecommunications and Signal Processing (TSP) · doi:10.1109/tsp.2019.8769039 · Cited by 90
Discriminative low-rank preserving projection for dimensionality reduction
Liu, Z., Wang, J., Liu, G., & Zhang, L. (2019) · Applied Soft Computing · doi:10.1016/j.asoc.2019.105768 · Cited by 89
Gene Expression Classification Based on Deep Learning
Ahmed, O., & Brifcani, A. M. A. (2019) · Scientific International Conference Najaf (SICN) · doi:10.1109/sicn47020.2019.9019357 · Cited by 87
Chen, X., Li, J., Zhang, Y.-C. S. L.-G., Lu, Y., & Liu, S. (2019) · Future Generation Computer Systems · doi:10.1016/j.future.2019.10.032 · Cited by 84
Combination of K-means clustering with Genetic Algorithm: A review
Zeebaree, D. Q. (2017) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.14563773 · Cited by 74
Self-citationTan, P., Wang, X., & Wang, Y. (2019) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2019.100597 · Cited by 64
The Effect of Dimensionality Reduction on Software Vulnerability Prediction Models
Stuckman, J., Walden, J., & Scandariato, R. (2016) · IEEE Transactions on Reliability · doi:10.1109/tr.2016.2630503 · Cited by 61
An Efficient Hybrid Feature Selection model for Dimensionality Reduction
Jain, D. K., & Singh, V. P. (2018) · Procedia Computer Science · doi:10.1016/j.procs.2018.05.188 · Cited by 56
Padmaja, D. L., & Vishnuvardhan, B. (2016) · IEEE International Conference on Advanced Computing (IACC) · doi:10.1109/iacc.2016.16 · Cited by 54
A Comparison of Three Classification Algorithms for Handwritten Digit Recognition
Abdulrazzaq, M. B., & Saeed, J. N. (2019) · International Conference on Advanced Science and Engineering (ICOASE) · doi:10.1109/icoase.2019.8723702 · Cited by 54
Self-citationHosseini, E. S., & Moattar, M. H. (2019) · Applied Soft Computing · doi:10.1016/j.asoc.2019.105581 · Cited by 54
Study of dimension reduction methodologies in data mining
Sharma, N., & Saroha, K. (2015) · International Conference on Computing, Communication and Automation · doi:10.1109/ccaa.2015.7148359 · Cited by 42
IMU-Based Robust Human Activity Recognition using Feature Analysis, Extraction, and Reduction
Dehzangi, O., & Sahu, V. (2018) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2018.8546311 · Cited by 40
Alipour-Fard, T., Arefi, H., & Mahmoudi, S. (2018) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2018.8518956 · Cited by 38
A Review on Dimensionality Reduction Techniques
Jindal, P., & Kumar, D. (2017) · International Journal of Computer Applications · doi:10.5120/ijca2017915260 · Cited by 37
Multi-Level of DNA Encryption Technique Based on DNA Arithmetic and Biological Operations
Zebari, D. A., Haron, H., Zeebaree, S. R. M., & Zeebaree, D. Q. (2018) · International Conference on Advanced Science and Engineering (ICOASE) · doi:10.1109/icoase.2018.8548824 · Cited by 36
Self-citationA Novel Efficient Feature Dimensionality Reduction Method and Its Application in Engineering
Cheng, Z., & Lu, Z. (2018) · Complexity · doi:10.1155/2018/2879640 · Cited by 34
Taxonomy dimension reduction for colorectal cancer prediction
Qu, K., Gao, F., Guo, F., & Zou, Q. (2019) · Computational Biology and Chemistry · doi:10.1016/j.compbiolchem.2019.107160 · Cited by 31
Sulaiman, D. M., Abdulazeez, A. M., Haron, H., & Sadiq, S. S. (2019) · International Conference on Advanced Science and Engineering (ICOASE) · doi:10.1109/icoase.2019.8723749 · Cited by 27
Self-citationGait-Based Human Gender Classification Using Lifting 5/3 Wavelet and Principal Component Analysis
Hassan, O. M. S., Abdulazeez, A. M., & Tiryaki, V. M. (2018) · International Conference on Advanced Science and Engineering (ICOASE) · doi:10.1109/icoase.2018.8548909 · Cited by 24
Self-citationNagarajan, V., Britto, E. C., & Veeraputhiran, S. M. (2019) · Medicine in Novel Technology and Devices · doi:10.1016/j.medntd.2019.100004 · Cited by 23
A Simultaneous Approach for Compression and Encryption Techniques Using Deoxyribonucleic Acid
Zebari, D. A., Haron, H., Zeebaree, D. Q., & Zain, A. M. (2019) · International Conference on Software, Knowledge, Information Management and Applications (SKIMA) · doi:10.1109/skima47702.2019.8982392 · Cited by 23
Self-citationA SURVEY OF ULTRASONOGRAPHY BREAST CANCER IMAGE SEGMENTATION TECHNIQUES
Saeed, J. N. (2020) · Academic Journal of Nawroz University · doi:10.25007/ajnu.v9n1a523 · Cited by 21
Self-citationCombining Noise Correction with Feature Selection
Teng, C. M. (2003) · Lecture notes in computer science · doi:10.1007/978-3-540-45228-7_34 · Cited by 20
Dimensionality Reduction Based on Feature Selection for Rice Varieties Recognition
Duong, H. T., & Hoang, V. T. (2019) · doi:10.1109/incit.2019.8912121 · Cited by 19
A feature extraction model based on discriminative graph signals
Lin, W., Huang, J., Suen, C. Y., & Yang, L. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.112861 · Cited by 16
Han, X., Liu, P., Wang, L., & Li, D. (2019) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2019.103283 · Cited by 15
Deep Feature Selection using an Enhanced Sparse Group Lasso Algorithm
Farokhmanesh, F., & Sadeghi, M. T. (2019) · Iranian Conference on Electrical Engineering · doi:10.1109/iraniancee.2019.8786386 · Cited by 13
Li, Y., Chai, Y., Zhou, H., & Yin, H. (2019) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2019.12.420 · Cited by 13
Cited by
Classification Based on Decision Tree Algorithm for Machine Learning
Charbuty, B., & Abdulazeez, A. (2021) · Journal of Applied Science and Technology Trends · doi:10.38094/jastt20165 · Cited by 1,871
Self-citationFeature dimensionality reduction: a review
Jia, W., Sun, M., Lian, J., & Hou, S. (2022) · Complex & Intelligent Systems · doi:10.1007/s40747-021-00637-x · Cited by 797
Feature selection techniques for machine learning: a survey of more than two decades of research
Theng, D., & Bhoyar, K. K. (2024) · Knowledge and Information Systems · doi:10.1007/s10115-023-02010-5 · Cited by 510
Machine Learning Applications based on SVM Classification A Review
Mustafa Abdullah, D., & Mohsin Abdulazeez, A. (2021) · Qubahan Academic Journal · doi:10.48161/qaj.v1n2a50 · Cited by 376
Yin, Y., Jang-Jaccard, J., Xu, W., Singh, A., Zhu, J., Sabrina, F., & Kwak, J. (2023) · Journal of Big Data · doi:10.1186/s40537-023-00694-8 · Cited by 321
Metadata
- Authors
- Zebari, R., Abdulazeez, A., Zeebaree, D., Zebari, D., & Saeed, J.
- Venue
- Journal of Applied Science and Technology Trends
- Published
- 2020-05-15
- Volume
- 1
- Issue
- 1
- Pages
- 56-70
- ISSN
- 2708-0757 (ISSN-L)
- OpenAlex
- W3024333932
- Cited by
- 918
- References
- 65
- FWCI
- 37.58
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.