The DOI matches its Crossref record; 70 of the 70 references it cites were found in a registry or an index.
Investigating the impact of data normalization on classification performance
Abstract
Abstract Data normalization is one of the pre-processing approaches where the data is either scaled or transformed to make an equal contribution of each feature. The success of machine learning algorithms depends upon the quality of the data to obtain a generalized predictive model of the classification problem. The importance of data normalization for improving data quality and subsequently the performance of machine learning algorithms has been presented in many studies. But, the work lacks for the feature selection and feature weighting approaches, a current research trend in machine learning for improving performance. Therefore, this study aims to investigate the impact of fourteen data normalization methods on classification performance considering full feature set, feature selection, and feature weighting. In this paper, we also present a modified Ant Lion optimization that search feature subsets and the best feature weights along with the parameter of Nearest Neighbor Classifier. Experiments are performed on 21 publicly available real and synthetic datasets, and results are analyzed based on the accuracy, the percentage of feature reduced and runtime. It has been observed from the results that no single method outperforms others. Therefore, we have suggested a set of the best and the worst methods combining the normalization procedure and empirical analysis of results. The better performers are z -Score and Pareto Scaling for the full feature set and feature selection, and tanh and its variant for feature weighting. The worst performers are Mean Centered, Variable Stability Scaling and Median and Median Absolute Deviation methods along with un-normalized data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Data mining: concepts and techniques
(2012) · Choice Reviews Online · doi:10.5860/choice.49-3305 · Cited by 28,531
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 25,410
Nearest neighbor pattern classification
Cover, T., & Hart, P. (1967) · IEEE Transactions on Information Theory · doi:10.1109/tit.1967.1053964 · Cited by 16,936
Individual Comparisons by Ranking Methods
Wilcoxon, F. (1945) · Biometrics Bulletin · doi:10.2307/3001968 · Cited by 15,354
Introduction to Statistical Pattern Recognition
(1990) · Elsevier eBooks · doi:10.1016/c2009-0-27872-x · Cited by 11,031
Peng, H., Long, F., & Ding, C. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.159 · Cited by 10,544
Advances in Neural Information Processing Systems 14: Proceedings of the 2001 Conference
(2002) · The MIT Press eBooks · doi:10.7551/mitpress/1120.001.0001 · Cited by 8,890
An introduction to variable and feature selection
GuyonIsabelle, & ElisseeffAndré (2003) · Journal of Machine Learning Research · doi:10.5555/944919.944968 · Cited by 7,715
An Introduction to Variable and Feature Selection.
Guyon, I., & Elisseeff, A. (2003) · Cited by 6,576
A Practical Guide to Support Vector Classication
Hsu, C., Chang, C.-C., & Lin, C. (2008) · Cited by 5,046
Procedures for Detecting Outlying Observations in Samples
Grubbs, F. E. (1969) · Technometrics · doi:10.1080/00401706.1969.10490657 · Cited by 4,105
Robust Statistics: The Approach Based on Influence Functions
Ruppert, D. (1987) · Technometrics · doi:10.2307/1269782 · Cited by 3,880
Mirjalili, S. (2015) · Advances in Engineering Software · doi:10.1016/j.advengsoft.2015.01.010 · Cited by 3,233
A Comparison of Alternative Tests of Significance for the Problem of $m$ Rankings
Friedman, M. (1940) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177731944 · Cited by 2,785
van den Berg, R. A., Hoefsloot, H. C., Westerhuis, J. A., Smilde, A. K., & van der Werf, M. J. (2006) · BMC Genomics · doi:10.1186/1471-2164-7-142 · Cited by 2,450
Score normalization in multimodal biometric systems
Jain, A., Nandakumar, K., & Ross, A. (2005) · Pattern Recognition · doi:10.1016/j.patcog.2005.01.012 · Cited by 2,154
A Cooperative Approach to Particle Swarm Optimization
vandenBergh, F., & Engelbrecht, A. P. (2004) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2004.826069 · Cited by 2,120
Alternatives to the Median Absolute Deviation
Rousseeuw, P. J., & Croux, C. (1993) · Journal of the American Statistical Association · doi:10.1080/01621459.1993.10476408 · Cited by 1,949
A Survey on Evolutionary Computation Approaches to Feature Selection
Xue, B., Zhang, M., Browne, W. N., & Yao, X. (2016) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2015.2504420 · Cited by 1,841
Real-Coded Genetic Algorithms and Interval-Schemata
Eshelman, L. J., & Schaffer, J. D. (1993) · Foundations of Genetic Algorithms · doi:10.1016/b978-0-08-094832-4.50018-0 · Cited by 1,650
Alternatives to the Median Absolute Deviation
Rousseeuw, P. J., & Croux, C. (1993) · Journal of the American Statistical Association · doi:10.2307/2291267 · Cited by 1,466
Efficient kNN classification with different numbers of nearest neighbors
Zhang, S., Li, X., Zong, M., Zhu, X., & Wang, R. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2673241 · Cited by 1,378
Data Preprocessing in Data Mining
García, S., Luengo, J., & Herrera, F. (2015) · Intelligent Systems Reference Library · doi:10.1007/978-3-319-10247-4 · Cited by 1,368
A GA-based feature selection and parameters optimizationfor support vector machines
Huang, C.-L., & Wang, C.-J. (2006) · Expert Systems with Applications · doi:10.1016/j.eswa.2005.09.024 · Cited by 1,363
Eriksson, L., Jaworska, J., Worth, A. P., Cronin, M. T. D., McDowell, R. M., & Gramatica, P. (2003) · Environmental Health Perspectives · doi:10.1289/ehp.5758 · Cited by 1,325
Stanfill, C., & Waltz, D. (1986) · Communications of the ACM · doi:10.1145/7902.7906 · Cited by 1,218
Statistical Comparisons of Classifiers over Multiple Data Sets
DemšarJanez (2006) · Journal of Machine Learning Research · doi:10.5555/1248547.1248548 · Cited by 1,074
Weston, J., Mukherjee, S., Chapelle, O., Pontil, M., Poggio, T., & Vapnik, V. N. (2000) · Cited by 988
Lin, S.-W., Ying, K.-C., Chen, S.-C., & Lee, Z.-J. (2008) · Expert Systems with Applications · doi:10.1016/j.eswa.2007.08.088 · Cited by 895
Sola, J., & Sevilla, J. (1997) · IEEE Transactions on Nuclear Science · doi:10.1109/23.589532 · Cited by 856
A novel particle swarm optimization algorithm with adaptive inertia weight
Nickabadi, A., Ebadzadeh, M. M., & Safabakhsh, R. (2011) · Applied Soft Computing · doi:10.1016/j.asoc.2011.01.037 · Cited by 806
Wettschereck, D., Aha, D. W., & Mohri, T. (1997) · Artificial Intelligence Review · doi:10.1023/a:1006593614256 · Cited by 717
A Fast Clustering-Based Feature Subset Selection Algorithm for High-Dimensional Data
Song, Q., Ni, J., & Wang, G. (2013) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2011.181 · Cited by 663
2004 IEEE International Joint Conference on Neural Networks
(2004) · 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat No 04CH37541) IJCNN-04 · doi:10.1109/ijcnn.2004.1381025 · Cited by 574
A distributed PSO–SVM hybrid system with feature selection and parameter optimization
Huang, C.-L., & Dun, J.-F. (2008) · Applied Soft Computing · doi:10.1016/j.asoc.2007.10.007 · Cited by 573
Large-scale evaluation of multimodal biometric authentication using state-of-the-art systems
Snelick, R., Uludag, U., Mink, A., Indovina, M., & Jain, A. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.57 · Cited by 516
Scaling and Normalization Effects in NMR Spectroscopic Metabonomic Data Sets
Craig, A., Cloarec, O., Holmes, E., Nicholson, J. K., & Lindon, J. C. (2006) · Analytical Chemistry · doi:10.1021/ac0519312 · Cited by 494
Introduction to statistical pattern recognition
Davis, J. C. (1996) · Computers & Geosciences · doi:10.1016/0098-3004(96)00017-9 · Cited by 463
Feature normalization and likelihood-based similarity measures for image retrieval
Aksoy, S., & Haralick, R. M. (2001) · Pattern Recognition Letters · doi:10.1016/s0167-8655(00)00112-4 · Cited by 457
Feature level fusion of hand and face biometrics
Ross, A. A., & Govindarajan, R. (2005) · SPIE Proceedings · doi:10.1117/12.606093 · Cited by 392
Ant Lion Optimization Algorithm for optimal location and sizing of renewable distributed generations
Ali, E. S., Abd Elazim, S. M., & Abdelaziz, A. Y. (2017) · Renewable Energy · doi:10.1016/j.renene.2016.09.023 · Cited by 366
Iterative RELIEF for Feature Weighting: Algorithms, Theories, and Applications
Sun, Y. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1093 · Cited by 342
An improved particle swarm optimization for feature selection
Liu, Y., Wang, G., Chen, H., Dong, H., Zhu, X., & Wang, S. (2011) · Journal of Bionic Engineering · doi:10.1016/s1672-6529(11)60020-6 · Cited by 324
Automated Diagnosis of Glaucoma Using Texture and Higher Order Spectra Features
Acharya, U. R., Dua, S., Du, X., Sree, S. V., & Chua, C. K. (2011) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2011.2119322 · Cited by 316
Supervised hybrid feature selection based on PSO and rough sets for medical diagnosis
Inbarani, H. H., Azar, A. T., & Jothi, G. (2014) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2013.10.007 · Cited by 307
A new hybrid ant colony optimization algorithm for feature selection
Kabir, M. M., Shahjahan, M., & Murase, K. (2012) · Expert Systems with Applications · doi:10.1016/j.eswa.2011.09.073 · Cited by 252
Personal Authentication Using Finger Knuckle Surface
Kumar, A., & Ravikanth, C. (2009) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2008.2011089 · Cited by 248
Improved binary particle swarm optimization using catfish effect for feature selection
Chuang, L.-Y., Tsai, S.-W., & Yang, C.-H. (2011) · Expert Systems with Applications · doi:10.1016/j.eswa.2011.04.057 · Cited by 240
Normalization as a Preprocessing Engine for Data Mining and the Approach of Preference Matrix
Al Shalabi, L., & Shaaban, Z. (2006) · 2006 International Conference on Dependability of Computer Systems · doi:10.1109/depcos-relcomex.2006.38 · Cited by 225
A method of SVM with Normalization in Intrusion Detection
li, W., & Liu, Z. (2011) · Procedia Environmental Sciences · doi:10.1016/j.proenv.2011.12.040 · Cited by 222
Tahir, M. A., Bouridane, A., & Kurugöllü, F. (2006) · Pattern Recognition Letters · doi:10.1016/j.patrec.2006.08.016 · Cited by 203
Trading MIPS and memory for knowledge engineering
Creecy, R. H., Masand, B. M., Smith, S. J., & Waltz, D. L. (1992) · Communications of the ACM · doi:10.1145/135226.135228 · Cited by 182
Efficient Feature Selection and Classification for Vehicle Detection
Wen, X., Shao, L., Fang, W., & Xue, Y. (2015) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2014.2358031 · Cited by 178
Learning weighted metrics to minimize nearest-neighbor classification error
Paredes, R., & Vidal, E. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.145 · Cited by 163
Preprocessing of analytical profiles in the presence of homoscedastic or heteroscedastic noise
Kvalheim, O. M., Brakstad, F., & Liang, Y. (1994) · Analytical Chemistry · doi:10.1021/ac00073a010 · Cited by 161
Multisensor Wireless System for Eccentricity and Bearing Fault Detection in Induction Motors
Esfahani, E. T., Wang, S., & Sundararajan, V. (2014) · IEEE/ASME Transactions on Mechatronics · doi:10.1109/tmech.2013.2260865 · Cited by 160
2004 Conference on Computer Vision and Pattern Recognition Workshop
(2004) · doi:10.1109/cvprw.2004 · Cited by 146
A Proposal for Local $k$ Values for $k$ -Nearest Neighbor Rule
García‐Pedrajas, N., Romero-del-Castillo, J. A., & García, G. C. (2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2506821 · Cited by 125
Scaling techniques to enhance two-dimensional correlation spectra
Noda, I. (2008) · Journal of Molecular Structure · doi:10.1016/j.molstruc.2007.12.026 · Cited by 118
Wang, C.-M., & Huang, Y. (2008) · Expert Systems with Applications · doi:10.1016/j.eswa.2008.07.026 · Cited by 117
Liu, D., Chen, H., Yang, B., Lv, X.-E., Li, L., & Liu, J. (2011) · Journal of Medical Systems · doi:10.1007/s10916-011-9815-x · Cited by 91
Ekenel, H. K., & Stiefelhagen, R. (2006) · IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2006.29 · Cited by 90
Large Margin Feature Weighting Method via Linear Programming
Chen, B., Liu, H., Chai, J., & Bao, Z. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2008.238 · Cited by 77
The Impact of Data Normalization on Stock Market Prediction: Using SVM and Technical Indicators
Pan, J., Zhuang, Y., & Fong, S. J. (2016) · Communications in computer and information science · doi:10.1007/978-981-10-2777-2_7 · Cited by 75
Feature Selection with Discrete Binary Differential Evolution
He, X., Zhang, Q., Sun, N., & Dong, Y. X. (2009) · doi:10.1109/aici.2009.438 · Cited by 74
A New Multi-layer Perceptrons Trainer Based on Ant Lion Optimization Algorithm
Yamany, W., Tharwat, A., Hassanin, M. F., Gaber, T., Hassanien, A. E., & Kim, T.-H. (2015) · doi:10.1109/isi.2015.9 · Cited by 71
Validation of alternative methods of data normalization in gene co-expression studies
Reverter, A., Barris, W., McWilliam, S. M., Byrne, K. A., Wang, Y. H., Tan, S. H., Hudson, N. J., & Dalrymple, B. P. (2004) · Bioinformatics · doi:10.1093/bioinformatics/bti124 · Cited by 70
Evaluation of normalization methods for cDNA microarray data by k-NN classification
Wu, W., Xing, E. P., Myers, C. A., Mian, S. I., & Bissell, M. J. (2005) · BMC Bioinformatics · doi:10.1186/1471-2105-6-191 · Cited by 65
Pérez-Rodríguez, J., Arroyo-Peña, A. G., & García‐Pedrajas, N. (2015) · Applied Soft Computing · doi:10.1016/j.asoc.2015.07.046 · Cited by 54
Anomadroid: Profiling Android Applications' Behaviors for Identifying Unknown Malapps
Su, D., Wang, W., Wang, X., & Liu, J. (2016) · IEEE International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom) · doi:10.1109/trustcom.2016.0127 · Cited by 18
Cited by
The choice of scaling technique matters for classification performance
de Amorim, L. B. V., Cavalcanti, G. D. C., & Cruz, R. M. O. (2023) · Applied Soft Computing · doi:10.1016/j.asoc.2022.109924 · Cited by 382
Kim, Y.-S., Kim, M. K., Fu, N., Liu, J., Wang, J., & Srebric, J. (2025) · Sustainable Cities and Society · doi:10.1016/j.scs.2024.105570 · Cited by 255
Zheng, S., Pan, K., Liu, J., & Chen, Y. (2024) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2024.110382 · Cited by 127
Xie, J., Sun, L., & Zhao, Y. F. (2025) · Engineering · doi:10.1016/j.eng.2024.04.024 · Cited by 112
Stacked Intelligent Metasurfaces for Task-Oriented Semantic Communications
Huang, G., An, J., Yang, Z., Gan, L., Bennis, M., & Debbah, M. (2025) · IEEE Wireless Communications Letters · doi:10.1109/lwc.2024.3499970 · Cited by 39
Metadata
- Authors
- Singh, D., & Singh, B.
- Venue
- Applied Soft Computing
- Publisher
- Elsevier BV
- Published
- 2020-12
- Volume
- 97
- Pages
- 105524
- ISSN
- 1568-4946 (ISSN-L)
- OpenAlex
- W2945020349
- Cited by
- 1,726
- References
- 70
- FWCI
- 37.87
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.