The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Evaluation of k-nearest neighbour classifier performance for heterogeneous data sets
Open accessAbstract
Distance-based algorithms are widely used for data classification problems. The k-nearest neighbour classification (k-NN) is one of the most popular distance-based algorithms. This classification is based on measuring the distances between the test sample and the training samples to determine the final classification output. The traditional k-NN classifier works naturally with numerical data. The main objective of this paper is to investigate the performance of k-NN on heterogeneous datasets, where data can be described as a mixture of numerical and categorical features. For the sake of simplicity, this work considers only one type of categorical data, which is binary data. In this paper, several similarity measures have been defined based on a combination between well-known distances for both numerical and binary data, and to investigate k-NN performances for classifying such heterogeneous data sets. The experiments used six heterogeneous datasets from different domains and two categories of measures. Experimental results showed that the proposed measures performed better for heterogeneous data than Euclidean distance, and that the challenges raised by the nature of heterogeneous data need personalised similarity measures adapted to the data characteristics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Data mining: concepts and techniques
(2012) · Choice Reviews Online · doi:10.5860/choice.49-3305 · Cited by 28,531
Nearest neighbor pattern classification
Cover, T., & Hart, P. (1967) · IEEE Transactions on Information Theory · doi:10.1109/tit.1967.1053964 · Cited by 16,936
(2008) · Data Mining and Market Intelligence for Optimal Marketing Returns · doi:10.4324/9780080878096-12 · Cited by 6,954
Interpreting Qualitative Data Methods for Analysing Talk, Text and Interaction
Kleinsasser, R. C., & Silverman, D. (1997) · The Modern Language Journal · doi:10.2307/329190 · Cited by 6,866
Principles of Numerical Taxonomy
(2013) · Personality Structure and Measurement (Psychology Revivals) · doi:10.4324/9780203766804-11 · Cited by 2,990
Discriminatory Analysis. Nonparametric Discrimination: Consistency Properties
Fix, E., & Hodges, J. L. (1989) · International Statistical Review / Revue Internationale de Statistique · doi:10.2307/1403797 · Cited by 2,516
Multivariate Analysis: Methods and Applications
Dillon, W. R., & Goldstein, M. (1984) · CERN Document Server (European Organization for Nuclear Research) · Cited by 1,905
Comprehensive Survey on Distance/Similarity Measures between Probability Density Functions
Cha, S.-H. (2007) · Cited by 1,644
Compositional dissimilarity as a robust measure of ecological distance
Faith, D. P., Minchin, P. R., & Belbin, L. (1987) · Vegetatio · doi:10.1007/bf00038687 · Cited by 1,554
Compositional dissimilarity as a robust measure of ecological distance
Faith, D. P., Minchin, P. R., & Belbin, L. (1987) · Theory and models in vegetation science · doi:10.1007/978-94-009-4061-1_6 · Cited by 1,449
Discovering knowledge in data: an introduction to data mining
(2005) · Choice Reviews Online · doi:10.5860/choice.42-4687 · Cited by 1,347
Deza, M. M., & Deza, E. (2014) · Springer eBooks · doi:10.1007/978-3-662-44342-2 · Cited by 1,041
Principles of Numerical Taxonomy.
Ross, H. H., Sokal, R. R., Sneath, P. H. A., & Freeman, W. H. (1964) · Systematic Zoology · doi:10.2307/2411834 · Cited by 971
Deza, E., & Deza, M. M. (2009) · Springer eBooks · doi:10.1007/978-3-642-00234-2 · Cited by 950
A Survey of Binary Similarity and Distance Measures
Choi, S.-S., Cha, S.-H., & Tappert, C. C. (2010) · Cited by 843
Bramer, M. (2013) · Undergraduate Topics in Computer Science · doi:10.1007/978-1-4471-4884-5 · Cited by 838
Encyclopedia of analytical chemistry: applications, theory, and instrumentation
(2001) · Choice Reviews Online · doi:10.5860/choice.39-0662 · Cited by 766
Discovering Knowledge in Data: An Introduction to Data Mining
Larose, D. T., & Larose, C. D. (2014) · Wiley eBooks · doi:10.1002/9781118874059 · Cited by 602
k-Nearest Neighbour Classifiers
Cunningham, P., & Delany, S. J. (2007) · Research Repository UCD (University College Dublin) · Cited by 542
The distance function effect on k-nearest neighbor classification for medical datasets
Hu, L.-Y., Huang, M.-W., Ke, S.-W., & Tsai, C.-F. (2016) · SpringerPlus · doi:10.1186/s40064-016-2941-7 · Cited by 455
(2019) · Data Mining and Data Warehousing · doi:10.1017/9781108635592.003 · Cited by 439
SHAVLIK, J. W., Deitterich, T. E., & Dietterich, T. G. (1991) · Cited by 425
Mohammed, M., Khan, M. B., & Bashier, E. B. M. (2016) · doi:10.1201/9781315371658 · Cited by 389
Classification of Heart Disease Using K- Nearest Neighbor and Genetic Algorithm
jabbar, M. A., Deekshatulu, B. L., & Chandra, P. (2013) · Procedia Technology · doi:10.1016/j.protcy.2013.12.340 · Cited by 379
A PCA-based similarity measure for multivariate time series
Yang, K., & Shahabi, C. (2004) · Proceedings of the 2nd ACM international workshop on Multimedia databases · doi:10.1145/1032604.1032616 · Cited by 276
Survey of Improving K-Nearest-Neighbor for Classification
Jiang, L., Cai, Z., Wang, D., & Jiang, S. (2007) · Fourth International Conference on Fuzzy Systems and Knowledge Discovery (FSKD 2007) · doi:10.1109/fskd.2007.552 · Cited by 270
Data Mining and Predictive Analytics
McCue, C. (2015) · Data Mining and Predictive Analysis · doi:10.1016/b978-0-12-800229-2.00003-1 · Cited by 247
Chen, S.-M., & Chang, C.-H. (2015) · Information Sciences · doi:10.1016/j.ins.2014.07.033 · Cited by 242
Comparison of Distance Measures in Cluster Analysis with Dichotomous Data
Finch, H. (2021) · Journal of Data Science · doi:10.6339/jds.2005.03(1).192 · Cited by 204
An Empirical Study of Distance Metrics for k-Nearest Neighbor Algorithm
Chomboon, K., Chujai, P., Teerarassammee, P., Kerdprasop, K., & Kerdprasop, N. (2015) · The Proceedings of the 2nd International Conference on Industrial Application Engineering 2015 · doi:10.12792/iciae2015.051 · Cited by 199
Chen, S.-M., Cheng, S.-H., & Lan, T.-C. (2016) · Information Sciences · doi:10.1016/j.ins.2016.01.040 · Cited by 195
A study of distance-based machine learning algorithms
Dietterich, T. G., & Wettschereck, D. (1994) · Cited by 141
Singh, A., Halgamuge, M. N., & Lakshmiganthan, R. (2017) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2017.081201 · Cited by 124
Noisy data elimination using mutual k-nearest neighbor for classification mining
Liu, H., & Zhang, S. (2011) · Journal of Systems and Software · doi:10.1016/j.jss.2011.12.019 · Cited by 120
(2015) · Cited by 118
Categorical missing data imputation for software cost estimation by multinomial logistic regression
Sentas, P., & Angelis, L. (2005) · Journal of Systems and Software · doi:10.1016/j.jss.2005.02.026 · Cited by 87
Compressed kNN: K-Nearest Neighbors with Data Compression
Salvador–Meneses, J., Ruiz–Chavez, Z., & García‐Rodríguez, J. (2019) · Entropy · doi:10.3390/e21030234 · Cited by 80
Software Similarity and Classification
Cesare, S., & Xiang, Y. (2012) · SpringerBriefs in computer science · doi:10.1007/978-1-4471-2909-7 · Cited by 74
GA-facilitated KNN classifier optimization with varying similarity measures
Peterson, M. R., Doom, T. E., & Raymer, M. L. (2005) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2005.1555009 · Cited by 35
Todeschini, R., Ballabio, D., Consonni, V., & Grisoni, F. (2016) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2016.06.013 · Cited by 34
Distances and Other Dissimilarity Measures in Chemometrics
Todeschini, R., Ballabio, D., & Consonni, V. (2015) · Wiley eBooks · doi:10.1002/9780470027318.a9438 · Cited by 30
Classification in Non-Metric Spaces
Weinshall, D., Jacobs, D. W., & Gdalyahu, Y. (1998) · neural information processing systems · Cited by 15
Bashon, Y., Neagu, D. C., & Ridley, M. J. (2013) · Soft Computing · doi:10.1007/s00500-012-0974-6 · Cited by 11
Self-citation
Cited by
Olu-Ajayi, R., Alaka, H., Sulaimon, I., Sunmola, F., & Ajayi, S. (2022) · Journal of Building Engineering · doi:10.1016/j.jobe.2021.103406 · Cited by 543
An experimental analysis of attack classification using machine learning in IoT networks
Churcher, A., Ullah, R., Ahmad, J., ur Rehman, S., Masood, F., Gogate, M., Alqahtani, F., Nour, B., & Buchanan, W. J. (2021) · Sensors · doi:10.3390/s21020446 · Cited by 439
“KNN is referred to as a lazy learner because there is no training done with KNN; instead, the training data are used when making predictions to classify the data [13].”
MethodInfluentialMarques Ramos, A. P., Prado Osco, L., Elis Garcia Furuya, D., Nunes Gonçalves, W., Cordeiro Santana, D., Pereira Ribeiro Teodoro, L., Antonio da Silva Junior, C., Fernando Capristo-Silva, G., Li, J., Henrique Rojo Baio, F., et al. (2020) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2020.105791 · Cited by 291
A Survey on Text Classification Algorithms: From Text to Predictions
Gasparetto, A., Marcuzzo, M., Zangari, A., & Albarelli, A. (2022) · Information · doi:10.3390/info13020083 · Cited by 253
Metadata
- Authors
- Ali, N., Neagu, D., & Trundle, P.
- Venue
- SN Applied Sciences
- Published
- 2019-11-06
- Volume
- 1
- Issue
- 12
- ISSN
- 2523-3963 (ISSN-L)
- 2523-3971
- OpenAlex
- W2989345584
- Cited by
- 274
- References
- 43
- FWCI
- 34.99
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.