The DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index.
Challenges in KNN Classification
Open accessAbstract
The KNN algorithm is one of the most popular data mining algorithms. It has been widely and successfully applied to data analysis applications across a variety of research topics in computer science. This paper illustrates that, despite its success, there remain many challenges in KNN classification, including K computation, nearest neighbor selection, nearest neighbor search and classification rules. Having established these issues, recent approaches to their resolution are examined in more detail, thereby providing a potential roadmap for ongoing KNN-related research, as well as some new classification rules regarding how to tackle the issue of training sample imbalance. To evaluate the proposed approaches, some experiments were conducted with 15 UCI benchmark datasets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Nearest neighbor pattern classification
Cover, T., & Hart, P. (1967) · IEEE Transactions on Information Theory · doi:10.1109/tit.1967.1053964 · Cited by 16,936
THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS
FISHER, R. A. (1936) · Annals of Eugenics · doi:10.1111/j.1469-1809.1936.tb02137.x · Cited by 15,227
Wold, S., Esbensen, K., & Geladi, P. (1987) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/0169-7439(87)80084-9 · Cited by 11,606
Shape matching and object recognition using shape contexts
Belongie, S., Malik, J., & Puzicha, J. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.993558 · Cited by 6,306
Top 10 algorithms in data mining
Wu, X., Kumar, V., Ross Quinlan, J., Ghosh, J., Yang, Q., Motoda, H., McLachlan, G. J., Ng, A., Liu, B., Yu, P. S., et al. (2008) · Knowledge and Information Systems · doi:10.1007/s10115-007-0114-2 · Cited by 5,667 · cited 1×
“As a result, KNN algorithms have been widely used in research and are considered to being one of the top-10 data mining algorithms [6].”
MethodML-KNN: A lazy learning approach to multi-label learning
Zhang, M.-L., & Zhou, Z.-H. (2007) · Pattern Recognition · doi:10.1016/j.patcog.2006.12.019 · Cited by 3,552
Product Quantization for Nearest Neighbor Search
Jégou, H., Douze, M., & Schmid, C. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.57 · Cited by 2,956 · cited 1×
“For example, Jegou, Douze and Schmid proposed a product quantization for nearest neighbor search [71].”
BackgroundDiscriminatory Analysis. Nonparametric Discrimination: Consistency Properties
Fix, E., & Hodges, J. L. (1989) · International Statistical Review / Revue Internationale de Statistique · doi:10.2307/1403797 · Cited by 2,516
KNN Model-Based Approach in Classification
Guo, G., Wang, H., Bell, D., Bi, Y., & Greer, K. (2003) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-39964-3_62 · Cited by 2,099
Information-theoretic metric learning
Davis, J. V., Kulis, B., Jain, P., Sra, S., & Dhillon, I. S. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273523 · Cited by 2,006
Efficient kNN classification with different numbers of nearest neighbors
Zhang, S., Li, X., Zong, M., Zhu, X., & Wang, R. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2673241 · Cited by 1,378
Self-citationStanfill, C., & Waltz, D. (1986) · Communications of the ACM · doi:10.1145/7902.7906 · Cited by 1,218
Shape Matching and Object Recognition Using Low Distortion Correspondences
Berg, A. C., Berg, T. L., & Malik, J. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.320 · Cited by 845
A Nonparametric Estimate of a Multivariate Density Function
Loftsgaarden, D. O., & Quesenberry, C. P. (1965) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177700079 · Cited by 781
Learning k for kNN Classification
Zhang, S., Li, X., Zong, M., Zhu, X., & Cheng, D. (2017) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/2990508 · Cited by 576
Self-citationNearest neighbor selection for iteratively kNN imputation
Zhang, S. (2012) · Journal of Systems and Software · doi:10.1016/j.jss.2012.05.073 · Cited by 496
Self-citationLi, W., Zhang, Y., Sun, Y., Wang, W., Li, M., Zhang, W., & Lin, X. (2020) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2019.2909204 · Cited by 454
Distance-Based Image Classification: Generalizing to New Classes at Near-Zero Cost
Mensink, T., Verbeek, J., Perronnin, F., & Csurka, G. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.83 · Cited by 431
Decision-Making Processes in Pattern Recognition
Eddy, R. P., & Sebestyen, G. S. (1963) · Mathematics of Computation · doi:10.2307/2004038 · Cited by 402
A nearest hyperrectangle learning method
Salzberg, S. (1991) · Machine Learning · doi:10.1007/bf00114779 · Cited by 384
A generalized mean distance-based k-nearest neighbor classifier
Gou, J., Ma, H., Ou, W., Zeng, S., Rao, Y., & Yang, H. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.08.021 · Cited by 350
Locally adaptive metric nearest-neighbor classification
Domeniconi, C., Peng, J., & Gunopulos, D. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1033219 · Cited by 307
A novel k NN algorithm with data-driven k parameter computation
Zhang, S., Cheng, D., Deng, Z., Zong, M., & Deng, X. (2018) · Pattern Recognition Letters · doi:10.1016/j.patrec.2017.09.036 · Cited by 278
Self-citationOne-Step Multi-View Spectral Clustering
Zhu, X., Zhang, S., He, W., Hu, R., Lei, C., & Zhu, P. (2019) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2018.2873378 · Cited by 265
Self-citationIKNN: Informative K-Nearest Neighbor Pattern Classification
Song, Y., Huang, J., Zhou, D., Zha, H., & Giles, C. L. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74976-9_25 · Cited by 211
Local and Global Structure Preservation for Robust Unsupervised Spectral Feature Selection
Zhu, X., Zhang, S., Hu, R., Zhu, Y., & Song, J. (2017) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2017.2763618 · Cited by 203
Self-citationLow-Rank Sparse Subspace for Spectral Clustering
Zhu, X., Zhang, S., Li, Y., Zhang, J., Yang, L., & Fang, Y. (2019) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2018.2858782 · Cited by 202
Self-citationCost-sensitive KNN classification
Zhang, S. (2020) · Neurocomputing · doi:10.1016/j.neucom.2018.11.101 · Cited by 180
Self-citationK-Nearest Neighbor Finding Using MaxNearestDist
Samet, H. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1182 · Cited by 165
Nearest neighbors by neighborhood counting
Wang, H. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.126 · Cited by 151
A novel ensemble method for k-nearest neighbor
Zhang, Y., Cao, G., Wang, B., & Li, X.-S. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2018.08.003 · Cited by 149
Hierarchical Clustering-Based Graphs for Large Scale Approximate Nearest Neighbor Search
Muñoz, J. A. V., Gonçalves, M. A., Dias, Z., & Torres, R. D. S. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2019.106970 · Cited by 137
Shell-neighbor method and its application in missing data imputation
Zhang, S. (2010) · Applied Intelligence · doi:10.1007/s10489-009-0207-6 · Cited by 130
Self-citationGallego, A., Calvo-Zaragoza, J., Valero-Mas, J. J., & Rico-Juan, J. R. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2017.09.038 · Cited by 127
Missing Value Imputation Based on Data Clustering
Zhang, S., Zhang, J., Zhu, X., Qin, Y., & Chengqi Zhang, B. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-79299-4_7 · Cited by 124
Self-citationA Statistical Approach to Texture Classification from Single Images
Varma, M., & Zisserman, A. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000046589.39864.ee · Cited by 124
Jackknife Variance Estimation for Nearest-Neighbor Imputation
Chen, J., & Shao, J. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501750332839 · Cited by 117
Feature Extraction by Maximizing the Average Neighborhood Margin
Wang, F., & Zhang, C. (2007) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2007.383124 · Cited by 104
Locality constrained representation-based K-nearest neighbor classification
Gou, J., Qiu, W., Zhang, Y., Shen, X., Zhan, Y., & Ou, W. (2019) · Knowledge-Based Systems · doi:10.1016/j.knosys.2019.01.016 · Cited by 100
The Nearest Neighbor Algorithm of Local Probability Centers
Li, B., Chen, Y. W., & Chen, Y. Q. (2008) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2007.908363 · Cited by 95
Adaptive Nearest Neighbor Classification using Support Vector Machines
Domeniconi, C., & Gunopulos, D. (2002) · The MIT Press eBooks · doi:10.7551/mitpress/1120.003.0090 · Cited by 90
Learning a Distance Metric by Balancing KL-Divergence for Imbalanced Datasets
Feng, L., Wang, H., Jin, B., Li, H., Xue, M., & Wang, L. (2018) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2018.2790914 · Cited by 89
BoostMap: An Embedding Method for Efficient Nearest Neighbor Retrieval
Athitsos, V., Alon, J., Sclaroff, S., & Kollios, G. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1140 · Cited by 84
Supervised distance metric learning through maximization of the Jeffrey divergence
Nguyen, B., Morell, C., & Bernard De Baets, C. (2016) · Pattern Recognition · doi:10.1016/j.patcog.2016.11.010 · Cited by 84
VHP: approximate nearest neighbor search via virtual hypersphere partitioning
Lu, K., Wang, H., Wang, W., & Kudo, M. (2020) · Proceedings of the VLDB Endowment · doi:10.14778/3397230.3397240 · Cited by 84
A Local Mean Representation-based K -Nearest Neighbor Classifier
Gou, J., Qiu, W., Zhang, Y., Xu, Y. D., Mao, Q., & Zhan, Y. (2019) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3319532 · Cited by 72
Parimputation: From Imputation and Null-Imputation to Partially Imputation
Zhang, S. (2008) · OPUS - Open Publications of UTS Scholars (University of Technology Sydney) · Cited by 61
Self-citationCost-Sensitive Classification with k-Nearest Neighbors
Qin, Z., Wang, A. T., Chengqi Zhang, B., & Zhang, S. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39787-5_10 · Cited by 56
Self-citationProbability Based Metrics for Nearest Neighbor Classification and Case-Based Reasoning
Blanzieri, E., & Ricci⋆, F. (1999) · Lecture notes in computer science · doi:10.1007/3-540-48508-2_2 · Cited by 42
K NN-CF Approach: Incorporating Certainty Factor to k NN Classification.
Zhang, S. (2010) · Cited by 42
Self-citationProduct quantization with dual codebooks for approximate nearest neighbor search
Pan, Z., Wang, L., Wang, Y., & Liu, Y. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.03.016 · Cited by 40
Learning to Index for Nearest Neighbor Search
Chiu, C., Prayoonwong, A., & Liao, Y.-C. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2907086 · Cited by 39
Nguyen, B., & Bernard De Baets, C. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2018.04.024 · Cited by 28
Tailored Aggregation for Classification
Mary‐Huard, T., & Robin, S. S. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.55 · Cited by 26
BP$k$ NN: $k$ -Nearest Neighbor Classifier With Pairwise Distance Metrics and Belief Function Theory
Jiao, L., Geng, X., & Pan, Q. (2019) · IEEE Access · doi:10.1109/access.2019.2909752 · Cited by 25
Redefining nearest neighbor classification in high-dimensional settings
López, J., & Maldonado, S. (2018) · Pattern Recognition Letters · doi:10.1016/j.patrec.2018.03.023 · Cited by 23
K-Subspaces Quantization for Approximate Nearest Neighbor Search
Ozan, E. C., Kıranyaz, S., & Gabbouj, M. (2016) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2016.2535287 · Cited by 21
Mutual kNN based spectral clustering
Tan, M., Zhang, S., & Wu, L. (2018) · Neural Computing and Applications · doi:10.1007/s00521-018-3836-z · Cited by 18
Self-citationSingleton indexes for nearest neighbor search
Téllez, E. S., Ruíz, G., & Chávez, E. (2016) · Information Systems · doi:10.1016/j.is.2016.03.003 · Cited by 8
Optimized high order product quantization for approximate nearest neighbors search
Li, L., & Hu, Q. (2019) · Frontiers of Computer Science · doi:10.1007/s11704-018-7049-5 · Cited by 8
Cited by
LLM meets ML: Data-efficient Anomaly Detection on Unstable Logs
Hadadi, F., Xu, Q., Bianculli, D., & Briand, L. (2024) · arXiv · doi:10.48550/arxiv.2406.07467 · Cited by 7
Metadata
- Authors
- Zhang, S.
- Venue
- IEEE Transactions on Knowledge and Data Engineering
- Published
- 2022-10-01
- Volume
- 34
- Issue
- 10
- Pages
- 4663-4675
- ISSN
- 1041-4347 (ISSN-L)
- 1558-2191
- 2326-3865
- OpenAlex
- W3120409033
- Cited by
- 362
- References
- 60
- FWCI
- 32.20
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.