The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Learning k for kNN Classification
Open accessAbstract
The K Nearest Neighbor (kNN) method has widely been used in the applications of data mining and machine learning due to its simple implementation and distinguished performance. However, setting all test data with the same k value in the previous kNN methods has been proven to make these methods impractical in real applications. This article proposes to learn a correlation matrix to reconstruct test data points by training data to assign different k values to different test data points, referred to as the Correlation Matrix kNN (CM-kNN for short) classification. Specifically, the least-squares loss function is employed to minimize the reconstruction error to reconstruct each test data point by all training data points. Then, a graph Laplacian regularizer is advocated to preserve the local structure of the data in the reconstruction process. Moreover, an ℓ 1 -norm regularizer and an ℓ 2, 1 -norm regularizer are applied to learn different k values for different test data and to result in low sparsity to remove the redundant/noisy feature from the reconstruction process, respectively. Besides for classification tasks, the kNN methods (including our proposed CM-kNN method) are further utilized to regression and missing data imputation. We conducted sets of experiments for illustrating the efficiency, and experimental results showed that the proposed method was more accurate and efficient than existing kNN methods in data-mining applications, such as classification, regression, and missing data imputation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Top 10 algorithms in data mining
Wu, X., Kumar, V., Ross Quinlan, J., Ghosh, J., Yang, Q., Motoda, H., McLachlan, G. J., Ng, A., Liu, B., Yu, P. S., et al. (2008) · Knowledge and Information Systems · doi:10.1007/s10115-007-0114-2 · Cited by 5,667
Locality Preserving Projections
He, X., & Niyogi, P. (2003) · Cited by 4,119
Distance Metric Learning for Large Margin Nearest Neighbor Classification
Weinberger, K. Q., & Saul, L. K. (2009) · Journal of Machine Learning Research · doi:10.5555/1577069.1577078 · Cited by 4,044
2009 International Joint Conference on Artificial Intelligence
(2009) · doi:10.1109/jcai15434.2009 · Cited by 2,800
Wu, X., Zhu, X., Wu, G.-Q., & Ding, W. (2014) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2013.109 · Cited by 2,410
Self-citationDistance Metric Learning for Large Margin Nearest Neighbor Classification
Weinberger, K. Q., Blitzer, J. C., & Saul, L. K. (2005) · Cited by 1,690
Iteratively reweighted least squares minimization for sparse recovery
Daubechies, I., DeVore, R., Fornasier, M., & Güntürk, C. S. (2010) · Communications on Pure and Applied Mathematics · doi:10.1002/cpa.20303 · Cited by 1,295
Travel time estimation of a path using sparse trajectories
Wang, Y., Zheng, Y., & Xue, Y. (2014) · Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2623330.2623656 · Cited by 525
Robust Joint Graph Sparse Coding for Unsupervised Spectral Feature Selection
Zhu, X., Li, X., Zhang, S., Ju, C., & Wu, X. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2521602 · Cited by 339
Self-citationBlock-Row Sparse Multiview Multilabel Learning for Image Classification
Zhu, X., Li, X., & Zhang, S. (2016) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2015.2403356 · Cited by 324
Self-citationNearest Neighbor Classification of Remote Sensing Images With the Maximal Margin Principle
Blanzieri, E., & Melgani, F. (2008) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2008.916090 · Cited by 288
Missing Value Estimation for Mixed-Attribute Data Sets
Zhu, X., Zhang, S., Jin, Z., Zhang, Z., & Xu, Z. (2011) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2010.99 · Cited by 286
Self-citationGarcía-Laencina, P. J., Sancho-Gómez, J.-L., Figueiras-Vidal, A. R., & Verleysen, M. (2009) · Neurocomputing · doi:10.1016/j.neucom.2008.11.026 · Cited by 254
IKNN: Informative K-Nearest Neighbor Pattern Classification
Song, Y., Huang, J., Zhou, D., Zha, H., & Giles, C. L. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74976-9_25 · Cited by 211
Big data analytics for healthcare
Sun, J., & Reddy, C. K. (2013) · Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2487575.2506178 · Cited by 195
K-Local Hyperplane and Convex Distance Nearest Neighbor Algorithms
Vincent, P., & Bengio, Y. (2001) · Cited by 182
Spatiotemporal Statistics for Video Quality Assessment
Li, X., Guo, Q., & Lu, X. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2568752 · Cited by 176
Self-citationA Regression-based K nearest neighbor algorithm for gene function prediction from heterogeneous data
Yao, Z., & Ruzzo, W. L. (2006) · BMC Bioinformatics · doi:10.1186/1471-2105-7-s1-s11 · Cited by 159
Nearest neighbors by neighborhood counting
Wang, H. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.126 · Cited by 151
Self-taught dimensionality reduction on the high-dimensional small-sized data
Zhu, X., Huang, Z. H., Yang, Y., Shen, H. T., Xu, C., & Luo, J. (2012) · Pattern Recognition · doi:10.1016/j.patcog.2012.07.018 · Cited by 135
Self-citationShell-neighbor method and its application in missing data imputation
Zhang, S. (2010) · Applied Intelligence · doi:10.1007/s10489-009-0207-6 · Cited by 130
Self-citationSparse hashing for fast multimedia search
Zhu, X., Huang, Z. H., Cheng, H., Cui, J., & Shen, H. T. (2013) · ACM Transactions on Information Systems · doi:10.1145/2457465.2457469 · Cited by 120
Self-citationSemi-parametric optimization for missing data imputation
Qin, Y., Zhang, S., Zhu, X., Zhang, J., & Zhang, C. (2007) · Applied Intelligence · doi:10.1007/s10489-006-0032-0 · Cited by 115
Self-citationJackknife Variance Estimation for Nearest-Neighbor Imputation
Chen, J., & Shao, J. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501750332839 · Cited by 107
Surveillance Video Synopsis via Scaling Down Objects
Li, X., Wang, Z., & Lu, X. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2507942 · Cited by 102
Self-citationNearest Neighbor Based Feature Selection for Regression and its Application to Neural Activity
Navot, A., Shpigelman, L., Tishby, N., & Vaadia, E. (2005) · Cited by 98
The Nearest Neighbor Algorithm of Local Probability Centers
Li, B., Chen, Y. W., & Chen, Y. Q. (2008) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2007.908363 · Cited by 95
An Adaptable $k$-Nearest Neighbors Algorithm for MMSE Image Interpolation
Ni, K. S., & Nguyen, T. Q. (2009) · IEEE Transactions on Image Processing · doi:10.1109/tip.2009.2023706 · Cited by 95
Hierarchical Learning of Tree Classifiers for Large-Scale Plant Species Identification
Jianping Fan, B., Zhou, N., Peng, J., & Gao, L. C. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2457337 · Cited by 86
Matrix-Similarity Based Loss Function and Feature Selection for Alzheimer's Disease Diagnosis
Zhu, X., Suk, H., & Shen, D. G. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.395 · Cited by 86
Self-citationImage collection summarization via dictionary learning for sparse representation
Yang, C., Shen, J., Peng, J., & Jianping Fan, B. (2012) · Pattern Recognition · doi:10.1016/j.patcog.2012.07.011 · Cited by 83
Knowledge Engineering with Big Data
Wu, X., Chen, H., Wu, G., Liu, J., Zheng, Q., He, X., Zhou, A., Zhao, Z., Wei, B., Li, Y., et al. (2015) · IEEE Intelligent Systems · doi:10.1109/mis.2015.56 · Cited by 79
Self-citationDeterministic Column-Based Matrix Decomposition
Li, X., & Pang, Y. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.64 · Cited by 76
Self-citationClustering-based Missing Value Imputation for Data Preprocessing
Zhang, C., Qin, Y., Zhu, X., et al. (2006) · 2022 IEEE 20th International Conference on Industrial Informatics (INDIN) · doi:10.1109/indin.2006.275767 · Cited by 61
Self-citationCombination of KNN-Based Feature Selection and KNNBased Missing-Value Imputation of Microarray Data
Meesad, P., & Hengpraprohm, K. (2008) · International Conference on Innovative Computing, Information and Control · doi:10.1109/icicic.2008.635 · Cited by 46
Scene Parsing From an MAP Perspective
Li, X., Mou, L., & Lu, X. (2014) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2361489 · Cited by 42
Self-citationK NN-CF Approach: Incorporating Certainty Factor to k NN Classification.
Zhang, S. (2010) · Cited by 42
Self-citationGBKII: An Imputation Method for Missing Values
Zhang, C., Zhu, X., Zhang, J., Qin, Y., & Zhang, S. (2007) · Springer eBooks · doi:10.1007/978-3-540-71701-0_122 · Cited by 41
Self-citationEfficient kNN Algorithm Based on Graph Sparse Reconstruction
Zhang, S., Zong, M., Sun, K., Liu, Y., & Cheng, D. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-14717-8_28 · Cited by 38
Self-citationCompact Structure Hashing via Sparse and Similarity Preserving Embedding
Ye, R., & Li, X. (2015) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2015.2414299 · Cited by 36
Self-citationSahigara, F., Ballabio, D., Todeschini, R., et al. (2014) · Current Computer - Aided Drug Design · doi:10.2174/1573409910666140410110241 · Cited by 34
Feature selection by combining subspace learning with sparse representation
Cheng, D., Zhang, S., Liu, X., Sun, K., & Zong, M. (2015) · Multimedia Systems · doi:10.1007/s00530-015-0487-0 · Cited by 28
Self-citationTailored Aggregation for Classification
Mary‐Huard, T., & Robin, S. S. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.55 · Cited by 26
Cost-sensitive imputing missing values with ordering
Zhu, X., Zhang, S., Zhang, J., et al. (2007) · Cited by 25
Self-citationSelf-representation nearest neighbor search for classification
Zhang, S., Cheng, D., Zong, M., & Gao, L. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.08.115 · Cited by 22
Self-citationTelco User Activity Level Prediction with Massive Mobile Broadband Data
Chen, L., Zeng, J., Yuan, M., Dai, W., & Yang, Q. (2016) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/2856057 · Cited by 21
Nonnegative correlation coding for image classification
Dong, Z., Liang, W. G., Wu, Y., Pei, M., & Jia, Y. (2015) · Science China Information Sciences · doi:10.1007/s11432-015-5289-7 · Cited by 17
Cited by
Efficient kNN classification with different numbers of nearest neighbors
Zhang, S., Li, X., Zong, M., Zhu, X., & Wang, R. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2673241 · Cited by 1,378
Self-citationA survey on missing data in machine learning
Emmanuel, T., Maupong, T., Mpoeleng, D., Semong, T., Mphago, B., & Tabona, O. (2021) · Journal of Big Data · doi:10.1186/s40537-021-00516-9 · Cited by 1,067
Challenges in KNN Classification
Zhang, S. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3049250 · Cited by 362
Self-citationA novel k NN algorithm with data-driven k parameter computation
Zhang, S., Cheng, D., Deng, Z., Zong, M., & Deng, X. (2018) · Pattern Recognition Letters · doi:10.1016/j.patrec.2017.09.036 · Cited by 278
Self-citationOne-Step Multi-View Spectral Clustering
Zhu, X., Zhang, S., He, W., Hu, R., Lei, C., & Zhu, P. (2019) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2018.2873378 · Cited by 265
Self-citation
Metadata
- Authors
- Zhang, S., Li, X., Zong, M., Zhu, X., & Cheng, D.
- Venue
- ACM Transactions on Intelligent Systems and Technology
- Published
- 2017-01-12
- Volume
- 8
- Issue
- 3
- Pages
- 1-19
- ISSN
- 2157-6904 (ISSN-L)
- 2157-6912
- OpenAlex
- W2574388714
- Cited by
- 576
- References
- 47
- FWCI
- 22.14
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.