The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Spectral Embedded Clustering: A Framework for In-Sample and Out-of-Sample Spectral Clustering
Abstract
Spectral clustering (SC) methods have been successfully applied to many real-world applications. The success of these SC methods is largely based on the manifold assumption, namely, that two nearby data points in the high-density region of a low-dimensional data manifold have the same cluster label. However, such an assumption might not always hold on high-dimensional data. When the data do not exhibit a clear low-dimensional manifold structure (e.g., high-dimensional and sparse data), the clustering performance of SC will be degraded and become even worse than K -means clustering. In this paper, motivated by the observation that the true cluster assignment matrix for high-dimensional data can be always embedded in a linear space spanned by the data, we propose the spectral embedded clustering (SEC) framework, in which a linearity regularization is explicitly added into the objective function of SC methods. More importantly, the proposed SEC framework can naturally deal with out-of-sample data. We also present a new Laplacian matrix constructed from a local regression of each pattern and incorporate it into our SEC framework to capture both local and global discriminative information for clustering. Comprehensive experiments on eight real-world high-dimensional datasets demonstrate the effectiveness and advantages of our SEC framework over existing SC methods and K-means-based clustering methods. Our SEC framework significantly outperforms SC using the Nyström algorithm on unseen data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
The Elements of Statistical Learning
Hastie, T., Friedman, J., & Tibshirani, R. (2001) · Springer Series in Statistics · doi:10.1007/978-0-387-21606-5 · Cited by 24,162
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 24,155
Normalized cuts and image segmentation
Shi, J., & Malik, J. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.868688 · Cited by 15,502
McLachlan, G., & Peel, D. (2000) · Wiley Series in Probability and Statistics · doi:10.1002/0471721182 · Cited by 10,991
On Spectral Clustering: Analysis and an algorithm
Ng, A. Y., Jordan, M. I., & Weiss, Y. (2001) · Cited by 8,159
Algorithms for Clustering Data
Sarle, W. S. (1990) · Technometrics · doi:10.1080/00401706.1990.10484648 · Cited by 7,865
Laplacian Eigenmaps for Dimensionality Reduction and Data Representation
Belkin, M., & Niyogi, P. (2003) · Neural Computation · doi:10.1162/089976603321780317 · Cited by 7,621
Algorithms for clustering data
Flury, B. (1989) · Journal of Statistical Planning and Inference · doi:10.1016/0378-3758(89)90033-5 · Cited by 6,432
From few to many: illumination cone models for face recognition under variable lighting and pose
Georghiades, A. S., Belhumeur, P. N., & Kriegman, D. J. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.927464 · Cited by 4,912
Algorithms for the Assignment and Transportation Problems
Munkres, J. (1957) · Journal of the Society for Industrial and Applied Mathematics · doi:10.1137/0105003 · Cited by 3,986
(2006) · Cited by 3,624
Learning realistic human actions from movies
Laptev, I., Marszalek, M., Schmid, C., & Rozenfeld, B. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587756 · Cited by 3,444
Graph Embedding and Extensions: A General Framework for Dimensionality Reduction
Yan, S., Xu, D., Zhang, B., Zhang, H.-J., Yang, Q., & Lin, S. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.250598 · Cited by 3,031
Self-citationMartínez, A. M. (1998) · Medical Entomology and Zoology · Cited by 2,830
Martínez, A. M. (1998) · CTIT technical reports series · Cited by 2,778
Solving Multiclass Learning Problems via Error-Correcting Output Codes
Dietterich, T. G., & Bakiri, G. (1995) · Journal of Artificial Intelligence Research · doi:10.1613/jair.105 · Cited by 2,739
Self-Tuning Spectral Clustering
Zelnik‐Manor, L., & Perona, P. (2004) · CaltechAUTHORS (California Institute of Technology) · Cited by 1,942
The CMU pose, illumination, and expression database
Sim, T., Baker, S., & Bsat, M. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1251154 · Cited by 1,783
Columbia Object Image Library (COIL100)
Nayar, S. K. (1996) · Medical Entomology and Zoology · Cited by 1,372
Ben‐Hur, A., Horn, D., Siegelmann, H. T., & Vapnik, V. N. (2002) · doi:10.5555/944790.944807 · Cited by 1,330
Spectral grouping using the nystrom method
Fowlkes, C., Belongie, S., Chung, F., & Malik, J. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.1262185 · Cited by 1,328
Kernel k-means: spectral clustering and normalized cuts
Dhillon, I. S., Guan, Y., & Kulis, B. (2004) · Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1014052.1014118 · Cited by 1,193
Multiclass spectral clustering
Yu, & Shi (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238361 · Cited by 947
Mercer kernel-based clustering in feature space
Girolami, M. (2002) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2002.1000150 · Cited by 903
Out-of-Sample Extensions for LLE, Isomap, MDS, Eigenmaps, and Spectral Clustering
Bengio, Y., Paiement, J.-F., Vincent, P., Delalleau, O., Roux, N. L., & Ouimet, M. (2003) · Cited by 894
Shape descriptors for non-rigid shapes with a single closed contour
Latecki, L. J., Lakamper, R., & Eckhardt, T. (2002) · Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662) · doi:10.1109/cvpr.2000.855850 · Cited by 833
A survey of kernel and spectral methods for clustering
Filippone, M., Camastra, F., Masulli, F., & Rovetta, S. (2008) · Pattern Recognition · doi:10.1016/j.patcog.2007.05.018 · Cited by 827
On the Learnability and Design of Output Codes for Multiclass Problems
Crammer, K., & Singer, Y. (2002) · Machine Learning · doi:10.1023/a:1013637720281 · Cited by 650
The Elements of Statistical Learning
Sapatinas, T. (2004) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2004.298_11.x · Cited by 635
Spectral Relaxation for K-means Clustering
Hongyuan Zha, B., He, X., Ding, C. H. Q., Gu, M., & Simon, H. D. (2001) · Cited by 585
Discriminative common vectors for face recognition
Cevikalp, H., Neamtu, M., Wilkes, M., & Barkana, A. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.9 · Cited by 528
Xu, L., Neufeld, J., Larson, B., & Schuurmans, D. (2004) · Cited by 462
Visual Event Recognition in Videos by Learning from Web Data
Duan, L., Xu, D., Tsang, I. W.-H., & Luo, J. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.265 · Cited by 409
Self-citationImage Clustering Using Local Discriminant Models and Global Integration
Yang, Y., Xu, D., Nie, F., Yan, S., & Zhuang, Y. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2049235 · Cited by 389
Self-citationYe, J. (2005) · Cited by 353
Adaptive dimension reduction using discriminant analysis and K -means clustering
Ding, C. H. Q., & Li, T. (2007) · International Conference on Machine Learning · doi:10.1145/1273496.1273562 · Cited by 286
Jia, Y., Nie, F., & Zhang, C. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2009.2015760 · Cited by 284
Self-citationA Local Learning Approach for Clustering
Wu, M., & Schölkopf, B. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0196 · Cited by 284
Least squares linear discriminant analysis
Ye, J. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273633 · Cited by 274
Multiway Spectral Clustering with Out-of-Sample Extensions through Weighted Kernel PCA
Alzate, C., & Suykens, J. A. K. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.292 · Cited by 229
Yang, Y., Zhuang, Y.-T., Wu, F., & Pan, Y.-H. (2008) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2008.917359 · Cited by 213
Discriminative K-means for Clustering
Ye, J., Zhao, Z., & Wu, M. (2007) · Cited by 199
Computer Intensive Statistical Methods: Validation, Model Selection, and Bootstrap
Lenth, R. V. (1995) · Technometrics · doi:10.1080/00401706.1995.10484382 · Cited by 183
Exploiting Data Topology in Visualization and Clustering of Self-Organizing Maps
Tasdemir, K., & Merenyi, E. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2008.2005409 · Cited by 173
Discriminative cluster analysis
De la Torre, F., & Kanade, T. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143875 · Cited by 170
Adaptive dimension reduction for clustering high dimensional data
Ding, C., He, X., Hongyuan Zha, B., & Simon, H. D. (2003) · Proceedings · doi:10.1109/icdm.2002.1183897 · Cited by 164
New Results on Error Correcting Output Codes of Kernel Machines
Passerini, A., Pontil, M., & Frasconi, P. (2004) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2003.820841 · Cited by 149
Maximum Margin Clustering Made Practical
Zhang, K., Tsang, I. W.-H., & Kwok, J. T.-Y. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2008.2010620 · Cited by 122
Self-citationDocument clustering via adaptive subspace iteration
Li, T., Ma, S., & Ogihara, M. (2004) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1008992.1009031 · Cited by 120
Adaptive Distance Metric Learning for Clustering
Ye, J., Zhao, Z., & Liu, H. (2007) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2007.383103 · Cited by 116
Tighter and convex maximum margin clustering
Li, Y.-F., Tsang, I. W.-H., Kwok, J. T.-Y., et al. (2009) · Cited by 115
Self-citationVisual event recognition in videos by learning from web data
Duan, L., Xu, D., Tsang, I. W.-H., & Luo, J. (2010) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2010.5539870 · Cited by 107
Self-citationSimplifying Mixture Models Through Function Approximation
Zhang, K., & Kwok, J. T.-Y. (2010) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2040835 · Cited by 62
Learning Gaussian Mixture Models With Entropy-Based Criteria
Benavent, A. P., Ruiz, F. J. E., & Saez, J. M. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2009.2030190 · Cited by 34
Cited by
Unsupervised deep embedding for clustering analysis
Xie, J., Girshick, R., & Farhadi, A. (2015) · arXiv · doi:10.48550/arxiv.1511.06335 · Cited by 2,476
Clustering and projected clustering with adaptive neighbors
Nie, F., Wang, X., & Huang, H. (2014) · Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2623330.2623726 · Cited by 981
Self-citationImproved Deep Embedded Clustering with Local Structure Preservation
Guo, X., Gao, L., Liu, X., & Yin, J. (2017) · Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/243 · Cited by 919
Li, Y., Hu, P., Liu, Z., Peng, D., Zhou, J. T., & Peng, X. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i10.17037 · Cited by 714
A Review of Feature Selection and Its Methods
Venkatesh, B., & Anuradha, J. (2019) · Cybernetics and Information Technologies · doi:10.2478/cait-2019-0001 · Cited by 631
Metadata
- Authors
- Nie, F., Zeng, Z., Tsang, I. W., Xu, D., & Zhang, C.
- Venue
- IEEE Transactions on Neural Networks
- Published
- 2011-11
- Volume
- 22
- Issue
- 11
- Pages
- 1796-1808
- ISSN
- 1045-9227 (ISSN-L)
- 1941-0093
- OpenAlex
- W2131828344
- Cited by
- 325
- References
- 55
- FWCI
- 9.17
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.