The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Understanding and Enhancement of Internal Clustering Validation Measures
Abstract
Clustering validation has long been recognized as one of the vital issues essential to the success of clustering applications. In general, clustering validation can be categorized into two classes, external clustering validation and internal clustering validation. In this paper, we focus on internal clustering validation and present a study of 11 widely used internal clustering validation measures for crisp clustering. The results of this study indicate that these existing measures have certain limitations in different application scenarios. As an alternative choice, we propose a new internal clustering validation measure, named clustering validation index based on nearest neighbors (CVNN), which is based on the notion of nearest neighbors. This measure can dynamically select multiple objects as representatives for different clusters in different situations. Experimental results show that CVNN outperforms the existing measures on both synthetic data and real-world data in different application scenarios.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 25,411
(1967) · Cited by 23,719
Silhouettes: A graphical aid to the interpretation and validation of cluster analysis
Rousseeuw, P. J. (1987) · Journal of Computational and Applied Mathematics · doi:10.1016/0377-0427(87)90125-7 · Cited by 21,392
(1996) · Cited by 20,179
Davies, D. L., & Bouldin, D. W. (1979) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1979.4766909 · Cited by 9,145
Hubert, L., & Arabie, P. (1985) · Journal of Classification · doi:10.1007/bf01908075 · Cited by 8,219
Multidimensional binary search trees used for associative searching
Bentley, J. L. (1975) · Communications of the ACM · doi:10.1145/361002.361007 · Cited by 7,520
(2008) · Data Mining and Market Intelligence for Optimal Marketing Returns · doi:10.4324/9780080878096-12 · Cited by 6,954
R-trees: a dynamic index structure for spatial searching
Guttman, A. (1984) · Proceedings of the 1984 ACM SIGMOD international conference on Management of data - SIGMOD '84 · doi:10.1145/602259.602266 · Cited by 6,580
Algorithms for clustering data
Flury, B. (1989) · Journal of Statistical Planning and Inference · doi:10.1016/0378-3758(89)90033-5 · Cited by 6,432
Estimating the Number of Clusters in a Data Set Via the Gap Statistic
Tibshirani, R., Walther, G., & Hastie, T. (2001) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00293 · Cited by 6,205
An Introduction to Data Mining
Stephens, C. R., & Sukumar, R. (2006) · The Handbook of Marketing Research · doi:10.4135/9781412973380.n22 · Cited by 4,562
A dendrite method for cluster analysis
Caliński, T., & Harabasz, J. (1974) · Communications in Statistics · doi:10.1080/03610927408827101 · Cited by 4,480
A validity measure for fuzzy clustering
Xie, X. L., & Beni, G. (1991) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.85677 · Cited by 3,385
On Clustering Validation Techniques
Halkidi, M., Batistakis, Y., & Vazirgiannis, M. (2001) · Journal of Intelligent Information Systems · doi:10.1023/a:1012801612483 · Cited by 2,646
Well-Separated Clusters and Optimal Fuzzy Partitions
Dunn†, J. C. (1974) · Journal of Cybernetics · doi:10.1080/01969727408546059 · Cited by 2,510
Chameleon: hierarchical clustering using dynamic modeling
Karypis, G., Han, E.-H., & Kumar, V. (1999) · Computer · doi:10.1109/2.781637 · Cited by 2,097
On cluster validity for the fuzzy c-means model
Pal, N. R., & Bezdek, J. C. (1995) · IEEE Transactions on Fuzzy Systems · doi:10.1109/91.413225 · Cited by 1,850
Discriminatory analysis: Nonparametric discrimination: Consistency properties: (471672008-001)
Fix, E., & Hodges, J. L. (1951) · PsycEXTRA Dataset · doi:10.1037/e471672008-001 · Cited by 1,696
Performance evaluation of some clustering algorithms and validity indices
Maulik, U., & Bandyopadhyay, S. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1114856 · Cited by 1,396
Some new indexes of cluster validity
Bezdek, J. C., & Pal, N. R. (1998) · IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) · doi:10.1109/3477.678624 · Cited by 1,132
Understanding of Internal Clustering Validation Measures
Liu, Y., Li, Z., Xiong, H., Gao, X., & Wu, J. (2010) · 2010 IEEE International Conference on Data Mining · doi:10.1109/icdm.2010.35 · Cited by 973
Self-citationEvaluation of hierarchical clustering algorithms for document datasets
Zhao, Y., & Karypis, G. (2002) · Proceedings of the eleventh international conference on Information and knowledge management · doi:10.1145/584792.584877 · Cited by 558
Stability-Based Validation of Clustering Solutions
Lange, T., Roth, V., Braun, M. L., & Buhmann, J. M. (2004) · Neural Computation · doi:10.1162/089976604773717621 · Cited by 526
NeNMF: An Optimal Gradient Method for Nonnegative Matrix Factorization
Guan, N., Tao, D., Luo, Z., & Yuan, B. (2012) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2012.2190406 · Cited by 468
Clustering validity assessment: finding the optimal partitioning of a data set
Halkidi, M., & Vazirgiannis, M. (2002) · Proceedings 2001 IEEE International Conference on Data Mining · doi:10.1109/icdm.2001.989517 · Cited by 426
A Monte Carlo Study of Thirty Internal Criterion Measures for Cluster Analysis
Milligan, G. W. (1981) · Psychometrika · doi:10.1007/bf02293899 · Cited by 407
Applied Multivariate Techniques
Marcucci, M. (1997) · Technometrics · doi:10.1080/00401706.1997.10485444 · Cited by 376
Quality Scheme Assessment in the Clustering Process
Halkidi, M., Vazirgiannis, M., & Batistakis, Y. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-45372-5_26 · Cited by 305
Online Nonnegative Matrix Factorization With Robust Stochastic Approximation
Guan, N., Tao, D., Luo, Z., & Yuan, B. (2012) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2012.2197827 · Cited by 287
K-Means Clustering Versus Validation Measures: A Data-Distribution Perspective
Xiong, H., Wu, J., & Chen, J. (2009) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2008.2004559 · Cited by 277
Self-citationNew indices for cluster validity assessment
Kim, M., & Ramakrishna, R. S. (2005) · Pattern Recognition Letters · doi:10.1016/j.patrec.2005.04.007 · Cited by 270
Adapting the right measures for K-means clustering
Wu, J., Xiong, H., & Chen, J. (2009) · Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1557019.1557115 · Cited by 255
Self-citationModel-based evaluation of clustering validation measures
Brun, M., Sima, C., Hua, J., Lowey, J., Carroll, B., Suh, E., & Dougherty, E. R. (2007) · Pattern Recognition · doi:10.1016/j.patcog.2006.06.026 · Cited by 238
Manifold elastic net: a unified framework for sparse dimension reduction
Zhou, T., Tao, D., & Wu, X. (2011) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-010-0182-x · Cited by 195
A Weighted Sum Validity Function for Clustering With a Hybrid Niching Genetic Algorithm
Sheng, W., Swift, S., Zhang, L., & Liu, X. (2005) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2005.850173 · Cited by 153
K-nearest-neighbor consistency in data clustering
Ding, C. H. Q., & He, X. (2004) · ACM Symposium on Applied Computing · doi:10.1145/967900.968021 · Cited by 101
An effective evaluation measure for clustering on evolving data streams
Kremer, H., Kranen, P., Jansen, T., Seidl, T., Bifet, A., Holmes, G., & Pfahringer, B. (2011) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2020408.2020555 · Cited by 99
Application of a New Symmetry-Based Cluster Validity Index for Satellite Image Segmentation
Saha, S., & Bandyopadhyay, S. (2008) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2008.915595 · Cited by 75
A new separation measure for improving the effectiveness of validity indices
Yue, S., Wang, J.-S., Wu, T., & Wang, H. (2009) · Information Sciences · doi:10.1016/j.ins.2009.11.005 · Cited by 36
Song, M. J., & Zhang, L. (2008) · Proceedings · doi:10.1109/icdm.2008.143 · Cited by 21
A New Cluster Validity Index for Data with Merged Clusters and Different Densities
Lam, B. S. Y., & Yan, H. (2006) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2005.1571244 · Cited by 8
Cited by
Large Scale Spectral Clustering Via Landmark-Based Sparse Representation
Cai, D., & Chen, X. (2015) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2358564 · Cited by 346
Architecture of the Mouse Brain Synaptome
Zhu, F., Cizeron, M., Qiu, Z., Benavides-Piccione, R., Kopanitsa, M. V., Skene, N. G., Koniaris, B., DeFelipe, J., Fransén, E., Komiyama, N. H., et al. (2018) · Neuron · doi:10.1016/j.neuron.2018.07.007 · Cited by 271
Constructing the L2-Graph for Robust Subspace Learning and Subspace Clustering
Peng, X., Yu, Z., Yi, Z., & Tang, H. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2536752 · Cited by 257
Metadata
- Authors
- Liu, Y., Li, Z., Xiong, H., Gao, X., Wu, J., & Wu, S.
- Venue
- IEEE Transactions on Cybernetics
- Published
- 2013-06
- Volume
- 43
- Issue
- 3
- Pages
- 982-994
- ISSN
- 2168-2267 (ISSN-L)
- 2168-2275
- OpenAlex
- W2045691329
- Cited by
- 315
- References
- 42
- FWCI
- 3.80
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.