The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Evaluation of Stability of k-Means Cluster Ensembles with Respect to Random Initialization
Abstract
Many clustering algorithms, including cluster ensembles, rely on a random component. Stability of the results across different runs is considered to be an asset of the algorithm. The cluster ensembles considered here are based on k-means clusterers. Each clusterer is assigned a random target number of clusters, k and is started from a random initialization. Here, we use 10 artificial and 10 real data sets to study ensemble stability with respect to random k, and random initialization. The data sets were chosen to have a small number of clusters (two to seven) and a moderate number of data points (up to a few hundred). Pairwise stability is defined as the adjusted Rand index between pairs of clusterers in the ensemble, averaged across all pairs. Nonpairwise stability is defined as the entropy of the consensus matrix of the ensemble. An experimental comparison with the stability of the standard k-means algorithm was carried out for k from 2 to 20. The results revealed that ensembles are generally more stable, markedly so for larger k. To establish whether stability can serve as a cluster validity index, we first looked at the relationship between stability and accuracy with respect to the number of clusters, k. We found that such a relationship strongly depends on the data set, varying from almost perfect positive correlation (0.97, for the glass data) to almost perfect negative correlation (-0.93, for the crabs data). We propose a new combined stability index to be the sum of the pairwise individual and ensemble stabilities. This index was found to correlate better with the ensemble accuracy. Following the hypothesis that a point of stability of a clustering algorithm corresponds to a structure found in the data, we used the stability measures to pick the number of clusters. The combined stability index gave best results.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1973) · CERN Document Server (European Organization for Nuclear Research) · Cited by 12,895
UCI Repository of machine learning databases
Blake, C. L. (1998) · Medical Entomology and Zoology · Cited by 10,582
Hubert, L., & Arabie, P. (1985) · Journal of Classification · doi:10.1007/bf01908075 · Cited by 8,219
Algorithms for Clustering Data
Sarle, W. S. (1990) · Technometrics · doi:10.1080/00401706.1990.10484648 · Cited by 7,865
Objective Criteria for the Evaluation of Clustering Methods
Rand, W. M. (1971) · Journal of the American Statistical Association · doi:10.1080/01621459.1971.10482356 · Cited by 6,566
Pattern Recognition and Neural Networks
Ripley, B. D. (1996) · Cambridge University Press eBooks · doi:10.1017/cbo9780511812651 · Cited by 6,459
Algorithms for clustering data
Flury, B. (1989) · Journal of Statistical Planning and Inference · doi:10.1016/0378-3758(89)90033-5 · Cited by 6,432
Estimating the Number of Clusters in a Data Set Via the Gap Statistic
Tibshirani, R., Walther, G., & Hastie, T. (2001) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00293 · Cited by 6,205
Pattern Classification and Scene Analysis.
Clarke, M. R. B., Duda, R. O., & Hart, P. E. (1974) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2344977 · Cited by 3,222
Monti, S., Tamayo, P., Mesirov, J., & Golub, T. (2003) · Machine Learning · doi:10.1023/a:1023949509487 · Cited by 2,116
Performance evaluation of some clustering algorithms and validity indices
Maulik, U., & Bandyopadhyay, S. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1114856 · Cited by 1,396
Combining multiple clusterings using evidence accumulation
Fred, A. L. N., & Jain, A. K. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.113 · Cited by 1,195
(2000) · CrossRef Listing of Deleted DOIs · doi:10.1162/153244302760200704 · Cited by 636
Gordon, A. (1999) · Chapman & Hall/CRC eBooks · doi:10.1201/9780367805302 · Cited by 619
Random projection for high dimensional data clustering: a cluster ensemble approach
Fern, X. Z., & Brodley, C. E. (2003) · Cited by 595
A stability based method for discovering structure in clustered data
Ben-Hur, A., Elisseeff, A., & Guyon, I. (2001) · Biocomputing 2002 · doi:10.1142/9789812799623_0002 · Cited by 555
Bagging to improve the accuracy of a clustering procedure
Dudoit, S., & Fridlyand, J. (2003) · Bioinformatics · doi:10.1093/bioinformatics/btg038 · Cited by 530
Stability-Based Validation of Clustering Solutions
Lange, T., Roth, V., Braun, M. L., & Buhmann, J. M. (2004) · Neural Computation · doi:10.1162/089976604773717621 · Cited by 526
Data clustering using evidence accumulation
Fred, A. L. N., & Jain, A. K. (2003) · Object recognition supported by user interaction for service robots · doi:10.1109/icpr.2002.1047450 · Cited by 515
Bousquet, O., Elisseeff, A., & Ron, D. (2001) · MPG.PuRe (Max Planck Society) · Cited by 493
A Mixture Model for Clustering Ensembles
Topchy, A., Jain, A. K., & Punch, W. (2004) · Proceedings of the 2004 SIAM International Conference on Data Mining · doi:10.1137/1.9781611972740.35 · Cited by 384
Fred, A. L. N., & Jain, A. K. (2003) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2003.1211462 · Cited by 362
Combining multiple weak clusterings
Topchy, A. P., Jain, A. K., & Punch, W. F. (2004) · Proceedings · doi:10.1109/icdm.2003.1250937 · Cited by 340
Finding Consistent Clusters in Data Partitions
Fred, A. L. N. (2001) · Lecture notes in computer science · doi:10.1007/3-540-48219-9_31 · Cited by 303
Using diversity in cluster ensembles
Kuncheva, L. I., & Hadjitodorov, S. T. (2005) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2004.1399790 · Cited by 289
Self-citationResampling Method for Unsupervised Estimation of Cluster Validity
Levine, E., & Domany, E. (2001) · Neural Computation · doi:10.1162/089976601753196030 · Cited by 271
Moderate diversity for better cluster ensembles
Hadjitodorov, S. T., Kuncheva, L. I., & Todorova, L. (2005) · Information Fusion · doi:10.1016/j.inffus.2005.01.008 · Cited by 224
Self-citationBagging for path-based clustering
Fischer, B., & Buhmann, J. M. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1240115 · Cited by 211
Ensembles of partitions via data resampling
Bidgoli, B. M., Topchy, A. P., & Punch, W. F. (2004) · International Conference on Information Technology: Coding and Computing (ITCC) · doi:10.1109/itcc.2004.1286629 · Cited by 132
Multiclassifier Systems: Back to the Future
Ghosh, J. (2002) · Lecture notes in computer science · doi:10.1007/3-540-45428-4_1 · Cited by 122
Stability of Randomized Learning Algorithms
Elisseeff, A., Evgeniou, T., & Pontil, M. (2005) · Cited by 116
Ensemble clustering in medical diagnostics
Greene, D., Tsymbal, A., Bolshakova, N., & Cunningham, P. (2004) · Cited by 90
Cluster ensemble and its applications in gene expression analysis
Hu, X. T., & Yoo, I. (2004) · Asia-Pacific Bioinformatics Conference · Cited by 89
Ensemble clustering in medical diagnostics
Greene, D., Tsymbal, A., Bolshakova, N., & Cunningham, P. (2004) · Proceedings - IEEE Symposium on Computer-Based Medical Systems · doi:10.1109/cbms.2004.1311777 · Cited by 79
Stability of Randomized Learning Algorithms
ElisseeffAndré, EvgeniouTheodoros, & PontilMassimiliano (2005) · Journal of Machine Learning Research · doi:10.5555/1046920.1046923 · Cited by 56
An Ensemble Method for Clustering
Weingessel, A., Dimitriadou, E., & Hornik, K. (2003) · Cited by 41
Cited by
Dong, X., Yu, Z., Cao, W., Shi, Y., & Ma, Q. (2020) · Frontiers of Computer Science · doi:10.1007/s11704-019-8208-z · Cited by 1,928
Kuo, B.-C., Ho, H.-H., Li, C.-H., Hung, C.-C., & Taur, J.-S. (2014) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2013.2262926 · Cited by 404
Chiang, M. M.-T., & Mirkin, B. (2010) · Journal of Classification · doi:10.1007/s00357-010-9049-5 · Cited by 319
Emotion recognition from physiological signals
GOUIZI, K., BEREKSI REGUIG, F., & MAAOUI, C. (2011) · Journal of Medical Engineering & Technology · doi:10.3109/03091902.2011.601784 · Cited by 92
Metadata
- Authors
- Kuncheva, L. I., & Vetrov, D. P.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2006-11
- Volume
- 28
- Issue
- 11
- Pages
- 1798-1808
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- OpenAlex
- W2108343180
- Cited by
- 325
- References
- 36
- FWCI
- 17.22
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.