The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Objective Criteria for the Evaluation of Clustering Methods
Open accessAbstract
Many intuitively appealing methods have been suggested for clustering data, however, interpretation of their results has been hindered by the lack of objective criteria. This article proposes several criteria which isolate specific aspects of the performance of a method, such as its retrieval of inherent structure, its sensitivity to resampling and the stability of its results in the light of new data. These criteria depend on a measure of similarity between two different clusterings of the same set of data; the measure essentially considers how each pair of data points is assigned in each clustering.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Modularity and community structure in networks
Newman, M. E. J. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0601602103 · Cited by 12,256
Fortunato, S. (2010) · Physics Reports · doi:10.1016/j.physrep.2009.11.002 · Cited by 11,293
Limits of Predictability in Human Mobility
Song, C., Qu, Z., Blumm, N., & Barabási, A.-L. (2010) · Science · doi:10.1126/science.1177170 · Cited by 3,234
Structure of Urban Movements: Polycentric Activity and Entangled Hierarchical Flows
Roth, C., Kang, S. M., Batty, M., & Barthélemy, M. (2011) · PLoS ONE · doi:10.1371/journal.pone.0015923 · Cited by 461
Cited by
Fortunato, S. (2010) · Physics Reports · doi:10.1016/j.physrep.2009.11.002 · Cited by 11,293
VSEARCH: a versatile open source tool for metagenomics
(2016) · doi:10.7717/peerj.2584 · Cited by 10,773
Hubert, L., & Arabie, P. (1985) · Journal of Classification · doi:10.1007/bf01908075 · Cited by 8,219
Enterotypes of the human gut microbiome
MetaHIT Consortium (additional members), Arumugam, M., Raes, J., Pelletier, E., Le Paslier, D., Yamada, T., Mende, D. R., Fernandes, G. R., Tap, J., Bruls, T., et al. (2011) · Nature · doi:10.1038/nature09944 · Cited by 7,548
Reversed graph embedding resolves complex single-cell trajectories
Qiu, X., Mao, Q., Tang, Y., Wang, L., Chawla, R., Pliner, H. A., & Trapnell, C. (2017) · Nature Methods · doi:10.1038/nmeth.4402 · Cited by 5,070
Community detection in networks: a user guide
Fortunato, S., & Hric, D. (2016) · Physics Reports · doi:10.1016/j.physrep.2016.09.002 · Cited by 2,086
Recovering Gene Interactions from Single-Cell Data Using Data Diffusion
van Dijk, D., Sharma, R., Nainys, J., Yim, K., Kathail, P., Carr, A. J., Burdziak, C., Moon, K. R., Chaffer, C. L., Pattabiraman, D., et al. (2018) · Cell · doi:10.1016/j.cell.2018.05.061 · Cited by 1,829
Time-series clustering – A decade review
Aghabozorgi, S., Seyed Shirkhorshidi, A., & Ying Wah, T. (2015) · Information Systems · doi:10.1016/j.is.2015.04.007 · Cited by 1,826
A survey of techniques for internet traffic classification using machine learning
Nguyen, T. T. T., & Armitage, G. (2008) · IEEE Communications Surveys & Tutorials · doi:10.1109/surv.2008.080406 · Cited by 1,664
Benchmarking atlas-level data integration in single-cell genomics
Luecken, M. D., Büttner, M., Chaichoompu, K., Danese, A., Interlandi, M., Mueller, M. F., Strobl, D. C., Zappia, L., Dugas, M., Colomé-Tatché, M., et al. (2022) · Nature Methods · doi:10.1038/s41592-021-01336-8 · Cited by 1,438
(2012) · neural information processing systems · Cited by 1,291
Visualizing structure and transitions in high-dimensional biological data
Moon, K. R., van Dijk, D., Wang, Z., Gigante, S., Burkhardt, D. B., Chen, W. S., Yim, K., Elzen, A. V. D., Hirn, M. J., Coifman, R. R., et al. (2019) · Nature Biotechnology · doi:10.1038/s41587-019-0336-3 · Cited by 1,065
Is My Network Module Preserved and Reproducible?
Langfelder, P., Luo, R., Oldham, M. C., & Horvath, S. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1001057 · Cited by 1,012
Cluster-wise assessment of cluster stability
Hennig, C. (2007) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2006.11.025 · Cited by 930
Individual differences in rates of change in cognitive abilities of older persons.
Wilson, R. S., Beckett, L. A., Barnes, L. L., Schneider, J. A., Bach, J., Evans, D. A., & Bennett, D. A. (2002) · Psychology and Aging · doi:10.1037/0882-7974.17.2.179 · Cited by 842
Decoding myofibroblast origins in human kidney fibrosis
Kuppe, C., Ibrahim, M. M., Kranz, J., Zhang, X., Ziegler, S., Perales-Patón, J., Jansen, J., Reimer, K. C., Smith, J. R., Dobie, R., et al. (2021) · Nature · doi:10.1038/s41586-020-2941-1 · Cited by 769
A framework for feature selection in clustering
Witten, D. M., & Tibshirani, R. (2010) · Journal of the American Statistical Association · doi:10.1198/jasa.2010.tm09415 · Cited by 696
(2012) · Cited by 618
Polarization of the vaccination debate on Facebook
Schmidt, A. L., Zollo, F., Scala, A., Betsch, C., & Quattrociocchi, W. (2018) · Vaccine · doi:10.1016/j.vaccine.2018.05.040 · Cited by 403
Mapping world cultures: Cluster formation, sources and implications
Ronen, S., & Shenkar, O. (2013) · Journal of International Business Studies · doi:10.1057/jibs.2013.42 · Cited by 377
Early and late life cognitive activity and cognitive systems in old age
WILSON, R. S., BARNES, L. L., KRUEGER, K. R., HOGANSON, G., BIENIAS, J. L., & BENNETT, D. A. (2005) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617705050459 · Cited by 355
Robustness of community structure in networks
Karrer, B., Levina, E., & Newman, M. E. J. (2008) · Physical Review E · doi:10.1103/physreve.77.046119 · Cited by 350
Anatomy of news consumption on Facebook
Schmidt, A. L., Zollo, F., Del Vicario, M., Bessi, A., Scala, A., Caldarelli, G., Stanley, H. E., & Quattrociocchi, W. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1617052114 · Cited by 305
A Blueprint for the Spatiotemporal Origins of Mouse Hippocampal Interneuron Diversity
Tricoire, L., Pelkey, K. A., Erkkila, B. E., Jeffries, B. W., Yuan, X., & McBain, C. J. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.0323-11.2011 · Cited by 292
The United Kingdom Brain Expression Consortium, Botía, J. A., Vandrovcova, J., Forabosco, P., Guelfi, S., D’Sa, K., Hardy, J., Lewis, C. M., Ryten, M., & Weale, M. E. (2017) · BMC Systems Biology · doi:10.1186/s12918-017-0420-6 · Cited by 289
Connectome sensitivity or specificity: which is more important?
Zalesky, A., Fornito, A., Cocchi, L., Gollo, L. L., van den Heuvel, M. P., & Breakspear, M. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.06.035 · Cited by 275
Messé, A., Rudrauf, D., Benali, H., & Marrelec, G. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003530 · Cited by 215
A survey of Clustering Algorithms
Rokach, L. (2009) · Data Mining and Knowledge Discovery Handbook · doi:10.1007/978-0-387-09823-4_14 · Cited by 245
Parallel Multi-Dimensional LSTM, With Application to Fast Biomedical Volumetric Image Segmentation
Stollenga, M. F., Byeon, W., Liwicki, M., & Schmidhuber, J. (2015) · arXiv · doi:10.48550/arxiv.1506.07452 · Cited by 244
Genetic topography of brain morphology
Chen, C.-H., Fiecas, M., Gutiérrez, E. D., Panizzon, M. S., Eyler, L. T., Vuoksimaa, E., Thompson, W. K., Fennema-Notestine, C., Hagler, D. J., Jernigan, T. L., et al. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1308091110 · Cited by 217
Mapping social dynamics on Facebook: The Brexit debate
Del Vicario, M., Zollo, F., Caldarelli, G., Scala, A., & Quattrociocchi, W. (2017) · Social Networks · doi:10.1016/j.socnet.2017.02.002 · Cited by 233
Zeng, Y., Wei, Z., Yu, W., Yin, R., Yuan, Y., Li, B., Tang, Z., Lu, Y., & Yang, Y. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbac297 · Cited by 211
Scholtens, L. H., Schmidt, R., de Reus, M. A., & van den Heuvel, M. P. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.0752-14.2014 · Cited by 160
Functional Connectome of the Fetal Brain
Turk, E., van den Heuvel, M. I., Benders, M. J., de Heus, R., Franx, A., Manning, J. H., Hect, J. L., Hernandez-Andrade, E., Hassan, S. S., Romero, R., et al. (2019) · The Journal of Neuroscience · doi:10.1523/jneurosci.2891-18.2019 · Cited by 176
Evaluation of Cell Type Annotation R Packages on Single-Cell RNA-Seq Data
Huang, Q., Liu, Y., Du, Y., & Garmire, L. X. (2021) · Genomics, Proteomics & Bioinformatics · doi:10.1016/j.gpb.2020.07.004 · Cited by 149
Meaning in Life in Emerging Adulthood: A Person‐Oriented Approach
Dezutter, J., Waterman, A. S., Schwartz, S. J., Luyckx, K., Beyers, W., Meca, A., Kim, S. Y., Whitbourne, S. K., Zamboanga, B. L., Lee, R. M., et al. (2014) · Journal of Personality · doi:10.1111/jopy.12033 · Cited by 133
Increasing sample size compensates for data problems in segmentation studies
Dolnicar, S., Grün, B., & Leisch, F. (2016) · Journal of Business Research · doi:10.1016/j.jbusres.2015.09.004 · Cited by 131
Low-income Latino mothers’ booksharing styles and children's emergent literacy development
Caspe, M. (2009) · Early Childhood Research Quarterly · doi:10.1016/j.ecresq.2009.03.006 · Cited by 127
Detecting heterogeneity in single-cell RNA-Seq data by non-negative matrix factorization
Zhu, X., Ching, T., Pan, X., Weissman, S. M., & Garmire, L. (2017) · PeerJ · doi:10.7717/peerj.2888 · Cited by 86
Wei, S. C., Sharma, R., Anang, N.-A. A. S., Levine, J. H., Zhao, Y., Mancuso, J. J., Setty, M., Sharma, P., Wang, J., Pe’er, D., et al. (2019) · Immunity · doi:10.1016/j.immuni.2019.03.004 · Cited by 97
Fontanella, S., Frainay, C., Murray, C. S., Simpson, A., & Custovic, A. (2018) · PLoS Medicine · doi:10.1371/journal.pmed.1002691 · Cited by 91
Evaluating stably expressed genes in single cells
Lin, Y., Ghazanfar, S., Strbenac, D., Wang, A., Patrick, E., Lin, D. M., Speed, T., Yang, J. Y. H., & Yang, P. (2019) · GigaScience · doi:10.1093/gigascience/giz106 · Cited by 84
Blind PRNU-Based Image Clustering for Source Identification
Marra, F., Poggi, G., Sansone, C., & Verdoliva, L. (2017) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2017.2701335 · Cited by 84
Mosaic integration and knowledge transfer of single-cell multimodal data with MIDAS
He, Z., Hu, S., Chen, Y., An, S., Zhou, J., Liu, R., Shi, J., Wang, J., Dong, G., Shi, J., et al. (2024) · Nature Biotechnology · doi:10.1038/s41587-023-02040-y · Cited by 84
Druckmann, S., Hill, S., Schürmann, F., Markram, H., & Segev, I. (2013) · Cerebral Cortex · doi:10.1093/cercor/bhs290 · Cited by 66
Large language models predict human sensory judgments across six modalities
Marjieh, R., Sucholutsky, I., van Rijn, P., Jacoby, N., & Griffiths, T. L. (2024) · Scientific Reports · doi:10.1038/s41598-024-72071-1 · Cited by 73
Metrics reloaded: Recommendations for image analysis validation
Maier-Hein, L., Reinke, A., Godau, P., Tizabi, M. D., Buettner, F., Christodoulou, E., Glocker, B., Isensee, F., Kleesiek, J., Kozubek, M., et al. (2022) · arXiv · doi:10.48550/arxiv.2206.01653 · Cited by 59
Gut microbiome strain-sharing within isolated village social networks
Beghini, F., Pullman, J., Alexander, M., Shridhar, S. V., Prinster, D., Singh, A., Matute Juárez, R., Airoldi, E. M., Brito, I. L., & Christakis, N. A. (2025) · Nature · doi:10.1038/s41586-024-08222-1 · Cited by 51
Learning Representations for Incomplete Time Series Clustering
Ma, Q., Chen, C., Li, S., & Cottrell, G. W. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i10.17070 · Cited by 34
Wang, H., Chen, C., & Fushing, H. (2012) · PLoS ONE · doi:10.1371/journal.pone.0045502 · Cited by 33
Skampardoni, I., Nasrallah, I. M., Abdulkadir, A., Wen, J., Melhem, R., Mamourian, E., Erus, G., Doshi, J., Singh, A., Yang, Z., et al. (2024) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2023.5599 · Cited by 28
Nonconvergence, covariance constraints, and class enumeration in growth mixture models.
McNeish, D., Harring, J. R., & Bauer, D. J. (2023) · Psychological Methods · doi:10.1037/met0000456 · Cited by 27
Colella, J. P., Frederick, L. M., Talbot, S. L., & Cook, J. A. (2021) · Diversity and Distributions · doi:10.1111/ddi.13234 · Cited by 25
DeepMF: deciphering the latent patterns in omics profiles with a deep learning method
Chen, L., Xu, J., & Li, S. C. (2019) · BMC Bioinformatics · doi:10.1186/s12859-019-3291-6 · Cited by 23
The Impact of Random Models on Clustering Similarity
Gates, A. J., & Ahn, Y.-Y. (2017) · doi:10.1101/196840 · Cited by 24
PIntMF: Penalized Integrative Matrix Factorization method for multi-omics data
Pierre-Jean, M., Mauger, F., Deleuze, J.-F., & Le Floch, E. (2022) · Bioinformatics · doi:10.1093/bioinformatics/btab786 · Cited by 20
Kang, T., Sun, Y., Kim, J. H., Ta, C., Perotte, A., Schiffer, K., Wu, M., Zhao, Y., Moustafa-Fahmy, N., Peng, Y., et al. (2023) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocad036 · Cited by 14
A reinforcement-learning approach to efficient communication
Kågebäck, M., Carlsson, E., Dubhashi, D., & Sayeed, A. (2020) · PLOS ONE · doi:10.1371/journal.pone.0234894 · Cited by 13
Cyclic structure with cellular precision in a vertebrate sensorimotor neural circuit
Yang, R., Vishwanathan, A., Wu, J., Kemnitz, N., Ih, D., Turner, N., Lee, K., Tartavull, I., Silversmith, W. M., Jordan, C. S., et al. (2023) · Current Biology · doi:10.1016/j.cub.2023.05.010 · Cited by 11
Utgés, J. S., MacGowan, S. A., Ives, C. M., & Barton, G. J. (2024) · Communications Biology · doi:10.1038/s42003-024-05970-8 · Cited by 10
Tumor stratification by a novel graph-regularized bi-clique finding algorithm
Ahmadi Adl, A., & Qian, X. (2015) · Computational Biology and Chemistry · doi:10.1016/j.compbiolchem.2015.02.010 · Cited by 3
Metadata
- Authors
- Rand, W. M.
- Venue
- Journal of the American Statistical Association
- Publisher
- Informa UK Limited
- Published
- 1971-12
- Volume
- 66
- Issue
- 336
- Pages
- 846-850
- ISSN
- 0162-1459 (ISSN-L)
- 1537-274X
- OpenAlex
- W2033403400
- Cited by
- 6,566
- References
- 4
- FWCI
- 3.70
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
