The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
How Many Clusters? Which Clustering Method? Answers Via Model-Based Cluster Analysis
Abstract
We consider the problem of determining the structure of clustered data, without prior knowledge of the number of clusters or any other information about their composition. Data are represented by a mixture model in which each component corresponds to a different cluster. Models with varying geometric properties are obtained through Gaussian components with different parametrizations and cross-cluster constraints. Noise and outliers can be modelled by adding a Poisson process component. Partitions are determined by the expectation-maximization (EM) algorithm for maximum likelihood, with initial values from agglomerative hierarchical clustering. Models are compared using an approximation to the Bayes factor based on the Bayesian information criterion (BIC); unlike significance tests, this allows comparison of more than two models at the same time, and removes the restriction that the models compared be nested. The problems of determining the number of clusters and the clustering method are solved simultaneously by choosing the best model. Moreover, the EM result provides a measure of uncertainty about the associated classification of each data point. Examples are given, showing that this approach can give performance that is much better than standard procedures, which often fail to identify groups that are either overlapping or of varying sizes and shapes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Estimating the Dimension of a Model
Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033
Golub, G. (2012) · doi:10.56021/9781421407944 · Cited by 34,505
(1967) · Cited by 23,719
Algorithm AS 136: A K-Means Clustering Algorithm
Hartigan, J. A., & Wong, M. A. (1979) · Applied Statistics · doi:10.2307/2346830 · Cited by 14,523
Pattern Recognition with Fuzzy Objective Function Algorithms
Bezdek, J. C. (1981) · doi:10.1007/978-1-4757-0450-1 · Cited by 9,881
Jeffreys, H., Moran, P. A. P., & Chatfield, C. (1922) · Nature · doi:10.1093/oso/9780198503682.001.0001 · Cited by 7,878
Finding Groups in Data: An Introduction to Cluster Analysis
Kaufman, L., & Rousseeuw, P. J. (1990) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316801 · Cited by 7,344
Golub, G. H., & Loan, C. F. V. (1996) · Johns Hopkins University Press eBooks · Cited by 6,027
(1975) · CERN Document Server (European Organization for Nuclear Research) · Cited by 5,958
The EM Algorithm and Extensions
Kushary, D. (1998) · Technometrics · doi:10.1080/00401706.1998.10485534 · Cited by 5,417
On the Convergence Properties of the EM Algorithm
Wu, C. F. J. (1983) · The Annals of Statistics · doi:10.1214/aos/1176346060 · Cited by 3,269
Model-Based Gaussian and Non-Gaussian Clustering
Banfield, J. D., & Raftery, A. E. (1993) · Biometrics · doi:10.2307/2532201 · Cited by 2,395
Mixture models : inference and applications to clustering
McLachlan, G. J., & Basford, K. E. (1988) · M. Dekker eBooks · Cited by 2,094
Bayesian classification (AutoClass): theory and results
Cheeseman, P. C., & Stutz, J. (1996) · Cited by 975
Gaussian parsimonious clustering models
Celeux, G., & Govaert, G. (1995) · Pattern Recognition · doi:10.1016/0031-3203(94)00125-6 · Cited by 872
A classification EM algorithm for clustering and two stochastic versions
Celeux, G., & Govaert, G. (1992) · Computational Statistics & Data Analysis · doi:10.1016/0167-9473(92)90042-e · Cited by 772
Neural Networks and Related Methods for Classification
Ripley, B. D. (1994) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1994.tb01990.x · Cited by 627
On Some Invariant Criteria for Grouping Data
Friedman, H. P., & Rubin, J. (1967) · Journal of the American Statistical Association · doi:10.1080/01621459.1967.10500923 · Cited by 613
Practical Bayesian Density Estimation Using Mixtures of Normals
Roeder, K., & Wasserman, L. (1997) · Journal of the American Statistical Association · doi:10.1080/01621459.1997.10474044 · Cited by 503
Clustering Methods Based on Likelihood Ratio Criteria
Scott, A. J., & Symons, M. J. (1971) · Biometrics · doi:10.2307/2529003 · Cited by 464
Detecting Features in Spatial Point Processes with Clutter via Model-Based Clustering
Dasgupta, A., & Raftery, A. E. (1998) · Journal of the American Statistical Association · doi:10.1080/01621459.1998.10474110 · Cited by 430
Consistent Estimation of a Mixing Distribution
Leroux, B. G. (1992) · The Annals of Statistics · doi:10.1214/aos/1176348772 · Cited by 413
Multidimensional clustering algorithms
Murtagh, F. D. (1985) · Cited by 386
On the Convergence of the EM Algorithm
Boyles, R. A. (1983) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1983.tb01229.x · Cited by 333
Three Types of Gamma‐Ray Bursts
Mukherjee, S., Feigelson, E. D., Jogesh Babu, G., Murtagh, F., Fraley, C., & Raftery, A. (1998) · The Astrophysical Journal · doi:10.1086/306386 · Cited by 305
Self-citationNearest-Neighbor Clutter Removal for Estimating Features in Spatial Point Processes
Byers, S., & Raftery, A. E. (1998) · Journal of the American Statistical Association · doi:10.1080/01621459.1998.10473711 · Cited by 304
BINDER, D. A. (1978) · Biometrika · doi:10.1093/biomet/65.1.31 · Cited by 302
Efficient Approximations for the Marginal Likelihood of Bayesian Networks with Hidden Variables
Maxwell Chickering, D., & Heckerman, D. (1997) · Machine Learning · doi:10.1023/a:1007469629108 · Cited by 292
Algorithms for Model-Based Gaussian Hierarchical Clustering
Fraley, C. (1998) · SIAM Journal on Scientific Computing · doi:10.1137/s1064827596311451 · Cited by 272
Self-citationCluster Dissection and Analysis: Theory, Fortran Programs, Examples.
Murtagh, F., & Spath, H. (1986) · Biometrics · doi:10.2307/2531267 · Cited by 240
Inference in model-based cluster analysis
Bensmail, H., Celeux, G., Raftery, A. E., & Robert, C. P. (1997) · Statistics and Computing · doi:10.1023/a:1018510926151 · Cited by 199
An attempt to define the nature of chemical diabetes using a multidimensional analysis
Reaven, G. M., & Miller, R. G. (1979) · Diabetologia · doi:10.1007/bf00423145 · Cited by 188
Bozdogan, H. (1993) · Studies in Classification, Data Analysis and Knowledge Organization · doi:10.1007/978-3-642-50974-2_5 · Cited by 186
Robust cluster analysis via mixtures of multivariate t-distributions
McLachlan, G. J., & Peel, D. (1998) · Lecture Notes in Computer Science · doi:10.1007/bfb0033290 · Cited by 160
Linear flaw detection in woven textiles using model-based clustering
Campbell, J. G., Fraley, C., Murtagh, F. D., & Raftery, A. E. (1997) · Pattern Recognition Letters · doi:10.1016/s0167-8655(97)00148-7 · Cited by 154
Self-citationPercentage Points of a Test for Clusters
Engelman, L., & Hartigan, J. A. (1969) · Journal of the American Statistical Association · doi:10.1080/01621459.1969.10501084 · Cited by 145
Fitting straight lines to point patterns
Murtagh, F. D., & Raftery, A. E. (1984) · Pattern Recognition · doi:10.1016/0031-3203(84)90045-1 · Cited by 121
PROBABILITY MODELS AND HYPOTHESES TESTING IN PARTITIONING CLUSTER ANALYSIS
Bock, H. (1996) · WORLD SCIENTIFIC eBooks · doi:10.1142/9789812832153_0011 · Cited by 112
Allard, D., & Fraley, C. (1997) · Journal of the American Statistical Association · doi:10.1080/01621459.1997.10473670 · Cited by 82
Self-citationAutoclass — A Bayesian Approach to Classification
Stutz, J., & Cheeseman, P. (1996) · Springer eBooks · doi:10.1007/978-94-009-0107-0_13 · Cited by 46
Cited by
Dormann, C. F., Elith, J., Bacher, S., Buchmann, C., Carl, G., Carré, G., Marquéz, J. R. G., Gruber, B., Lafourcade, B., Leitão, P. J., et al. (2013) · Ecography · doi:10.1111/j.1600-0587.2012.07348.x · Cited by 9,998
Jombart, T., Devillard, S., & Balloux, F. (2010) · BMC Genetics · doi:10.1186/1471-2156-11-94 · Cited by 4,963
Model-Based Clustering, Discriminant Analysis, and Density Estimation
Fraley, C., & Raftery, A. E. (2002) · Journal of the American Statistical Association · doi:10.1198/016214502760047131 · Cited by 4,257
Self-citationLocal-global parcellation of the human cerebral cortex from intrinsic functional connectivity MRI
Schaefer, A., Kong, R., Gordon, E. M., Laumann, T. O., Zuo, X.-N., Holmes, A. J., Eickhoff, S. B., & Yeo, B. T. T. (2018) · Cerebral Cortex · doi:10.1093/cercor/bhx179 · Cited by 3,657
mclust 5: Clustering, Classification and Density Estimation Using Gaussian Finite Mixture Models
Scrucca, L., Fop, M., Murphy, T., & Raftery, A. (2016) · The R Journal · doi:10.32614/rj-2016-021 · Cited by 2,892
Metadata
- Authors
- Fraley, C.
- Venue
- The Computer Journal
- Publisher
- Oxford University Press (OUP)
- Published
- 1998-08-01
- Volume
- 41
- Issue
- 8
- Pages
- 578-588
- ISSN
- 0010-4620 (ISSN-L)
- 1460-2067
- OpenAlex
- W2047555270
- Cited by
- 2,549
- References
- 41
- FWCI
- 21.44
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.