An Approach for Determining the Number of Clusters in a Model-Based Cluster Analysis
Open accessThe DOI matches its Crossref record; 52 of the 53 references it cites were found in a registry or an index.
Abstract
To determine the number of clusters in the clustering analysis that has a broad range of applied sciences, such as physics, chemistry, biology, engineering, economics etc., many methods have been proposed in the literature. The aim of this paper is to determine the number of clusters of a dataset in a model-based clustering by using an Analytic Hierarchy Process (AHP). In this study, the AHP model has been created by using the information criteria Akaike’s Information Criterion (AIC), Approximate Weight of Evidence (AWE), Bayesian Information Criterion (BIC), Classification Likelihood Criterion (CLC), and Kullback Information Criterion (KIC). The achievement of the proposed approach has been tested on common real and synthetic datasets. The proposed approach based on the corresponding information criteria has produced accurate results. The currently produced results have been seen to be more accurate than those corresponding to the information criteria.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“According to the guidelines of Akogul and Erisoglu (2017), the best suited solution turned out to be the one distinguishing 4 classes (profiles).”
From The role of cognitive appraisals and illness-related beliefs in adaptation to life with rheumatoid arthritis: variable- and person-centered approach (2024) · cites this paper as Akogul and Erisoglu (2017)
Citations
Cites
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Estimating the Dimension of a Model
Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033
THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS
FISHER, R. A. (1936) · Annals of Eugenics · doi:10.1111/j.1469-1809.1936.tb02137.x · Cited by 15,227
How to Make a Decision: The Analytic Hierarchy Process
Saaty, T. L. (1990) · European Journal of Operational Research · doi:10.1016/0377-2217(90)90057-i · Cited by 9,605
Data clustering: 50 years beyond K-means
Jain, A. K. (2010) · Pattern Recognition Letters · doi:10.1016/j.patrec.2009.09.011 · Cited by 9,368
The analytic hierarchy process—what it is and how it is used
Saaty, R. W. (1987) · Mathematical Modelling · doi:10.1016/0270-0255(87)90473-8 · Cited by 5,380
Model-Based Clustering, Discriminant Analysis, and Density Estimation
Fraley, C., & Raftery, A. E. (2002) · Journal of the American Statistical Association · doi:10.1198/016214502760047131 · Cited by 4,257
Analytic hierarchy process: An overview of applications
Vaidya, O. S., & Kumar, S. (2006) · European Journal of Operational Research · doi:10.1016/j.ejor.2004.04.028 · Cited by 3,800
An entropy criterion for assessing the number of clusters in a mixture model
Celeux, G., & Soromenho, G. (1996) · Journal of Classification · doi:10.1007/bf01246098 · Cited by 2,448
Model-Based Gaussian and Non-Gaussian Clustering
Banfield, J. D., & Raftery, A. E. (1993) · Biometrics · doi:10.2307/2532201 · Cited by 2,395
Models, Methods, Concepts & Applications of the Analytic Hierarchy Process
Saaty, T. L., & Vargas, L. G. (2012) · International Series in Operations Research & Management Science · doi:10.1007/978-1-4614-3597-6 · Cited by 2,210 · cited 3×
“The AHP chooses the best one among the alternatives, taking into account the goal and the criteria [49].”
BackgroundIII. Contributions to the mathematical theory of evolution
Pearson, K. (1894) · Philosophical Transactions of the Royal Society of London. (A.) · doi:10.1098/rsta.1894.0003 · Cited by 1,550
The Analytic Hierarchy Process—An Exposition
Forman, E. H., & Gass, S. I. (2001) · Operations Research · doi:10.1287/opre.49.4.469.11231 · Cited by 1,070
Gaussian parsimonious clustering models
Celeux, G., & Govaert, G. (1995) · Pattern Recognition · doi:10.1016/0031-3203(94)00125-6 · Cited by 872
The Utilization of Multiple Measurements in Problems of Biological Classification
Rao, C. R. (1948) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1948.tb00008.x · Cited by 871
Model-based clustering and data transformations for gene expression data
Yeung, K. Y., Fraley, C., Murua, A., Raftery, A. E., & Ruzzo, W. L. (2001) · Bioinformatics · doi:10.1093/bioinformatics/17.10.977 · Cited by 869
Estimating the components of a mixture of normal distributions
DAY, N. E. (1969) · Biometrika · doi:10.1093/biomet/56.3.463 · Cited by 824
Biernacki, C., Celeux, G., & Govaert, G. (2003) · Computational Statistics & Data Analysis · doi:10.1016/s0167-9473(02)00163-9 · Cited by 658
Numerical methods for fuzzy clustering
Ruspini, E. H. (1970) · Information Sciences · doi:10.1016/s0020-0255(70)80056-1 · Cited by 561
Variable Selection for Model-Based Clustering
Raftery, A. E., & Dean, N. (2006) · Journal of the American Statistical Association · doi:10.1198/016214506000000113 · Cited by 521
Estimation of Parameters for a Mixture of Normal Distributions
Hasselblad, V. (1966) · Technometrics · doi:10.1080/00401706.1966.10490375 · Cited by 492
Model-based clustering of high-dimensional data: A review
Bouveyron, C., & Brunet-Saumard, C. (2014) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2012.12.008 · Cited by 467
A robust EM clustering algorithm for Gaussian mixture models
Yang, M.-S., Lai, C.-Y., & Lin, C.-Y. (2012) · Pattern Recognition · doi:10.1016/j.patcog.2012.04.031 · Cited by 366
Classification of radar returns from the ionosphere using neural networks
Sigillito, V. G. (1989) · Johns Hopkins APL technical digest · Cited by 344
BINDER, D. A. (1978) · Biometrika · doi:10.1093/biomet/65.1.31 · Cited by 302
A probabilistic classification system for predicting the cellular localization sites of proteins.
Horton, P., & Nakai, K. (1996) · PubMed · Cited by 300
Model selection for probabilistic clustering using cross-validated likelihood
Smyth, P. (2000) · Statistics and Computing · doi:10.1023/a:1008940618127 · Cited by 285
An Experimental Comparison of Model-Based Clustering Methods
Meilă, M., & Heckerman, D. (2001) · Machine Learning · doi:10.1023/a:1007648401407 · Cited by 280
Algorithms for Model-Based Gaussian Hierarchical Clustering
Fraley, C. (1998) · SIAM Journal on Scientific Computing · doi:10.1137/s1064827596311451 · Cited by 272
Genetic-based EM algorithm for learning Gaussian mixture models
Pernkopf, F., & Bouchaffra, D. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.162 · Cited by 265
Another interpretation of the EM algorithm for mixture distributions
Hathaway, R. J. (1986) · Statistics & Probability Letters · doi:10.1016/0167-7152(86)90016-7 · Cited by 246
A multivariate study of variation in two species of rock crab of the genus Leptograpsus
Campbell, N., & Mahon, R. (1974) · Australian Journal of Zoology · doi:10.1071/zo9740417 · Cited by 205
The EMMIX Algorithm for the Fitting of Normal andt-Components
McLachlan, G. J., & Peel, D. (1999) · Journal of Statistical Software · doi:10.18637/jss.v004.i02 · Cited by 201
An automatic method to determine the number of clusters using decision-theoretic rough set
Yu, H., Liu, Z., & Wang, G. (2014) · International Journal of Approximate Reasoning · doi:10.1016/j.ijar.2013.03.018 · Cited by 201
A large-sample model selection criterion based on Kullback's symmetric divergence
Cavanaugh, J. E. (1999) · Statistics & Probability Letters · doi:10.1016/s0167-7152(98)00200-4 · Cited by 196
An attempt to define the nature of chemical diabetes using a multidimensional analysis
Reaven, G. M., & Miller, R. G. (1979) · Diabetologia · doi:10.1007/bf00423145 · Cited by 188
Bozdogan, H. (1993) · Studies in Classification, Data Analysis and Knowledge Organization · doi:10.1007/978-3-642-50974-2_5 · Cited by 186
ENSEMBLE OF SOFTWARE DEFECT PREDICTORS: AN AHP-BASED EVALUATION METHOD
PENG, Y., KOU, G., WANG, G., WU, W., & SHI, Y. (2011) · International Journal of Information Technology & Decision Making · doi:10.1142/s0219622011004282 · Cited by 180
Estimation of Finite Mixtures of Distributions from the Exponential Family
Hasselblad, V. (1969) · Journal of the American Statistical Association · doi:10.1080/01621459.1969.10501071 · Cited by 176
Model-based clustering based on sparse finite Gaussian mixtures
Malsiner-Walli, G., Frühwirth-Schnatter, S., & Grün, B. (2016) · Statistics and Computing · doi:10.1007/s11222-014-9500-2 · Cited by 173
Bozdogan, H. (1990) · Communication in Statistics- Theory and Methods · doi:10.1080/03610929008830199 · Cited by 156
Model-based clustering and classification with non-normal mixture distributions
Lee, S., & McLachlan, G. J. (2013) · Statistical Methods & Applications · doi:10.1007/s10260-013-0237-4 · Cited by 125
Using the analytic hierarchy process for information system project selection
Muralidhar, K., Santhanam, R., & Wilson, R. L. (1990) · Information & Management · doi:10.1016/0378-7206(90)90055-m · Cited by 123
A COMPUTER PROGRAM FOR THE MAXIMUM LIKELIHOOD ANALYSIS OF TYPES
Wolfe, J. H. (1965) · Defense Technical Information Center (DTIC) · doi:10.21236/ad0620026 · Cited by 78
Model-Based Learning Using a Mixture of Mixtures of Gaussian and Uniform Distributions
Browne, R. P., McNicholas, P. D., & Sparling, M. D. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.199 · Cited by 78
Model-based clustering of Gaussian copulas for mixed data
Marbac, M., Biernacki, C., & Vandewalle, V. (2017) · Communication in Statistics- Theory and Methods · doi:10.1080/03610926.2016.1277753 · Cited by 60
Everitt, B. S. (1984) · Journal of the Royal Statistical Society Series D (The Statistician) · doi:10.2307/2987851 · Cited by 48
A Multicriteria Decision Making Approach for Estimating the Number of Clusters in a Data Set
Peng, Y., Zhang, Y., Kou, G., & Shi, Y. (2012) · PLoS ONE · doi:10.1371/journal.pone.0041713 · Cited by 38
Akoğul, S., & Erişoğlu, M. (2016) · Mathematical and Computational Applications · doi:10.3390/mca21030034 · Cited by 33
Kwedlo, W. (2015) · Pattern Analysis and Applications · doi:10.1007/s10044-014-0441-3 · Cited by 18
Bozdogan, H., Sclove, S. L., Gupta, A. K., Haughton, D., Kitagawa, G., Ozaki, T., & Tanabe, K. (1994) · Springer eBooks · doi:10.1007/978-94-011-0866-9 · Cited by 6
A model selection algorithm for mixture model clustering of heterogeneous multivariate data
Erol, H. (2013) · International Conference on Innovations in Intelligent Systems and Applications (INISTA) · doi:10.1109/inista.2013.6577617 · Cited by 5
Research works printed but not linked: 5
- Saaty, T.L. (1980). The Analytic Hierarchy Process. Cook WD and Seiford LM (1978). Priority Ranking and Consensus Formation, Management Science, McGraw-Hill.
- McLachlan, G., and Peel, D. (2004). Finite Mixture Models, John Wiley & Sons.
- Akaike, H. (1971, January 2–8). Information theory and an extension of the Maximum likelihood Principal. Proceedings of the 2nd International Symposium on Information Theory, Tsahkadsor, Armenia.
- Biernacki, 1997, Using the classification likelihood to choose the number of clusters, Comput. Sci. Stat., 29, 451
- Oliveira-Brochado, A., and Martins, F.V. (2005). Assessing the Number of Components in Mixture Models: A Review, Universidade do Porto, Faculdade de Economia do Porto. Technical Report.
Cited by
Loneliness and emotion regulation
Preece, D. A., Goldenberg, A., Becerra, R., Boyes, M., Hasking, P., & Gross, J. J. (2021) · Personality and Individual Differences · doi:10.1016/j.paid.2021.110974 · Cited by 135
Coplan, R. J., Hipson, W. E., & Bowker, J. C. (2021) · Journal of Youth and Adolescence · doi:10.1007/s10964-020-01365-0 · Cited by 103
Alexithymia Profiles and Depression, Anxiety, and Stress
Preece, D. A., Mehta, A., Petrova, K., Sikka, P., Pemberton, E., & Gross, J. J. (2024) · Journal of Affective Disorders · doi:10.1016/j.jad.2024.02.071 · Cited by 82
COVID-19: A Boon or a Bane for Creativity?
Mercier, M., Vinchon, F., Pichot, N., Bonetto, É., Bonnardel, N., Girandola, F., & Lubart, T. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.601150 · Cited by 80
Determining the optimal number of clusters by Enhanced Gap Statistic in K-mean algorithm
Khan, I. K., Daud, H., Zainuddin, N. B., Sokkalingam, R., Farooq, M., Baig, M. E., Ayub, G., & Zafar, M. (2024) · Egyptian Informatics Journal · doi:10.1016/j.eij.2024.100504 · Cited by 67
Metadata
- Authors
- Akogul, S., & Erisoglu, M.
- Affiliations
- Department of Statistics, Yildiz Technical University, 34220 Istanbul, Turkey
- Department of Statistics, Necmettin Erbakan University, 42090 Konya, Turkey
- ORCID
- Akogul, Serkan
- Venue
- Entropy
- Publisher
- MDPI AG
- Published
- 2017-08-29
- Volume
- 19
- Issue
- 9
- Pages
- 452
- ISSN
- 1099-4300 (ISSN-L)
- OpenAlex
- W2752363677
- Cited by
- 269
- References
- 53
- Citations by year
- 2026: 42 · 2025: 57 · 2024: 43 · 2023: 28 · 2022: 43 · 2021: 33 · 2020: 13 · 2019: 4 · 2018: 6
- FWCI
- 3.75
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Entropy (publishedVersion, cc-by)
- Pamukkale University Open Access Archive (Pamukkale University) (submittedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Türkiye Bilimsel ve Teknolojik Araştırma Kurumu
- Yildiz Teknik Üniversitesi
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Advanced Clustering Algorithms Research
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Methods and Mixture Models
- Social Sciences › Decision Sciences › Management Science and Operations Research › Multi-Criteria Decision Making
- Keywords
- number of clusters, model-based clustering, analytic hierarchy process, information criteria, Akaike information criterion, Bayesian information criterion, optimal number of clusters
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.