An entropy criterion for assessing the number of clusters in a mixture model
Open accessThe DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Entropy above .80 also indicates a good-fitting model [40, 41].”
From Symptom experiences in post-treatment cancer survivors: associations with acceptance and commitment therapy constructs. (2021) · cites this paper as [40]
In the citing paper
“These values can vary between 0 and 1 with higher values representing greater accuracy of classification and values above 0.80 evidencing classification with minimal uncertainty.”
From Coping profiles and their association with psychological functioning: A latent profile analysis of coping strategies during the COVID-19 pandemic (2022) · cites this paper as Celeux & Soromenho, 1996
In the citing paper
“the entropy values of greater than .80 showed a 220 clear delineation of classes in the 'quadratic' GMM models with two or three classes 221 (Celeux and Soromenho, 1996).”
From Time in treatment: Examining mental illness trajectories across inpatient psychiatric treatment (2020) · cites this paper as Celeux and Soromenho, 1996
Citations
Cites
A new look at the statistical model identification
Akaike, H. (1974) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1974.1100705 · Cited by 51,879
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Estimating the Dimension of a Model
Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033
(1967) · Cited by 23,719
Pattern Recognition with Fuzzy Objective Function Algorithms
Bezdek, J. C. (1981) · doi:10.1007/978-1-4757-0450-1 · Cited by 9,881
Statistical Analysis of Finite Mixture Distributions.
Lindsay, B. G., Titterington, D. M., Smith, A. F. M., & Makov, U. E. (1987) · Journal of the American Statistical Association · doi:10.2307/2289504 · Cited by 2,905
Model-Based Gaussian and Non-Gaussian Clustering
Banfield, J. D., & Raftery, A. E. (1993) · Biometrics · doi:10.2307/2532201 · Cited by 2,395 · cited 2×
“…have considered the problem of choosing the number of clusters, in a partitioning setting, within the context of multivariate mixture models (see Bock 1985; Celeux 1986; Bozdogan 1993; Banfield and Raftery 1993; McLachlan and Basford 1988; Windham and Cutler 1992; Bryant 1993, among others).”
MethodMixture models : inference and applications to clustering
McLachlan, G. J., & Basford, K. E. (1988) · M. Dekker eBooks · Cited by 2,094
Statistical Analysis of Finite Mixture Distributions.
Newton, J., Titterington, D. M., Smith, A. F. M., & Makov, U. E. (1986) · Biometrics · doi:10.2307/2531224 · Cited by 1,986
Proceedings of the 6th Berkeley Symposium on Mathematical Statistics and Probability
Cam, L. M. L., Neyman, J., & Scott, E. L. (1972) · Medical Entomology and Zoology · Cited by 1,679
Research works printed but not linked: 1
- BRYANT, P. G., and WILLIAMSON, J. A. (1986), ?Maximum Likelihood and Classification: a Comparison of Three Approaches,? inClassification as a tool of research, Eds., W. Gaul and M. Schader, North-Holland, pp. 33?45.
Cited by
Items 101–200 of 1,010
Lebret, R., Iovleff, S., Langrognet, F., Biernacki, C., Celeux, G., & Govaert, G. (2015) · Journal of Statistical Software · doi:10.18637/jss.v067.i06 · Cited by 108
“The index K is used to highlight that NEC is essentially devoted to choosing the number of mixture components K , not the model parameterization (Celeux and Soromenho 1996; Biernacki, Celeux, and Govaert 1999).”
Self-citationTrajectories of acute low back pain: a latent class growth analysis
Downie, A. S., Hancock, M. J., Rzewuska, M., Williams, C. M., Lin, C.-W. C., & Maher, C. G. (2016) · Pain · doi:10.1097/j.pain.0000000000000351 · Cited by 107
Khurana, A., Römer, D., Betancourt, L. M., & Hurt, H. (2017) · Addiction · doi:10.1111/add.13792 · Cited by 126
“80) [37], classification criteria (>91% classification probabilities), and model fit indices (LRT and bootstrap LRT results), we assigned participants to the latent classes they were most likely to belong based on highest posterior probabilities.”
Adverse childhood experiences and the associations with depression and anxiety in adolescents
Lee, H. Y., Kim, I., Nam, S., & Jeong, J. (2020) · Children and Youth Services Review · doi:10.1016/j.childyouth.2020.104850 · Cited by 137
Peura, P., Aro, T. I., Räikkönen, E., Viholainen, H., Koponen, T. K., Usher, E. L., & Aro, M. T. (2021) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2021.101947 · Cited by 141
Fryer, L. K., & Ainley, M. (2019) · Learning and Instruction · doi:10.1016/j.learninstruc.2017.11.002 · Cited by 103
Choosing the number of clusters
Mirkin, B. (2011) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.15 · Cited by 105
“12 Both of these can be evaluated as side products of the ordinary expectation maximization (EM) algorithm at each prespecified K so that no additional efforts are needed to compute them.”
BackgroundEvaluation of Structural Equation Mixture Models: Parameter Estimates and Correct Class Assignment
Tueller, S., & Lubke, G. (2010) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511003659318 · Cited by 104
“Much of the prior FMM and SEMM research has focussed on choosing the correct number of classes, factors, or both ( Celeux & Soromenho, 1996 ; Henson et al, 2007 ; Jeffries, 2003 ; Lo, Mendell, & Rubin, 2001 ; Lubke & Muthen, 2007 ; Lubke & Neale, 2006 ; Nylund et al, 2007 ).”
MethodMixture-model cluster analysis using information theoretical criteria
Fonseca, J. R. S., & Cardoso, M. G. M. S. (2007) · Intelligent Data Analysis · doi:10.3233/ida-2007-11204 · Cited by 127
“C. Biernacki, G. Celeux and G. Govaert [12] suggested the improved NEC (originally introduced by Celeux and Soromenho [20]), which chooses a model with s clusters for minimum NEC( s ) (cid:2) 1, (2 (cid:2) s (cid:2) S), because they state that NEC (1) = 1 ; otherwise NEC declares there is no…”
Separating Latent Classes by Information Criteria
Yang, C.-C., & Yang, C.-C. (2007) · Journal of Classification · doi:10.1007/s00357-007-0010-1 · Cited by 118
Perceived Barriers to Treatment for Alcohol Problems: A Latent Class Analysis
Schuler, M. S., Puttaiah, S., Mojtabai, R., & Crum, R. M. (2015) · Psychiatric Services · doi:10.1176/appi.ps.201400160 · Cited by 101
“To determine the optimal number of latent classes, we implemented LCA models with 1 to 5 classes and considered the following fit statistics: Akaike Information Criterion (AIC), Bayesian Information Criterion (BIC), adjusted BIC, Lo-Mendell-Rubin likelihood ratio test (LMR LRT), and entropy (42-46).”
Ağırdağ, O. (2013) · International Journal of Bilingual Education and Bilingualism · doi:10.1080/13670050.2013.816264 · Cited by 114
Time spent online: Latent profile analyses of emerging adults' social media use
Scott, C. F., Bay-Cheng, L. Y., Prince, M. A., Nochajski, T. H., & Collins, R. L. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2017.05.026 · Cited by 99
PLS-Based Model Selection: The Role of Alternative Explanations in Information Systems Research
Sharma, P. N., Sarstedt, M., Galit Shmueli, A., Kim, K. H., & Thiele, K. O. (2019) · tub.dok (Hamburg University of Technology) · doi:10.17005/1.jais.00538 · Cited by 98
“…various scenarios and methodological contexts, such as mixtures of normal distributions (e.g., Biernacki, Celeux, & Govaert, 2000; Bozdogan, 1994; Celeux & Soromenho, 1996), mixture regression models (e.g., Andrews & Currim, 2003a; Becker, Ringle, Sarstedt, & Völckner, 2015; Hawkins, Allen, &…”
Fong, C. J., Kremer, K. P., Cox, C. H.-T., & Lawson, C. A. (2021) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2021.101962 · Cited by 118
Allen, J. D., Caspi, C. E., YANG, M. H., Leyva, B., Stoddard, A. M., Tamers, S. L., Tucker‐Seeley, R. D., & Sorensen, G. (2014) · Social Science & Medicine · doi:10.1016/j.socscimed.2014.10.034 · Cited by 115
“We used the Akaike Information Criteria (AIC), Bayesian Information Criteria (BIC), and entropy indices to compare the fit of increasing class solutions (Celeux & Soromenho, 1996).”
A geometric approach to cluster validity for normal mixtures
Bezdek, J. C., Li, W. Q., Attikiouzel, Y., & Windham, M. P. (1997) · Soft Computing · doi:10.1007/s005000050019 · Cited by 105
“The only probabilistic criterion we tested that is an explicit function of both P and g is Celeux’s NEC entropy criteria [12].”
BackgroundTrajectories of Social Engagement and Mortality in Late Life
Thomas, P. A. (2012) · Journal of Aging and Health · doi:10.1177/0898264311432310 · Cited by 97
“The model had high entropy at 0.92, indicating a clear delineation of classes with little overlap (Celeux & Soromenho, 1996).”
MethodInfluentialMcCullough, S. J., Adamson, G., Breslin, K. M. M., McClelland, J. F., Doyle, L. A., & Saunders, K. J. (2020) · Scientific Reports · doi:10.1038/s41598-020-72240-y · Cited by 98
Refining the phenotype of borderline personality disorder: Diagnostic criteria and beyond.
Hallquist, M. N., & Pilkonis, P. A. (2012) · Personality Disorders Theory Research and Treatment · doi:10.1037/a0027953 · Cited by 132
“…the BLRT selected a 4-class FinMM (ns = 28, 27, 20, and 20) as the best-fitting model, and there was a high degree of certainty about the class membership of each individual, entropy = .83 (average conditional probability of latent class membership ≥ .90 for all classes; Celeux & Soromenho, 1996).”
MethodUnderstanding household switching behavior in the retail electricity market
Yang, Y. (2014) · Energy Policy · doi:10.1016/j.enpol.2014.03.009 · Cited by 113
Hallquist, M. N., & Wright, A. G. C. (2014) · Journal of Personality Assessment · doi:10.1080/00223891.2013.845201 · Cited by 95
“To the extent that individuals have a high probability of being in a single class, the model is said to have high entropy, a statistic that varies from 0, reflecting complete uncertainty about assignment, to 1, reflecting complete certainty (Celeux & Soromenho, 1996).”
La Flair, L. N., Bradshaw, C. P., Storr, C. L., Green, K. M., Alvanzo, A. A. H., & Crum, R. M. (2012) · Journal of Studies on Alcohol and Drugs · doi:10.15288/jsad.2012.73.351 · Cited by 94
The artificial intelligence divide: Who is the most vulnerable?
Wang, C., Boerman, S. C., Kroon, A. C., Möller, J. E., & de Vreese, C. H. (2024) · New Media & Society · doi:10.1177/14614448241232345 · Cited by 174
“In this study, we adopted the most commonly used statistics, the log-likelihood (LL), Bayesian information criterion (BIC), Akaike’s information criteria (AIC) (Schwarz, 1978), Lo–Mendell–Rubin adjusted likelihood ratio test (LRT), and the entropy score (Celeux and Soromenho, 1996).”
Chamberlain, S. R., Štochl, J., Redden, S. A., Odlaug, B. L., & Grant, J. E. (2017) · Addictive Behaviors · doi:10.1016/j.addbeh.2017.03.020 · Cited by 112
“Entropy of the three class model was 0.82, indicating reasonable delineation of classes (Celeux & Soromenho, 1996).”
MethodInfluentialCarlesso, L. C., Segal, N. A., Frey‐Law, L., Zhang, Y., Lu, N., Nevitt, M. C., Lewis, C. E., & Neogi, T. (2018) · Arthritis & Rheumatology · doi:10.1002/art.40752 · Cited by 97
“40752/abstract), indicating good quality of classification (35), and the classification probabilities for each class were all >0.”
BackgroundEmotion Regulation Profiles, Temperament, and Adjustment Problems in Preadolescents
Zalewski, M., Lengua, L. J., Wilson, A. C., Trancik, A., & Bazinet, A. D. (2011) · Child Development · doi:10.1111/j.1467-8624.2011.01575.x · Cited by 112
“Entropy is reported as further evidence for our profile selection, with values approaching 1 suggesting superior class identification (Celeux & Soromenho, 1996).”
ResultProfiles of internalizing and externalizing symptoms associated with bullying victimization
Eastman, M. L., Foshee, V. A., Ennett, S. T., Sotres‐Alvarez, D., Reyes, H. L. M., Faris, R., & North, K. E. (2018) · Journal of Adolescence · doi:10.1016/j.adolescence.2018.03.007 · Cited by 106
Yoon, I., & Kim, M. (2021) · Teaching and Teacher Education · doi:10.1016/j.tate.2021.103565 · Cited by 129
Determining the number of components in mixtures of linear models
Hawkins, D. S., Allen, D. M., & Stromberg, A. J. (2001) · Computational Statistics & Data Analysis · doi:10.1016/s0167-9473(01)00017-2 · Cited by 90
Ashenhurst, J. R., Wilhite, E. R., Harden, K. P., & Fromme, K. (2016) · Archives of Sexual Behavior · doi:10.1007/s10508-016-0692-8 · Cited by 102
Killing and latent classes of PTSD symptoms in Iraq and Afghanistan veterans
Maguen, S., Madden, E., Bosch, J. O., Galatzer‐Levy, I. R., Knight, S. J., Litz, B. T., Marmar, C. R., & McCaslin, S. E. (2012) · Journal of Affective Disorders · doi:10.1016/j.jad.2012.08.021 · Cited by 100
Rauschnabel, P. A., Hein, D. W. E., He, J., Ro, Y. K., Rawashdeh, S. A., & Krulikowski, B. (2016) · i-com · doi:10.1515/icom-2016-0021 · Cited by 106
Gamma mixture models for target recognition
Webb, A. R. (2000) · Pattern Recognition · doi:10.1016/s0031-3203(99)00195-8 · Cited by 87
Dimension reduction for model-based clustering
Scrucca, L. (2009) · Statistics and Computing · doi:10.1007/s11222-009-9138-7 · Cited by 102
Deniz Erdogmus, B., & Príncipe, J. C. (2006) · IEEE Signal Processing Magazine · doi:10.1109/sp-m.2006.248709 · Cited by 86
“Then, the number of components in the mixture can be selected as the minimizer of NEC (M) if NEC (M * ) ≤ 1 and M = 1 otherwise [4] In contrast to the penalized entropy method, the NEC method tries to make sure that a model fit achieves both large data likelihood and a balanced usage of the components (as measured by…”
BackgroundInfluentialMcPherson, K. E., McAloney‐Kocaman, K., McGlinchey, E., Faeth, P. C., & Armour, C. (2021) · Psychiatry Research · doi:10.1016/j.psychres.2021.114138 · Cited by 98
Willoughby, B. J., Carroll, J. S., Nelson, L. J., & Padilla‐Walker, L. M. (2014) · Culture Health & Sexuality · doi:10.1080/13691058.2014.927075 · Cited by 104
Nation Binding: How Public Service Broadcasting Mitigates Political Selective Exposure
Bos, L., Kruikemeier, S., & de Vreese, C. (2016) · PLOS ONE · doi:10.1371/journal.pone.0155112 · Cited by 84
“) model to provide well separated clusters” and for which values approaching one indicate clear delineation of classes ([21]), has a value of .”
Kavčič, T., Avsec, A., & Zager Kocjan, G. (2022) · Personality and Individual Differences · doi:10.1016/j.paid.2021.111287 · Cited by 84
Morgan, G. B., Hodge, K. J., & Baggett, A. R. (2015) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2015.02.019 · Cited by 99
Quirk, M., Nylund-Gibson, K., & Furlong, M. (2013) · Early Childhood Research Quarterly · doi:10.1016/j.ecresq.2012.11.002 · Cited by 84
“Entropy ranges between 0 and 1, where 1 is perfect classification and values approaching 1 indicate clear delineation of classes (Celeux & Soromenho, 1996).”
Gaussian Mixture Modeling by Exploiting the Mahalanobis Distance
Ververidis, D., & Kotropoulos, C. L. (2008) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2008.917350 · Cited by 83
Klug, K., Felfe, J., & Krick, A. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02456 · Cited by 82
Profiling development of burnout over eight years: relation with job demands and resources
Mäkikangas, A., Leiter, M. P., Kinnunen, U. M., & Feldt, T. (2020) · European Journal of Work and Organizational Psychology · doi:10.1080/1359432x.2020.1790651 · Cited by 158
“Entropy illustrates the classification accuracy and AvePP evaluates the certainty of placing an observation in a particular profile using posterior probabilities (Celeux & Soromenho, 1996; Jung & Wickrama, 2008).”
BackgroundE-Cigarettes and the Drug Use Patterns of Adolescents
Miech, R. A., O’Malley, P. M., Johnston, L. D., & Patrick, M. E. (2016) · Nicotine & Tobacco Research · doi:10.1093/ntr/ntv217 · Cited by 80
Jeon, L., Buettner, C. K., & Hur, E. (2016) · Early Education and Development · doi:10.1080/10409289.2016.1099354 · Cited by 80
“…values of the bootstrap likelihood ratio test and Lo–Mendell–Rubin likelihood ratio test (Lo, Mendell, & Rubin, 2001; p < .05 indicates that the estimated model is more favorable than the model with one less group), and entropy (Celeux & Soromenho, 1996; range = 0–1, higher values are preferable).”
MethodWolff, K. T., Cuevas, C., Intravia, J., Baglivio, M. T., & Epps, N. (2018) · Journal of Youth and Adolescence · doi:10.1007/s10964-018-0887-5 · Cited by 116
Patterns of pregnancy and postpartum depressive symptoms: Latent class trajectories and predictors.
Fredriksen, E., von Soest, T., Smith, L., & Moe, V. (2017) · Journal of Abnormal Psychology · doi:10.1037/abn0000246 · Cited by 79
Patterns of youth tobacco and polytobacco usage: The shift to alternative tobacco products
Harrell, P. T., Naqvi, S. M. H., Plunk, A. D., Ji, M., & Martins, S. S. (2016) · The American Journal of Drug and Alcohol Abuse · doi:10.1080/00952990.2016.1225072 · Cited by 83
“The utility and precision of the resulting classes was assessed using entropy (31,32).”
MethodSame mindset, different goals and motivational frameworks: Profiles of mindset-based meaning systems
Yu, J., & McLellan, R. (2020) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2020.101901 · Cited by 102
Personality profiles: Using latent profile analysis to model personality typologies
Ferguson, S. L., & Hull, D. M. (2017) · Personality and Individual Differences · doi:10.1016/j.paid.2017.10.029 · Cited by 94
Feldt, T., Huhtala, M., Kinnunen, U., Hyvönen, K., Mäkikangas, A., & Sonnentag, S. (2013) · Work & Stress · doi:10.1080/02678373.2013.765670 · Cited by 78
“…the Bayesian Information Criterion (BIC); (2) classification quality as determined by entropy values (entropy values range from 0 to 1, where values close to 1 indicate clear classification; Celeux & Soromenho, 1996); (3) the Vuong-Lo-Mendel-Rubin (VLMR); and (4) the Lo-Mendell-Rubin (LMR) test.”
BackgroundUnderstanding HIV Care Provider Attitudes Regarding Intentions to Prescribe PrEP
Castel, A. D., Feaster, D. J., Tang, W., Willis, S. J., Jordan, H., Villamizar, K., Kharfen, M., Kolber, M. A., Rodriguez, A. E., & Metsch, L. R. (2015) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/qai.0000000000000780 · Cited by 79
“Entropy with values approaching 1 indicates clear delineation of classes.(29) For categorical variables, x2 tests were combined across imputations using the method described by Li et al,(30) which results in an F-statistic and associated P value.”
MethodArmour, C., Elklit, A., Lauterbach, D., & Elhai, J. D. (2014) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2013.12.008 · Cited by 92
Peugh, J., & Fan, X. (2012) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2012.659618 · Cited by 76
“…entropy-based enumeration indexes that reward GMM models producing well-defined trajectory profiles have been proposed (e.g., Bauer & Curran, 2003a, 2004): the normalized entropy criterion (NEC; Celeux & Soromenho, 1996), and the classification likelihood criterion (CLC; Biernacki & Govaert, 1997).”
BackgroundKashikar-Zuck, S., Cunningham, N., Peugh, J., Black, W. R., Nelson, S., Lynch-Jordan, A. M., Pfeiffer, M., Tran, S. T., Ting, T. V., Arnold, L. M., et al. (2019) · Pain · doi:10.1097/j.pain.0000000000001415 · Cited by 72
Lavigne, R. (2010) · European Journal of Political Economy · doi:10.1016/j.ejpoleco.2010.04.001 · Cited by 83
A comparison of some criteria for states selection in the latent Markov model for longitudinal data
Bacci, S., Pandolfi, S., & Pennoni, F. (2013) · Advances in Data Analysis and Classification · doi:10.1007/s11634-013-0154-2 · Cited by 75
“Celeux and Soromenho (1996) proposed to consider the following criterion NEC = EN ̂k(θ) − ̂1(θ) , k ≥ 2, (8) where ̂k(θ) is the maximum log-likelihood in a k components mixture and ̂1(θ) is the maximum log-likelihood in a one component mixture.”
BackgroundInfluentialGrowth mixture models in longitudinal research
Reinecke, J., & Seddig, D. (2011) · AStA Advances in Statistical Analysis · doi:10.1007/s10182-011-0171-4 · Cited by 80
Patrick, M. E., Bray, B. C., & Berglund, P. A. (2016) · Journal of Studies on Alcohol and Drugs · doi:10.15288/jsad.2016.77.881 · Cited by 89
“…Bayesian information criterion (BIC; Schwarz, 1978), consistent AIC (CAIC; Bozdogan, 1987), sample size–adjusted BIC (aBIC; Sclove, 1987), entropy (Celeux & Soromenho, 1996), and a bootstrapped likelihood ratio test (BLRT; McLachlan, 1987; McLachlan & Peel, 2000), as well as model stability and…”
MethodBurić, I., Kim, L. E., & Hodis, F. A. (2021) · Journal of Educational Psychology · doi:10.1037/edu0000654 · Cited by 107
“…BIC (SABIC; Sclove, 1987), as well as the adjusted and bootstrapped likelihood ratio test (ALRT and BLRT; McLachlan & Peel, 2000), and the entropy (Celeux & Soromenho, 1996); for indepth discussions and examples of LPA model building, estimation, and interpretation of findings, interested…”
BackgroundBoisvert, S., & Poulin, F. (2016) · Journal of Youth and Adolescence · doi:10.1007/s10964-016-0435-0 · Cited by 73
“The entropy was used to determine the degree of uncertainty of the classification (Celeux and Soromenho 1996).”
MethodKing, C. A., Brent, D., Grupp-Phelan, J., Shenoi, R., Page, K., Mahabee-Gittens, E. M., Chernick, L. S., Melzer-Lange, M., Rea, M., McGuire, T. C., et al. (2020) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2019.10.015 · Cited by 73
Chang, F., Yasmin, S., Huang, H., Chan, A. H. S., & Haque, M. M. (2021) · Analytic Methods in Accident Research · doi:10.1016/j.amar.2021.100188 · Cited by 73
Petersen, M. W., Schröder, A., Jørgensen, T., Ørnbøl, E., Dantoft, T. M., Eliasen, M., Thuesen, B. H., & Fink, P. (2020) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2019.109868 · Cited by 71
van den Heuvel, M. W. H., Stikkelbroek, Y. A. J., Bodden, D. H. M., & van Baar, A. L. (2019) · Development and Psychopathology · doi:10.1017/s0954579419000920 · Cited by 86
“Entropy indicates how well a model categorizes individuals into profiles, with better categorization for values closer to 1 (Celeux & Soromenho, 1996).”
Boer, M., Stevens, G. W. J. M., Finkenauer, C., Koning, I. M., & van den Eijnden, R. J. J. M. (2022) · Assessment · doi:10.1177/10731911211027232 · Cited by 71
“This means that there was substantial overlap in adolescents’ item scores between the classes in the four- and five-class solutions, which diminishes the interpretability of the classes (Celeux & Soromenho, 1996).”
BackgroundLegleye, S., Piontek, D., Kraus, L., Morand, É., & Falissard, B. (2013) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1378 · Cited by 75
“The model with the optimal number of classes was the one with the lowest Bayesian information criterion (BIC) and the highest entropy (Celeux and Soromenho, 1996).”
MethodMiaskowski, C. A., Cooper, B. A., Dhruva, A., Dunn, L. B., Langford, D. J., Cataldo, J. K., Baggott, C., Merriman, J. D., Dodd, M. J., Lee, K. A., et al. (2012) · PLoS ONE · doi:10.1371/journal.pone.0040560 · Cited by 74
“[53,58].”
Lizzio‐Wilson, M., Thomas, E. F., Louis, W. R., Wilcockson, B., Amiot, C. E., Moghaddam, F. M., & McGarty, C. (2021) · Psychological Science · doi:10.1177/0956797620970562 · Cited by 83
Putwain, D. W., Stockinger, K., von der Embse, N. P., Suldo, S. M., & Daumiller, M. H. (2021) · Journal of School Psychology · doi:10.1016/j.jsp.2021.08.001 · Cited by 91
Observed Classroom Quality Profiles of Kindergarten Classrooms in Finland
Salminen, J., Lerkkanen, M., Poikkeus, A., Pakarinen, E., Siekkinen, M., Hännikäinen, M., Poikonen, P., & Rasku‐Puttonen, H. (2012) · Early Education and Development · doi:10.1080/10409289.2011.574267 · Cited by 95
Smoking patterns during pregnancy and postnatal period and depressive symptoms
Munafo, M., Heron, J., & Araya, R. (2008) · Nicotine & Tobacco Research · doi:10.1080/14622200802412895 · Cited by 70
Fitting Mixtures of Kent Distributions to Aid in Joint Set Identification
Peel, D. A., Whiten, W. J., & McLachlan, G. J. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501750332974 · Cited by 70
“The M step requires nding the value of ë , ë 4k+ 15 that globally maximizes the objective function Q4ë 3 ë 4k55, which is de ned to be the conditional expectation of the completedata log-likelihood given the observed data, computed using ë 4k5 for ë .”
BackgroundMethodDharma, C., Lefebvre, D. L., Tran, M. M., Lou, W. Y. W., Subbarao, P., Becker, A. B., Mandhane, P. J., Turvey, S. E., Sears, M. R., & the CHILD Study investigators (2017) · Clinical & Experimental Allergy · doi:10.1111/cea.13063 · Cited by 81
“91.(33) These 5 classes were as follows:”
Achterhof, R., Huntjens, R. J. C., Meewisse, M.-L., & Kiers, H. A. L. (2019) · European Journal of Psychotraumatology · doi:10.1080/20008198.2019.1698223 · Cited by 70
“In addition, entropy values are computed, which refer to the uncertainty of classification of cases to clusters, and they are calculated using the individual posterior probabilities of class membership (Celeux & Soromenho, 1996).”
MethodExamining Variation in Adolescent Bystanders' Responses to Bullying
Waasdorp, T. E., & Bradshaw, C. P. (2018) · School Psychology Review · doi:10.17105/spr-2017-0081.v47-1 · Cited by 80
“Finally, the entropy was calculated, which indicates classification accuracy, such that entropy values greater than .80 reflect classes that are highly discriminating (Celeux & Soromenho, 1996; Nylund, Asparouhov, & Muthén, 2007).”
MethodBauer, G. R., Mahendran, M., Walwyn, C., & Shokoohi, M. (2021) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-021-02195-6 · Cited by 93
“As model-based methods, goodness-of-fit statistics such as the Akaike information criterion [15], Bayesian information criterion [16], sample size adjusted BIC [17], and entropy [18] are available to aid in decision-making about the number and features of the latent groups.”
MethodStapinski, L. A., Edwards, A. C., Hickman, M., Araya, R., Teesson, M., Newton, N. C., Kendler, K. S., & Heron, J. E. (2016) · Prevention Science · doi:10.1007/s11121-016-0652-5 · Cited by 80
“A well differentiated class solution is desirable, thus entropy (an index of class separation based on the posterior class membership probabilities; Celeux & Soromenho, 1996) was considered when comparing models with two or more classes.”
MethodMathur, S., Pilgrim, N. A., Patel, S. K., Okal, J. O., Mwapasa, V., Chipeta, E. K., Musheke, M., Mahapatra, B., & Pulerwitz, J. (2020) · International Journal of Public Health · doi:10.1007/s00038-020-01350-1 · Cited by 70
Symptom Clusters in Breast Cancer Survivors: A Latent Class Profile Analysis
Lee, L., Ross, A., Griffith, K., Jensen, R., & Wallen, G. (2020) · Oncology Nursing Forum · doi:10.1188/20.onf.89-100 · Cited by 66
Patterns of inquiry-based science instruction and student science achievement in PISA 2015
Forbes, C. T., Neumann, K., & Schiepe-Tiska, A. (2020) · International Journal of Science Education · doi:10.1080/09500693.2020.1730017 · Cited by 99
Bernstein, A., Stickle, T. R., Zvolensky, M. J., Taylor, S. J., Abramowitz, J. S., & Stewart, S. H. (2010) · Behavior Therapy · doi:10.1016/j.beth.2010.02.003 · Cited by 71
Identifying classes of conjoint alcohol and marijuana use in entering freshmen.
Haas, A. L., Wickham, R. E., Macia, K. S., Shields, M., Macher, R. B., & Schulte, T. (2015) · Psychology of Addictive Behaviors · doi:10.1037/adb0000089 · Cited by 70
Health and work-life balance across types of work schedules: A latent class analysis
Brauner, C., Wöhrmann, A. M., Frank, K., & Michel, A. (2019) · Applied Ergonomics · doi:10.1016/j.apergo.2019.102906 · Cited by 99
Transitions between subclasses of bullying and victimization when entering middle school
Williford, A., Boulton, A. J., & Jenson, J. M. (2013) · Aggressive Behavior · doi:10.1002/ab.21503 · Cited by 77
Stephens, K., Cooper, B. A., West, C. M., Paul, S. M., Baggott, C., Merriman, J. D., Dhruva, A., Kober, K. M., Langford, D. J., Leutwyler, H. C., et al. (2013) · Journal of Pain · doi:10.1016/j.jpain.2013.09.015 · Cited by 71
“80 being preferred.(8,48) Finally, the best-fitting model was visually inspected by plotting observed against modelpredicted values to determine whether the predicted trajectories followed the empiric trajectories for the classes, and to evaluate whether the predicted plots ‘‘made sense’’ theoretically and clinically.”
MethodLearning-Based Quality Control for Cardiac MR Images
Tarroni, G., Oktay, O., Bai, W., Schuh, A., Suzuki, H., Passerat‐Palmbach, J., de Marvao, A., O’Regan, D. P., Cook, S. A., Glocker, B., et al. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2878509 · Cited by 71
“Since only some slices show papillary muscles, both a twocomponent and a one-component models are used, and only one is selected based on the Akaike information criterion [26].”
Kaestle, C. E. (2019) · The Journal of Sex Research · doi:10.1080/00224499.2019.1577351 · Cited by 66
“…criteria statistics, it can be helpful to consider entropy, which gives an aggregate of posterior probabilities so that higher entropies indicate greater class separation and correct classification (Celeux & Soromenho, 1996; Ramaswamy, DeSarbo, Reibstein, & Robinson, 1993; Roesch et al., 2010).”
BackgroundIdentifying Mixtures of Mixtures Using Bayesian Estimation
Malsiner‐Walli, G., Frühwirth‐Schnatter, S., & Grün, B. (2016) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.2016.1200472 · Cited by 66
A systematic review of latent variable mixture modeling research in social work journals
Killian, M. O., Cimino, A. N., Weller, B. E., & Hyun Seo, C. (2019) · Journal of Evidence-Based Social Work · doi:10.1080/23761407.2019.1577783 · Cited by 65
Salas‐Wright, C. P., Vaughn, M. G., & Maynard, B. R. (2014) · Emerging Adulthood · doi:10.1177/2167696814539327 · Cited by 74
“Higher entropy values indicate greater accuracy of classification (Celeux & Soromenho, 1996).”
BackgroundClass, capital, and identity in Australian society
Sheppard, J., & Biddle, N. (2017) · Australian Journal of Political Science · doi:10.1080/10361146.2017.1364342 · Cited by 73
Trajectories of binge drinking and personality change across emerging adulthood.
Ashenhurst, J. R., Harden, K. P., Corbin, W. R., & Fromme, K. (2015) · Psychology of Addictive Behaviors · doi:10.1037/adb0000116 · Cited by 77
“Entropy values range between 0 – 1, with values approaching 1 indicating a high degree of certainty in classification of individuals as belonging to a given latent category of C (Celeux & Soromenho, 1996).”
Mixture of D-vine copulas for modeling dependence
Kim, D., Kim, J., Liao, S.-M., & Jung, Y. (2013) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2013.02.018 · Cited by 64
Chon, Y. V., & Shin, T. (2019) · Learning and Individual Differences · doi:10.1016/j.lindif.2019.01.007 · Cited by 75
Mäkikangas, A., & Schaufeli, W. B. (2021) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2021.103658 · Cited by 80
Patterns of polysubstance use and simultaneous co-use in high risk young adults
Bailey, A. J., Farmer, E. J., & Finn, P. (2019) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2019.107656 · Cited by 68
Li, K., Cardinal, B. J., & Acock, A. C. (2013) · The Journals of Gerontology Series B · doi:10.1093/geronb/gbt068 · Cited by 73
Metadata
- Authors
- Celeux, G., & Soromenho, G.
- Affiliations
- Institut national de recherche en sciences et technologies du numérique (FR)
- University of Lisbon (PT)
- ORCID
- Soromenho, Gilda
- Venue
- Journal of Classification
- Published
- 1996-09
- Volume
- 13
- Issue
- 2
- Pages
- 195-212
- ISSN
- 0176-4268 (ISSN-L)
- 1432-1343
- OpenAlex
- W2079817125
- Cited by
- 2,448
- References
- 37
- Citations by year
- 2026: 248 · 2025: 223 · 2024: 213 · 2023: 208 · 2022: 184 · 2021: 204 · 2020: 176 · 2019: 183 · 2018: 112 · 2017: 100 · 2016: 105 · 2015: 92 · 2014: 85 · 2013: 75 · 2012: 49
- FWCI
- 1.91
- Type
- journal article
- Language
- en
- Open access
- green
- inria.hal.science
- Licence
- other-oa
- www.springer.com/tdm (tdm)
- Locations
- Journal of Classification (publishedVersion)
- OpenGrey (Institut de l'Information Scientifique et Technique) (submittedVersion)
- HAL (submittedVersion, other-oa)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Methods and Mixture Models
- Physical Sciences › Computer Science › Artificial Intelligence › Advanced Clustering Algorithms Research
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Keywords
- entropy criterion, number of clusters, mixture models, model selection, likelihood ratios, optimal number of clusters
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.