An entropy criterion for assessing the number of clusters in a mixture model
Open accessThe DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Entropy above .80 also indicates a good-fitting model [40, 41].”
From Symptom experiences in post-treatment cancer survivors: associations with acceptance and commitment therapy constructs. (2021) · cites this paper as [40]
In the citing paper
“These values can vary between 0 and 1 with higher values representing greater accuracy of classification and values above 0.80 evidencing classification with minimal uncertainty.”
From Coping profiles and their association with psychological functioning: A latent profile analysis of coping strategies during the COVID-19 pandemic (2022) · cites this paper as Celeux & Soromenho, 1996
In the citing paper
“the entropy values of greater than .80 showed a 220 clear delineation of classes in the 'quadratic' GMM models with two or three classes 221 (Celeux and Soromenho, 1996).”
From Time in treatment: Examining mental illness trajectories across inpatient psychiatric treatment (2020) · cites this paper as Celeux and Soromenho, 1996
Citations
Cites
A new look at the statistical model identification
Akaike, H. (1974) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1974.1100705 · Cited by 51,879
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Estimating the Dimension of a Model
Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033
(1967) · Cited by 23,719
Pattern Recognition with Fuzzy Objective Function Algorithms
Bezdek, J. C. (1981) · doi:10.1007/978-1-4757-0450-1 · Cited by 9,881
Statistical Analysis of Finite Mixture Distributions.
Lindsay, B. G., Titterington, D. M., Smith, A. F. M., & Makov, U. E. (1987) · Journal of the American Statistical Association · doi:10.2307/2289504 · Cited by 2,905
Model-Based Gaussian and Non-Gaussian Clustering
Banfield, J. D., & Raftery, A. E. (1993) · Biometrics · doi:10.2307/2532201 · Cited by 2,395 · cited 2×
“…have considered the problem of choosing the number of clusters, in a partitioning setting, within the context of multivariate mixture models (see Bock 1985; Celeux 1986; Bozdogan 1993; Banfield and Raftery 1993; McLachlan and Basford 1988; Windham and Cutler 1992; Bryant 1993, among others).”
MethodMixture models : inference and applications to clustering
McLachlan, G. J., & Basford, K. E. (1988) · M. Dekker eBooks · Cited by 2,094
Statistical Analysis of Finite Mixture Distributions.
Newton, J., Titterington, D. M., Smith, A. F. M., & Makov, U. E. (1986) · Biometrics · doi:10.2307/2531224 · Cited by 1,986
Proceedings of the 6th Berkeley Symposium on Mathematical Statistics and Probability
Cam, L. M. L., Neyman, J., & Scott, E. L. (1972) · Medical Entomology and Zoology · Cited by 1,679
Research works printed but not linked: 1
- BRYANT, P. G., and WILLIAMSON, J. A. (1986), ?Maximum Likelihood and Classification: a Comparison of Three Approaches,? inClassification as a tool of research, Eds., W. Gaul and M. Schader, North-Holland, pp. 33?45.
Cited by
Items 501–600 of 1,010
Fitzpatrick, K., Gray, R., & QUIGLEY, M. A. (2016) · PLoS ONE · doi:10.1371/journal.pone.0153447 · Cited by 36
“The number of latent classes was decided by fitting models with different numbers of latent classes and then considering model interpretability and model fit, parsimony and stability using the Akaike information criterion (AIC)[25], Schwarz Bayesian information criterion (BIC)[26], Consistent AIC (CAIC) [27], sample-s…”
MethodLocal Optima in Mixture Modeling
Shireman, E. M., Steinley, D., & Brusco, M. J. (2016) · Multivariate Behavioral Research · doi:10.1080/00273171.2016.1160359 · Cited by 30
“…that the mixing proportions of clusters affect the accuracy of the mixture model (Andrews, Ansari, & Currim, 2002; Biernacki & Govaert, 1997, 1999; Celeux & Soromenho, 1996; Henson, Reise, & Kim, 2008; Nylund, Asparouhov, & Muthén, 2007; Swan-son, Lindenberg, Bauer, & Crosby, 2012; Woodward,…”
Kindergarten readiness profiles of rural, Appalachian children from low-income households
Justice, L. M., Jiang, H., Khan, K. S., & Dynia, J. M. (2017) · Journal of Applied Developmental Psychology · doi:10.1016/j.appdev.2017.02.004 · Cited by 36
Instructor and peer bullying in college students: Distinct typologies based on Latent Class Analysis
Marraccini, M. E., Brick, L. A. D., & Weyandt, L. L. (2018) · Journal of American College Health · doi:10.1080/07448481.2018.1454926 · Cited by 37
Kang, M., Lee, J., & Lee, A.-R. (2019) · Asia Pacific Education Review · doi:10.1007/s12564-019-09609-w · Cited by 37
“In addition to the above, entropy (Celeux and Soromenho 1996) or relative entropy (REN; Ramaswamy et al.”
BackgroundJeong, S., Blaney, J. M., & Feldon, D. F. (2019) · CBE—Life Sciences Education · doi:10.1187/cbe.19-05-0089 · Cited by 38
The Use of Latent Profiles to Explore the Multi-dimensionality of Self-compassion
Ullrich-French, S. C., & Cox, A. E. (2020) · Mindfulness · doi:10.1007/s12671-020-01365-y · Cited by 34
“…solution not only had substantive uniqueness, but resulted in entropy values that indicate highly discriminating latent classes (i.e., > 0.80; Celeux and Soromenho 1996; Muthén and Muthén 2007) and strong posterior probabilities for most likely class membership (i.e., > 0.80; Gudicha et al.…”
BackgroundInfluentialInquiry-Based Learning and Conceptual Change in Balance Beam Understanding
van der Graaf, J. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.01621 · Cited by 37
PrEP service delivery preferences of black Cis-gender women living in the Southern United States
Elopre, L. E., Boutwell, A., Gordon, B., Johnson, B., Marrazzo, J. M., Pol, B. J. V. D., & Mugavero, M. J. (2022) · AIDS and Behavior · doi:10.1007/s10461-022-03691-9 · Cited by 31
Merriman, J. D., Aouizerat, B. E., Langford, D. J., Cooper, B. A., Baggott, C., Cataldo, J. K., Dhruva, A., Dunn, L. B., West, C. M., Paul, S. M., et al. (2013) · Biological Research For Nursing · doi:10.1177/1099800413479441 · Cited by 33
When to treat prostate cancer patients based on their PSA dynamics
Lavieri, M. S., Puterman, M. L., Tyldesley, S. K., & Morris, W. (2012) · IIE Transactions on Healthcare Systems Engineering · doi:10.1080/19488300.2012.666631 · Cited by 30
“Other possible criteria to be considered when assessing the number of clusters are described by Celeux and Soromenho ( 1996 ).”
BackgroundLewson, A. B., Johns, S. A., Krueger, E., Chinh, K., Kidwell, K. M., & Mosher, C. E. (2021) · Supportive Care in Cancer · doi:10.1007/s00520-020-05854-7 · Cited by 27
Chrysoulakis, A., Ivert, A., & Levander, M. T. (2022) · European Journal of Criminology · doi:10.1177/14773708221097657 · Cited by 30
“Entropy values approaching one (1) indicate clearly separated clusters (Celeux and Soromenho, 1996).”
BackgroundNurses' second victim experience, job insecurity, and turnover intention: A latent profile analysis
Shao, Y., Li, S., Wei, L. S., Shan, X., Zhou, D., Zhang, Y., & Wei, H. (2023) · Research in Nursing & Health · doi:10.1002/nur.22313 · Cited by 34
Patterns of Physical Activity Among Older Adults in New York City
Mooney, S. J., Joshi, S., Cerdá, M., Quinn, J. W., Beard, J., Kennedy, G. J., Benjamin, E. O., Ompad, D. C., & Rundle, A. (2015) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2015.02.015 · Cited by 40
Patterns of drinking-related protective and risk behaviors in college student drinkers
Ray, A. E., Stapleton, J. L., Turrisi, R., & Philion, E. (2011) · Addictive Behaviors · doi:10.1016/j.addbeh.2011.12.005 · Cited by 28
McMain, S., Fitzpatrick, S., Boritz, T. Z., Barnhart, R., Links, P. S., & Streiner, D. L. (2017) · Journal of Personality Disorders · doi:10.1521/pedi_2017_31_309 · Cited by 34
Re‐Examining the SNAP Benefit Cycle Allowing for Heterogeneity
Dorfman, J. H., Gregory, C., Liu, Z., & Huo, R. (2018) · Applied Economic Perspectives and Policy · doi:10.1093/aepp/ppy013 · Cited by 31
A Latent Profile Analysis of Bisexual Identity: Evidence of Within-Group Diversity
Choi, A. Y., Nylund-Gibson, K. K., Israel, T., & Mendez, S. E. A. (2018) · Archives of Sexual Behavior · doi:10.1007/s10508-018-1325-1 · Cited by 33
Liu, Y., Elliott, A. L., Serdarevic, M., Leeman, R. F., & Cottler, L. B. (2019) · Addictive Behaviors Reports · doi:10.1016/j.abrep.2019.100170 · Cited by 31
Exploratory behavior and developmental skill acquisition in infants with Down syndrome
Fidler, D. J., Schworer, E. K., Prince, M. A., Will, E., Needham, A. W., & Daunhauer, L. A. (2019) · Infant Behavior and Development · doi:10.1016/j.infbeh.2019.02.002 · Cited by 33
Predicting Patterns of Treatment Response and Outcome for Adolescents Who Are Suicidal and Depressed
Abbott, C. H., Zisk, A., Bounoua, N., Diamond, G. S., & Kobak, R. (2019) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2018.12.013 · Cited by 34
Investigating child self-report capacity: a systematic review and utility analysis
Bevans, K. B., Ahuvia, I. L., Hallock, T. M., Mendonca, R. J., Roth, S. C., Forrest, C. B., Blackwell, C. K., Kramer, J. M., & Wakschlag, L. S. (2020) · Quality of Life Research · doi:10.1007/s11136-019-02387-3 · Cited by 37
Mother and father repertoires of emotion socialization practices in middle childhood
Sosa‐Hernandez, L., Sack, L., Seddon, J. A., Bailey, K., & Thomassin, K. (2020) · Journal of Applied Developmental Psychology · doi:10.1016/j.appdev.2020.101159 · Cited by 37
Female sex and femininity independently associate with common somatic symptom trajectories
Ballering, A., Wardenaar, K. J., Hartman, T. O., & Rosmalen, J. G. M. (2020) · Psychological Medicine · doi:10.1017/s0033291720004043 · Cited by 30
“…entropy of the model with the lowest BIC was assessed, as high entropy (>0.80) indicates strong distinctive capabilities between trajectory classes (Celeux & Soromenho, 1996); (iii) class sizes, as class sizes should not comprise less than 1% of the sample (Infurna & Grimm, 2017); and (iv)…”
BackgroundInfluentialPatterns of multimorbidity trajectories and their correlates among Korean older adults
Lee, S. A., Joo, S., Chai, H. W., & Jun, H. J. (2021) · Age and Ageing · doi:10.1093/ageing/afab002 · Cited by 29
Hyland, P., Vallières, F., Daly, M., Butter, S., Bentall, R. P., Fox, R. J., Karatzias, T., MacLachlan, M., McBride, O., Murphy, J., et al. (2021) · Journal of Affective Disorders · doi:10.1016/j.jad.2021.08.145 · Cited by 31
Williams, G. C., Patte, K. A., Ferro, M. A., & Leatherdale, S. T. (2021) · Health Promotion and Chronic Disease Prevention in Canada · doi:10.24095/hpcdp.41.5.02 · Cited by 30
What is your shopping travel style? Heterogeneity in US households’ online shopping and travel
Shah, H., Carrel, A. L., & Le, H. (2021) · Transportation Research Part A Policy and Practice · doi:10.1016/j.tra.2021.08.013 · Cited by 35
A latent profile analysis of perceiving and living a calling
Duffy, R. D., Spurk, D., Perez, G., Kim, H. J., & Rosa, A. D. (2022) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2022.103694 · Cited by 34
Family Thriving During COVID-19 and the Benefits for Children’s Well-Being
Partington, L. C., Mashash, M., & Hastings, P. D. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.879195 · Cited by 38
Mallett, K. A., Turrisi, R., Ray, A. E., Stapleton, J. L., Abar, C. C., Mastroleo, N. R., Tollison, S. J., Grossbard, J. R., & Larimer, M. E. (2011) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.2011.00860.x · Cited by 33
“The entropy value of the four-class model was .83, which suggests that the latent profiles were well separated and that the parenting indicator variables were good predictors of parent profile membership (Celeux & Soromenho, 1996).”
BackgroundBray, B. C., Foti, R. J., Thompson, N. J., & Wills, S. F. (2014) · Human Performance · doi:10.1080/08959285.2014.956176 · Cited by 29
“…criterion (AIC; Akaike, 1974), Bayesian information criterion (BIC; Schwartz, 1978), sample size adjusted BIC (a-BIC; Sclove, 1987), entropy (Celeux & Soromenho, 1996), and a bootstrapped likelihood ratio test (McLachlan, 1987; McLachlan & Peel, 2000), as well as model stability and…”
MethodCunningham, C. E., Rimas, H. L., Chen, Y., Deal, K., McGrath, P. J., Lingley‐Pottie, P., Reid, G. J., Lipman, E. L., & Corkum, P. V. (2014) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2014.888666 · Cited by 33
“To avoid the overfitting associated with Akaike Information Criteria values (Celeux & Soromenho, 1996) we chose a four-class solution minimizing Bayesian Information Criterion values (Nylund et al., 2007).”
MethodHandgun Carrying Among Youth in the United States
Vaughn, M. G., Salas‐Wright, C. P., Boutwell, B. B., DeLisi, M., & Curtis, M. P. (2016) · Youth Violence and Juvenile Justice · doi:10.1177/1541204016629721 · Cited by 29
“Lower BIC, AIC, and CAIC values and higher log likelihood values reflect better model fit (Celeux & Soromenho, 1996).”
Cosco, T. D., Stephan, B. C. M., Brayne, C., Terrera, G. M., & CFAS, M. (2017) · Canadian Journal on Aging / La Revue canadienne du vieillissement · doi:10.1017/s0714980817000344 · Cited by 30
“Classification is assessed via evaluation of the entropy, an index that takes values between 0 and 1 with high values indicating a clear classification of individuals in classes (Celeux & Soromenho, 1996).”
Al‐Shehri, H., Koukounari, A., Stanton, M. C., Adriko, M., Arinaitwe, M., Atuhaire, A., Kabatereine, N. B., & Stothard, J. R. (2018) · Parasitology · doi:10.1017/s003118201800029x · Cited by 34
“The classification certainty of this model was evaluated through entropy; values of entropy near one indicate high certainty in classification while values near zero indicate low certainty (Celeux and Soromenho, 1996).”
Methodvon Davier, M., & Molenaar, I. W. (2003) · Psychometrika · doi:10.1007/bf02294798 · Cited by 29
“Normal mixture models in cluster analysis also use information criteria as well as other criteria based on the classification likelihood ( Celeux & Soromenho, 1996; Biernacki, Celeux & Govaert, 2000) and resampling methods (McLachlan & Peel, 1997).”
MethodKinnunen, S. M., Puolakanaho, A., Tolvanen, A., Mäkikangas, A., & Lappalainen, R. (2019) · International Journal of Stress Management · doi:10.1037/str0000095 · Cited by 28
Hinni, C. (2022) · transcript Verlag eBooks · doi:10.1515/9783839460580 · Cited by 28
A nonparametric Bayesian approach toward robot learning by demonstration
Chatzis, S., Korkinof, D., & Demiris, Y. (2012) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2012.02.005 · Cited by 28
“Keywords: Gaussian mixture regression, robot learning by demonstration, Dirichlet process, variational Bayes, nonparametric statistics.”
MethodSleep schedules and school performance in Indigenous Australian children
Blunden, S. L., Magee, C., Attard, K., Clarkson, L., Caputi, P., & Skinner, T. C. (2018) · Sleep Health · doi:10.1016/j.sleh.2017.12.006 · Cited by 34
“80 or higher).(32) The distinctiveness, meaning, and interpretability of the latent classes were considered to ensure a parsimonious and meaningful solution.”
BackgroundAn Information-Theoretic Approach for Multivariate Skew-t Distributions and Applications
Abid, S. H., Quaez, U. J., & Contreras‐Reyes, J. E. (2021) · Mathematics · doi:10.3390/math9020146 · Cited by 28
“These models provide important applications in many scientific fields such as density estimation [2], data mining and pattern recognition [3], image processing and satellite imaging [4], medicine and genetics [4,5], fisheries [6,7], astronomy [2], and more.”
BackgroundWang, P., Chen, Y., Chang, Y., Wu, C.-F., Lu, W.-H., & Yen, C. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18042091 · Cited by 27
“A value of entropy approaching 1 indicates the clear separation of classes [38], and entropy values >0.”
BackgroundMekawi, Y., Kuzyk, E., Dixon, H. D., McKenna, B. G., Camacho, L., de Andino, A. M., Stevens, J. S., Michopolous, V., & Powers, A. D. (2021) · Clinical Psychological Science · doi:10.1177/21677026211000723 · Cited by 30
“Entropy values range from 0 to 1; higher values (particularly > .8) indicate higher classification certainty (Celeux & Soromenho, 1996).”
BackgroundHeterogeneity in outdoor comfort assessment in urban public spaces
Peng, Y., Feng, T., & Timmermans, H. J. P. (2021) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2021.147941 · Cited by 35
Determinants of Black families’ access to a community‐based STEM program: A latent class analysis
King, N. S., Collier, Z. K., Johnson, B. G., Acosta, M. M., & Southwell, C. N. (2021) · Science Education · doi:10.1002/sce.21669 · Cited by 35
The ambivalence about accepting the prevalence somatic symptoms in PTSD: Is PTSD a somatic disorder?
McFARLANE, A. C., & Graham, K. (2021) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2021.09.030 · Cited by 32
Patterns of Father Involvement and Child Development among Families with Low Income
Yoon, S., Kim, M., Yang, J., Lee, J. Y., Latelle, A., Wang, J., Zhang, Y., & Schoppe‐Sullivan, S. J. (2021) · Children · doi:10.3390/children8121164 · Cited by 48
“The entropy value ranges between 0 and 1, with a value closer to 1 indicating a smaller model classification error [52].”
BackgroundOei, A. C., Li, D., Chu, C. M., Ng, I. Y. H., Hoo, E., & Ruby, K. (2023) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2023.106191 · Cited by 42
A comparison study of image segmentation by clustering techniques
Kettaf, F.-Z., Bi, D., & de Beauville, J. P. A. (2002) · International Conference on Signal Processing · doi:10.1109/icsigp.1996.566528 · Cited by 28
Using Mixture Regression to Identify Varying Effects: A Demonstration With Paternal Incarceration
Dyer, W. J., Pleck, J. H., & McBride, B. A. (2012) · Journal of Marriage and the Family · doi:10.1111/j.1741-3737.2012.01012.x · Cited by 32
Mixture model based multivariate statistical analysis of multiply censored environmental data
He, J. (2013) · Advances in Water Resources · doi:10.1016/j.advwatres.2013.05.001 · Cited by 28
Abar, C. C., Turrisi, R., & Mallett, K. A. (2013) · Psychology of Addictive Behaviors · doi:10.1037/a0032731 · Cited by 38
“Entropy values approaching 1.0 indicate little profile overlap (Celeux & Soromenho, 1996).”
BackgroundInfluentialSasser, T. R., Beekman, C. R., & Bierman, K. L. (2014) · Development and Psychopathology · doi:10.1017/s0954579414000947 · Cited by 39
“Model entropy values approaching 1 indicate greater confidence in children’s assignment to the appropriate profile (Celeux & Soromenho, 1996).”
BackgroundInvestigating profiles of lexical quality in preschool and their contribution to first grade reading
Murphy, K. A., & Farquharson, K. (2016) · Reading and Writing · doi:10.1007/s11145-016-9651-y · Cited by 39
Ağırdağ, O. (2014) · Multilingual Matters eBooks · doi:10.21832/9781783092437-008 · Cited by 28
Links Between Contexts and Middle to Late Childhood Social‐Emotional Development
Duong, J., & Bradshaw, C. P. (2017) · American Journal of Community Psychology · doi:10.1002/ajcp.12201 · Cited by 56
“We also favored models with higher entropy scores, which demonstrated classification accuracy (Celeux & Soromenho, 1996).”
ResultAllami, Y., Vitaro, F., Brendgen, M. R., Carbonneau, R., & Tremblay, R. E. (2018) · Psychology of Addictive Behaviors · doi:10.1037/adb0000356 · Cited by 36
“Following Celeux and Soromenho (1996) and Nylund, Asparouhov, and Muthén (2007), the Bayesian information criterion (BIC), entropy, and the Lo Mendell Rubin adjusted likelihood ratio test (LMR-ALRT) were used to evaluate model fit.”
MethodChildhood Maltreatment and Narcissism: The Mediating Role of Dissociation
Bertele, N., Talmon, A., & Gross, J. J. (2022) · Journal of Interpersonal Violence · doi:10.1177/0886260520984404 · Cited by 27
“Entropy ranges from 0 to 1 with values close to 1 suggesting a clear delineation of classes (Celeux & Soromenho, 1996).”
BackgroundChau, A. K. C., So, S. H., Sun, X., Zhu, C., Chiu, C., Chan, R. C. K., & Leung, P. W. L. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.931558 · Cited by 31
“A better-fitted model is indicated by a smaller value on all these criteria except for entropy, where a greater value would suggest a clear profile separation (59).”
MethodInflammatory subphenotypes in patients at risk of ARDS: evidence from the LIPS-A trial
Redaelli, S., von Wedel, D., Fosset, M., Suleiman, A., Chen, G., Alingrin, J., Gong, M. N., Gajic, O., Banner‐Goodspeed, V., Talmor, D. S., et al. (2023) · Intensive Care Medicine · doi:10.1007/s00134-023-07244-z · Cited by 29
“We further assessed class separation through entropy [16, 25].”
MethodMa, F., Zhu, Y., Liu, L., Chen, H., Liu, Y., & Zhang, F. (2025) · Journal of Nursing Management · doi:10.1155/jonm/3793927 · Cited by 42
“Entropy values closer to one suggest more precise classifcation, with values of 0.80 or higher signifying a classifcation accuracy of 90% or more [31].”
InfluentialNoel, H., Denny, S., Farrant, B., Rossen, F. V., Teevale, T., Clark, T. C., Fleming, T. M., Bullen, P., Sheridan, J. L., & Fortune, S. A. (2013) · Journal of Paediatrics and Child Health · doi:10.1111/jpc.12397 · Cited by 32
Dussault, F., Brendgen, M. R., Vitaro, F., Carbonneau, R., Boivin, M., & Tremblay, R. E. (2015) · Journal of Gambling Studies · doi:10.1007/s10899-015-9546-x · Cited by 29
Depaoli, S. A., Winter, S. D., Lai, K., & Guerra-Peña, K. (2019) · Multivariate Behavioral Research · doi:10.1080/00273171.2019.1593813 · Cited by 28
“…Desarbo, Reibstein, and Robinson (1993) proposed a rescaling of E(K) known as entropy, which can be seen as: Entropy Kð Þ ¼ 1 E Kð Þ n log kð Þ : (19) Entropy ranges from 0: corresponding to randomness to 1: corresponding to perfect classification (Celeux & Soromenho, 1996; Ramaswamy et al., 1993).”
BackgroundMethodPadilla‐Walker, L. M., Rogers, A. A., & McLean, R. D. (2020) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2020.04.031 · Cited by 28
“Lower values indicate better fit when using BIC and SABIC, and entropy with values approaching 1 indicates clearer delineation of classes [23].”
Methoddos Santos, C. S., Picoito, J., Nunes, C., & Loureiro, I. (2020) · Frontiers in Pediatrics · doi:10.3389/fped.2020.00417 · Cited by 29
“8 are considered good, there is no consensual definition of what constitutes low entropy (30).”
BackgroundMoreira, P., Inman, R. A., & Cloninger, C. R. (2020) · Child Psychiatry & Human Development · doi:10.1007/s10578-020-01063-9 · Cited by 30
“Model fit was compared using the Akaike Information Criterion [49], Bayesian Information Criterion [50] (BIC; Schwarz, 1978), samplesize adjusted BIC [51], and entropy [52].”
MethodPatterns of situational engagement and task values in science lessons
Upadyaya, K., Cumsille, P. E., Ávalos, B., Araneda, S., Lavonen, J., & Salmela‐Aro, K. (2021) · The Journal of Educational Research · doi:10.1080/00220671.2021.1955651 · Cited by 35
General digital competences of beginning trainees in commercial vocational education and training
Findeisen, S., & Wild, S. (2022) · Empirical research in vocational education and training · doi:10.1186/s40461-022-00130-w · Cited by 65
“In addition, we checked for the entropy values closest to 1 (Asparouhov and Muthen 2018; Celeux and Soromenho 1996), and also used the diagonal of the average latent class probabilities for most likely class membership as a selection criterion.”
MethodLuo, Y., Wang, A., Zeng, Y., & Zhang, J. (2022) · Supportive Care in Cancer · doi:10.1007/s00520-022-06860-7 · Cited by 30
“8 was used to indicate a good separation of the latent classes [35].”
MethodNonconvergence, covariance constraints, and class enumeration in growth mixture models.
McNeish, D., Harring, J. R., & Bauer, D. J. (2023) · Psychological Methods · doi:10.1037/met0000456 · Cited by 27
Commuters’ preferences for fast and reliable travel: A semi-parametric estimation approach
Koster, P. R., & Koster, H. R. A. (2015) · Transportation Research Part B Methodological · doi:10.1016/j.trb.2015.05.011 · Cited by 24
Dyer, N., Owen, M. T., & Caughy, M. O. (2014) · Parenting · doi:10.1080/15295192.2014.972756 · Cited by 33
“…with one to five classes were estimated, and model fit was evaluated using the Bayesian Information Criterion (BIC), the Lo, Mendel, Rubin (LMR) statistic (Celeux & Soromenho, 1996; Clogg, 1995; Hagenaars & Halman, 1989; Nylund, 2007), and the bootstrapped likelihood ratio test (LRT; Nylund, 2007).”
MethodProcess Monitoring Using Bayesian Classification on PCA Subspace
Liu, J. (2004) · Industrial & Engineering Chemistry Research · doi:10.1021/ie0498495 · Cited by 27
Extracting Spurious Latent Classes in Growth Mixture Modeling With Nonnormal Errors
Guerra-Peña, K., & Steinley, D. (2016) · Educational and Psychological Measurement · doi:10.1177/0013164416633735 · Cited by 27
“However, other simulation research have found that BIC estimates fewer groups than the ‘‘true’’ model when, despite a valid component density, the sample size is not large (Celeux & Soromenho, 1996).”
BackgroundMethodHallquist, M. N., & Lenzenweger, M. F. (2013) · Journal of Abnormal Psychology · doi:10.1037/a0030060 · Cited by 26
“A three-class GMM best characterized total PD symptom change in the NoPD group according to the AICc, BIC, and BLRT (see Table 2), and there was a high degree of certainty about latent class membership, entropy .87 (Celeux & Soromenho, 1996).”
Kim, S., Lee, J., & Boone, D. (2022) · Journal of Pain Research · doi:10.2147/jpr.s340382 · Cited by 26
“80 indicated a good separation of the classes in each model.(63) The results”
BackgroundZammit, A. R., Hall, C. B., Lipton, R. B., Katz, M. J., & Terrera, G. M. (2018) · Journal of the International Neuropsychological Society · doi:10.1017/s135561771700128x · Cited by 26
“To assess fit between models with k versus k + 1 classes, we used the Bayesian information criterion (BIC) (Raftery, 1995); we also used entropy (Celeux & Soromenho, 1996) to identify the solution that seemed to have the best precision in distinguishing amongst classes.”
MethodA Capabilities Approach to Unequal Trajectories of Healthy Aging: The Importance of the Environment
Stephens, C. V., Szabó, Á., Allen, J., & Alpass, F. (2018) · Journal of Aging and Health · doi:10.1177/0898264318779474 · Cited by 29
Clark, D. V., Banura, P., Bandeen‐Roche, K., Liles, W. C., Kain, K. C., Scheld, W. M., Moss, W. J., & Jacob, S. T. (2019) · JCI Insight · doi:10.1172/jci.insight.127623 · Cited by 29
“Several criteria were used to determine the best fitting model, including the Bayesian Information Criterion (BIC) (39, 40), the log likelihood, the Lo-Mendell-Rubin test, (41) entropy (42), and clinical interpretability (43).”
MethodColledani, D., Anselmi, P., & Robusto, E. (2019) · Personality and Individual Differences · doi:10.1016/j.paid.2019.05.044 · Cited by 28
Constellations of family risk for long-term adolescent antisocial behavior.
LoBraico, E. J., Bray, B. C., Feinberg, M. E., & Fosco, G. M. (2020) · Journal of Family Psychology · doi:10.1037/fam0000640 · Cited by 36
“…criterion (AIC; Akaike, 1974), Bayesian information criterion(BIC; Schwarz, 1978), sample-size adjusted BIC (a-BIC; Sclove, 1987), entropy (Celeux & Soromenho, 1996), and a bootstrapped likelihood ratio test (McLachlan, 1987; McLachlan & Peel, 2005), as well as model stability and…”
MethodBrown, S. M., RHOADES, G. K., Marti, C. N., & Lewis, T. (2021) · Child Maltreatment · doi:10.1177/1077559520985934 · Cited by 37
“To determine the best fitted model, several fit indices were examined: (1) entropy values approaching 1 and larger than .80 (Celeux & Soromenho, 1996); (2) average class probabilities larger than .80 (Geiser, 2012); (3) smaller Akaike information criterion (AIC) values for the k”
MethodProfiles and Predictors of Children’s Growth in Alphabet Knowledge
Piasta, S. B., Logan, J. A. R., Farley, K. S., Strang, T. M., & Justice, L. M. (2021) · Journal of Education for Students Placed at Risk (JESPAR) · doi:10.1080/10824669.2021.1871617 · Cited by 35
Swain, S., Coupland, C. A. C., Strauss, V. Y., Mallen, C. D., Kuo, C. F., Sarmanova, A., Bierma-Zeinstra, S., Englund, M., Prieto‐Alhambra, D., Doherty, M., et al. (2022) · Osteoarthritis and Cartilage · doi:10.1016/j.joca.2021.12.013 · Cited by 29
Räikkönen, E., Kokko, K., Chen, M., & Pulkkinen, L. (2012) · Longitudinal and Life Course Studies · doi:10.14301/llcs.v3i2.180 · Cited by 32
“In addition, entropy (Celeux and Soromenho 1996) and interpretability of”
BackgroundDistinct symptom experiences in subgroups of patients with COPD
Holm, A. M., Christensen, V. L., Rustøen, T., Cooper, B., Miaskowski, C. A., Henriksen, A. H., & Bentsen, S. B. (2016) · International Journal of COPD · doi:10.2147/copd.s105299 · Cited by 27
“80.(39) As is common for this type of analysis, the log-likelihood and Akaike Information Criterion are reported for the interested reader.”
BackgroundEidhof, M. B., Djelantik, A. A. A. M. J., Klaassens, E. R., Kantor, V., Rittmannsberger, D., Sleijpen, M., Steenbakkers, A., Weindl, D., & ter Heide, F. J. J. (2019) · Journal of Traumatic Stress · doi:10.1002/jts.22363 · Cited by 34
Han, Y., Donnelly, H. K., Ma, J., Song, J., & Hong, H. (2019) · Journal of Community Psychology · doi:10.1002/jcop.22226 · Cited by 31
Modarresi, S., Suh, N., Walton, D. M., & MacDermid, J. C. (2019) · Musculoskeletal Science and Practice · doi:10.1016/j.msksp.2019.07.012 · Cited by 30
Ho, R., Fong, T. C. T., & Cheung, I. K. M. (2014) · Quality of Life Research · doi:10.1007/s11136-014-0731-7 · Cited by 28
“Average posterior class probabilities and entropy of the models were reported [31].”
BackgroundBurnout profiles among esports players: Associations with mental toughness and resilience
Poulus, D., Sargeant, J. A., Zarate, D., Griffiths, M. D., & Stavropoulos, V. (2024) · Journal of Sports Sciences · doi:10.1080/02640414.2024.2405794 · Cited by 25
“Table 2 shows four potential combinations of parameterisa-tions of variance-covariance structures that can be estimated with TidyLPA to obtain the optimal number of profiles (Celeux & Soromenho, 1996).”
InfluentialShin, J., Kang, H., Choi, S., Chu, S. H., & Choi, J. (2025) · Journal of Medical Internet Research · doi:10.2196/57122 · Cited by 31
“To assess the quality of model classification, we analyzed the entropy value, targeting a criterion of ≥ 0.8 [43].”
InfluentialSimultaneous Dimensionality and Complexity Model Selection for Spectral Graph Clustering
Yang, C., Priebe, C. E., Park, Y., & Marchette, D. J. (2020) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.2020.1824870 · Cited by 25
“To list a few: Akaike information criterion (AIC) (Akaike 1998), Bayesian information criterion (BIC) (Schwarz 1978), an entropy criterion (NEC) (Celeux and Soromenho 1996), integrated completed likelihood (ICL) (Biernacki, Celeux, and Govaert 2000), and cross-validated likelihood (Smyth 2000).”
BackgroundPiper, K. N., Haardörfer, R., Escoffery, C., Sheth, A. N., & Sales, J. M. (2021) · Implementation Science Communications · doi:10.1186/s43058-021-00148-3 · Cited by 25
“80 indicate a high level of separation between the groups (39)), signi cant p-values for the bootstrap likelihood ratio test (BLRT) (which tests if the model performs signi cantly better than the K− 1 group solution), and comparatively low AIC and BIC values.”
MethodHeterogeneity of borderline personality disorder symptoms in help-seeking adolescents
Cavelti, M., Lerch, S., Ghinea, D., Fischer-Waldschmidt, G., Resch, F., Koenig, J., & Kaess, M. (2021) · Borderline Personality Disorder and Emotion Dysregulation · doi:10.1186/s40479-021-00147-9 · Cited by 35
Intersectional identity approach to chronic pain disparities using latent class analysis
Newman, A. K., & Thorn, B. E. (2021) · Pain · doi:10.1097/j.pain.0000000000002407 · Cited by 27
Dumas, D., Dong, Y., & Leveling, M. (2021) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2021.102013 · Cited by 32
Metadata
- Authors
- Celeux, G., & Soromenho, G.
- Affiliations
- Institut national de recherche en sciences et technologies du numérique (FR)
- University of Lisbon (PT)
- ORCID
- Soromenho, Gilda
- Venue
- Journal of Classification
- Published
- 1996-09
- Volume
- 13
- Issue
- 2
- Pages
- 195-212
- ISSN
- 0176-4268 (ISSN-L)
- 1432-1343
- OpenAlex
- W2079817125
- Cited by
- 2,448
- References
- 37
- Citations by year
- 2026: 248 · 2025: 223 · 2024: 213 · 2023: 208 · 2022: 184 · 2021: 204 · 2020: 176 · 2019: 183 · 2018: 112 · 2017: 100 · 2016: 105 · 2015: 92 · 2014: 85 · 2013: 75 · 2012: 49
- FWCI
- 1.91
- Type
- journal article
- Language
- en
- Open access
- green
- inria.hal.science
- Licence
- other-oa
- www.springer.com/tdm (tdm)
- Locations
- Journal of Classification (publishedVersion)
- OpenGrey (Institut de l'Information Scientifique et Technique) (submittedVersion)
- HAL (submittedVersion, other-oa)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Methods and Mixture Models
- Physical Sciences › Computer Science › Artificial Intelligence › Advanced Clustering Algorithms Research
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Keywords
- entropy criterion, number of clusters, mixture models, model selection, likelihood ratios, optimal number of clusters
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.