Asymptotic Behaviour of the Posterior Distribution in Overfitted Mixture Models
Open accessThe DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
Summary: We study the asymptotic behaviour of the posterior distribution in a mixture model when the number of components in the mixture is larger than the true number of components: a situation which is commonly referred to as an overfitted mixture. We prove in particular that quite generally the posterior distribution has a stable and interesting behaviour, since it tends to empty the extra components. This stability is achieved under some restriction on the prior, which can be used as a guideline for choosing the prior. Some simulations are presented to illustrate this behaviour.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Estimating the Dimension of a Model
Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033
Information Theory and an Extension of the Maximum Likelihood Principle
Akaike, H. (1998) · Springer Series in Statistics · doi:10.1007/978-1-4612-1694-0_15 · Cited by 17,781
McLachlan, G., & Peel, D. (2000) · Wiley Series in Probability and Statistics · doi:10.1002/0471721182 · Cited by 10,991
Statistical Analysis of Finite Mixture Distributions.
Lindsay, B. G., Titterington, D. M., Smith, A. F. M., & Makov, U. E. (1987) · Journal of the American Statistical Association · doi:10.2307/2289504 · Cited by 2,905
Statistical Analysis of Finite Mixture Distributions.
Newton, J., Titterington, D. M., Smith, A. F. M., & Makov, U. E. (1986) · Biometrics · doi:10.2307/2531224 · Cited by 1,986
On Bayesian Analysis of Mixtures with an Unknown Number of Components (with discussion)
Richardson, S., & Green, P. J. (1997) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00095 · Cited by 1,898
Finite Mixture and Markov Switching Models
(2006) · Springer Series in Statistics · doi:10.1007/978-0-387-35768-3 · Cited by 1,554
Asymptotics for likelihood ratio tests under loss of identifiability
Liu, X., & Shao, Y. (2003) · The Annals of Statistics · doi:10.1214/aos/1056562463 · Cited by 191
Dacunha-Castelle, D., & Gassiat, E. (1999) · The Annals of Statistics · doi:10.1214/aos/1017938921 · Cited by 187
Using Bootstrap Likelihood Ratios in Finite Mixture Models
Feng, Z. D., & McCulloch, C. E. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02104.x · Cited by 180
Variational approximations in Bayesian model selection for finite mixture distributions
McGrory, C. A., & Titterington, D. M. (2007) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2006.07.020 · Cited by 169
Computational methods for Bayesian model choice
Robert, C. P., Wraith, D., Goggans, P. M., & Chan, C.-Y. (2009) · AIP conference proceedings · doi:10.1063/1.3275622 · Cited by 83
Lasserre, J., Bishop, C., Bernardo, J. M., Bayarri, M. J., Berger, J. O., Dawid, A. P., Heckerman, D. E., Smith, A. F. M., & West, M. L. (2007) · Oxford University Press eBooks · Cited by 43
Azäis, J., Gassiat, É., & Mercadier, C. (2006) · Bernoulli · doi:10.3150/bj/1161614946 · Cited by 31
Cited by
Predicting Upper Limb Motor Impairment Recovery after Stroke: A Mixture Model
van der Vliet, R., Selles, R. W., Andrinopoulou, E., Nijland, R., Ribbers, G. M., Frens, M. A., Meskers, C., & Kwakkel, G. (2020) · Annals of Neurology · doi:10.1002/ana.25679 · Cited by 229
Model-based clustering based on sparse finite Gaussian mixtures
Malsiner-Walli, G., Frühwirth-Schnatter, S., & Grün, B. (2016) · Statistics and Computing · doi:10.1007/s11222-014-9500-2 · Cited by 173
“the draws in a post-processing procedure, a range of different methods has been proposed in the literature, see Sperrin et al. (2010) and Jasra et al.”
BackgroundMethodInfluential
Metadata
- Authors
- Rousseau, J., & Mengersen, K.
- Venue
- Journal of the Royal Statistical Society Series B: Statistical Methodology
- Publisher
- Oxford University Press (OUP)
- Published
- 2011-08-09
- Volume
- 73
- Issue
- 5
- Pages
- 689-710
- ISSN
- 1369-7412 (ISSN-L)
- 1467-9868
- OpenAlex
- W1732489270
- Cited by
- 292
- References
- 15
- FWCI
- 8.87
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.