The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Markov Chain Monte Carlo Methods and the Label Switching Problem in Bayesian Mixture Modeling
Open accessAbstract
In the past ten years there has been a dramatic increase of interest in the Bayesian analysis of finite mixture models. This is primarily because of the emergence of Markov chain Monte Carlo (MCMC) methods. While MCMC provides a convenient way to draw inference from complicated statistical models, there are many, perhaps underappreciated, problems associated with the MCMC analysis of mixtures. The problems are mainly caused by the nonidentifiability of the components under symmetric priors, which leads to so-called label switching in the MCMC output. This means that ergodic averages of component specific quantities will be identical and thus useless for inference. We review the solutions to the label switching problem, such as artificial identifiability constraints, relabelling algorithms and label invariant loss functions. We also review various MCMC sampling schemes that have been suggested for mixture models and discuss posterior sensitivity to prior specification.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Monte Carlo sampling methods using Markov chains and their applications.
Hastings, W. K. (1970) · Biometrika · doi:10.1093/biomet/57.1.97 · Cited by 15,195
McLachlan, G., & Peel, D. (2000) · Wiley Series in Probability and Statistics · doi:10.1002/0471721182 · Cited by 10,991
Reversible jump Markov chain Monte Carlo computation and Bayesian model determination
GREEN, P. J. (1995) · Biometrika · doi:10.1093/biomet/82.4.711 · Cited by 5,930
Baum, L. E., Petrie, T., Soules, G., & Weiss, N. (1970) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177697196 · Cited by 4,297
Monte Carlo Statistical Methods
Robert, C. P., & Casella, G. (2004) · Springer Texts in Statistics · doi:10.1007/978-1-4757-4145-2 · Cited by 4,271
Markov Chains for Exploring Posterior Distributions
Tierney, L. (1994) · The Annals of Statistics · doi:10.1214/aos/1176325750 · Cited by 3,452
Statistical Analysis of Finite Mixture Distributions.
Lindsay, B. G., Titterington, D. M., Smith, A. F. M., & Makov, U. E. (1987) · Journal of the American Statistical Association · doi:10.2307/2289504 · Cited by 2,905
Statistical Inference for Probabilistic Functions of Finite State Markov Chains
Baum, L. E., & Petrie, T. (1966) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177699147 · Cited by 2,775
Monte Carlo Strategies in Scientific Computing
Liu, J. S. (2004) · Springer Series in Statistics · doi:10.1007/978-0-387-76371-2 · Cited by 2,690
Bayesian Density Estimation and Inference Using Mixtures
Escobar, M. D., & West, M. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476550 · Cited by 2,255
On Bayesian Analysis of Mixtures with an Unknown Number of Components (with discussion)
Richardson, S., & Green, P. J. (1997) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00095 · Cited by 1,898
III. Contributions to the mathematical theory of evolution
Pearson, K. (1894) · Philosophical Transactions of the Royal Society of London. (A.) · doi:10.1098/rsta.1894.0003 · Cited by 1,550
Dealing With Label Switching in Mixture Models
Stephens, M. (2000) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00265 · Cited by 1,069
LINDLEY, D. V. (1957) · Biometrika · doi:10.1093/biomet/44.1-2.187 · Cited by 977
On Bayesian Analysis of Mixtures with an Unknown Number of Components
Richardson, S. T., & Green, P. J. (1997) · Cited by 919
Estimation of Finite Mixture Distributions Through Bayesian Sampling
Diebolt, J., & Robert, C. P. (1994) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1994.tb01985.x · Cited by 912
The Utilization of Multiple Measurements in Problems of Biological Classification
Rao, C. R. (1948) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1948.tb00008.x · Cited by 871
Model-based clustering and data transformations for gene expression data
Yeung, K. Y., Fraley, C., Murua, A., Raftery, A. E., & Ruzzo, W. L. (2001) · Bioinformatics · doi:10.1093/bioinformatics/17.10.977 · Cited by 869
Computational and Inferential Difficulties with Mixture Posterior Distributions
Celeux, G., Hurn, M., & Robert, C. P. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10474285 · Cited by 604
Stephens, M. (2000) · The Annals of Statistics · doi:10.1214/aos/1016120364 · Cited by 524
The Infinite Hidden Markov Model
Beal, M. J., Ghahramani, Z., & Rasmussen, C. E. (2002) · Advances in Neural Information Processing Systems 14 · doi:10.7551/mitpress/1120.003.0079 · Cited by 481
Markov chain Monte Carlo Estimation of Classical and Dynamic Switching and Mixture Models
Frühwirth-Schnatter, S. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501750333063 · Cited by 449
Exact and efficient Bayesian inference for multiple changepoint problems
Fearnhead, P. (2006) · Statistics and Computing · doi:10.1007/s11222-006-8450-8 · Cited by 440
Bayesian Modelling and Inference on Mixtures of Distributions
Marin, J.-M., Mengersen, K., & Robert, C. P. (2005) · Handbook of Statistics · doi:10.1016/s0169-7161(05)25016-2 · Cited by 367
Hidden Markov Models and Disease Mapping
Green, P. J., & Richardson, S. (2002) · Journal of the American Statistical Association · doi:10.1198/016214502388618870 · Cited by 347
Sampling from multimodal distributions using tempered transitions
Neal, R. M. (1996) · Statistics and Computing · doi:10.1007/bf00143556 · Cited by 343
Trans-dimensional Markov chain Monte Carlo
Green, P. J. (2003) · Highly Structured Stochastic Systems · doi:10.1093/oso/9780198510550.003.0017 · Cited by 329
A comment on D. V. Lindley's statistical paradox
BARTLETT, M. S. (1957) · Biometrika · doi:10.1093/biomet/44.3-4.533 · Cited by 324
A Generalized Theory of the Combination of Observations so as to Obtain the Best Result
Newcomb, S. (1886) · American Journal of Mathematics · doi:10.2307/2369392 · Cited by 267
Density Estimation with Confidence Sets Exemplified by Superclusters and Voids in the Galaxies
Roeder, K. (1990) · Journal of the American Statistical Association · doi:10.1080/01621459.1990.10474918 · Cited by 236
Real-Parameter Evolutionary Monte Carlo With Applications to Bayesian Mixture Models
Liang, F., & Wong, W. H. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501753168325 · Cited by 206
Robert, C. P., Rydén, T., & Titterington, D. M. (2000) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00219 · Cited by 203
Reversible Jump, Birth-and-Death and More General Continuous Time Markov Chain Monte Carlo Samplers
Cappé, O., Robert, C. P., & Rydèn, T. (2003) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/1467-9868.00409 · Cited by 139
Penalized Maximum Likelihood Estimator for Normal Mixtures
Ciuperca, G., RIDOLFI, A., & Idier, J. (2003) · Scandinavian Journal of Statistics · doi:10.1111/1467-9469.00317 · Cited by 115
A Bayesian Approach to DNA Sequence Segmentation
Boys, R. J., & Henderson, D. A. (2004) · Biometrics · doi:10.1111/j.0006-341x.2004.00206.x · Cited by 99
Population-Based Reversible Jump Markov Chain Monte Carlo
Jasra, A., Stephens, D. A., & Holmes, C. C. (2007) · Biometrika · doi:10.1093/biomet/asm069 · Cited by 92
Self-citationLikelihood and Bayesian analysis of mixtures
Aitkin, M. A. (2001) · Statistical Modelling · doi:10.1177/1471082x0100100404 · Cited by 61
Bayesian methods for mixtures of normal distributions
Stephens, M. (1997) · OpenGrey (Institut de l'Information Scientifique et Technique) · Cited by 23
Cited by
Jakobsson, M., & Rosenberg, N. A. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btm233 · Cited by 6,290
Scientific discovery in the age of artificial intelligence.
Wang, H., Fu, T., Du, Y., Gao, W., Huang, K., Liu, Z., Chandak, P., Liu, S., Van Katwyk, P., Deac, A., et al. (2023) · Nature · doi:10.1038/s41586-023-06221-2 · Cited by 1,823
Sequential Monte Carlo Samplers
Del Moral, P., Doucet, A., & Jasra, A. (2006) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2006.00553.x · Cited by 1,239
Self-citationGao, H., Williamson, S., & Bustamante, C. D. (2007) · Genetics · doi:10.1534/genetics.107.072371 · Cited by 491
von Toussaint, U. (2011) · Reviews of Modern Physics · doi:10.1103/revmodphys.83.943 · Cited by 422
Metadata
- Authors
- Jasra, A., Holmes, C. C., & Stephens, D. A.
- Venue
- Statistical Science
- Publisher
- Institute of Mathematical Statistics
- Published
- 2005-02-01
- Volume
- 20
- Issue
- 1
- Pages
- 50-67
- ISSN
- 0883-4237 (ISSN-L)
- OpenAlex
- W2035756456
- Cited by
- 670
- References
- 39
- FWCI
- 17.86
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.