The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Maximum likelihood estimation via the ECM algorithm: A general framework
Abstract
Two major reasons for the popularity of the EM algorithm are that its maximum step involves only complete-data maximum likelihood estimation, which is often computationally simple, and that its convergence is stable, with each iteration increasing the likelihood. When the associated complete-data maximum likelihood estimation itself is complicated, EM is less attractive because the M-step is computationally unattractive. In many cases, however, complete-data maximum likelihood estimation is relatively simple when conditional on some function of the parameters being estimated. We introduce a class of generalized EM algorithms, which we call the ECM algorithm, for Expectation/Conditional Maximization (CM), that takes advantage of the simplicity of complete-data conditional maximum likelihood estimation by replacing a complicated M-step of EM with several computationally simpler CM-steps. We show that the ECM algorithm shares all the appealing convergence properties of EM, such as always increasing the likelihood, and present several illustrative examples.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Stochastic relaxation, gibbs distributions, and the bayesian restoration of images.
Geman, S., & Geman, D. (1984) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1984.4767596 · Cited by 17,949
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,265
Self-citationInference from iterative simulation using multiple sequences
Gelman, A., & Rubin, D. B. (1992) · Statistical Science · doi:10.1214/ss/1177011136 · Cited by 16,627
Self-citationMonte Carlo sampling methods using Markov chains and their applications.
Hastings, W. K. (1970) · Biometrika · doi:10.1093/biomet/57.1.97 · Cited by 15,195
RUBIN, D. B. (1976) · Biometrika · doi:10.1093/biomet/63.3.581 · Cited by 9,925
Self-citationAn Efficient Method of Estimating Seemingly Unrelated Regressions and Tests for Aggregation Bias
Zellner, A. (1962) · Journal of the American Statistical Association · doi:10.1080/01621459.1962.10480664 · Cited by 8,401
Practical Methods of Optimization
Fletcher, R. (2000) · Wiley eBooks · doi:10.1002/9781118723203 · Cited by 7,605
Principles of mathematical analysis
Rudin, W. (1964) · UCLA - Biblioteca de Ciencias y Tecnologia Felix Morales Bueno · Cited by 5,300
On the Statistical Analysis of Dirty Pictures
Besag, J. (1986) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1986.tb01412.x · Cited by 4,191
On the Convergence Properties of the EM Algorithm
Wu, C. F. J. (1983) · The Annals of Statistics · doi:10.1214/aos/1176346060 · Cited by 3,269
Cited by
Inference from iterative simulation using multiple sequences
Gelman, A., & Rubin, D. B. (1992) · Statistical Science · doi:10.1214/ss/1177011136 · Cited by 16,627
Self-citationMcLachlan, G., & Peel, D. (2000) · Wiley Series in Probability and Statistics · doi:10.1002/0471721182 · Cited by 10,991
Precision mapping of quantitative trait loci.
Zeng, Z. B. (1994) · Genetics · doi:10.1093/genetics/136.4.1457 · Cited by 3,182
Hunter, D. R., & Lange, K. (2004) · The American Statistician · doi:10.1198/0003130042836 · Cited by 1,783
Modeling the Drop-Out Mechanism in Repeated-Measures Studies
Little, R. J. A. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476615 · Cited by 1,522
Multiple Imputation for Multivariate Missing-Data Problems: A Data Analyst's Perspective
Schafer, J. L., & Olsen, M. K. (1998) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3304_5 · Cited by 1,518
Robust Demographic Inference from Genomic and SNP Data
Excoffier, L., Dupanloup, I., Huerta-Sánchez, E., Sousa, V. C., & Foll, M. (2013) · PLoS Genetics · doi:10.1371/journal.pgen.1003905 · Cited by 1,466
Iglesias, J. E., Augustinack, J. C., Nguyen, K., Player, C. M., Player, A., Wright, M., Roy, N., Frosch, M. P., McKee, A. C., Wald, L. L., et al. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2015.04.042 · Cited by 1,277
Survey of maneuvering target tracking. part v: multiple-model methods
Li, X. R., & Jilkov, V. P. (2005) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2005.1561886 · Cited by 1,157
Analysis of multivariate probit models
Chib, S. (1998) · Biometrika · doi:10.1093/biomet/85.2.347 · Cited by 834
Optimization Transfer Using Surrogate Objective Functions
Lange, K., Hunter, D. R., & Yang, I. (2000) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.2000.10474858 · Cited by 808
The EM Algorithm—an Old Folk-song Sung to a Fast New Tune
Meng, X.-L., & Van Dyk, D. (1997) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00082 · Cited by 802
Self-citationConvergence of a stochastic approximation version of the EM algorithm
Delyon, B., Lavielle, M., & Moulines, E. (1999) · The Annals of Statistics · doi:10.1214/aos/1018031103 · Cited by 778
Matched Sampling for Causal Effects
Rubin, D. B. (2006) · Cambridge University Press eBooks · doi:10.1017/cbo9780511810725 · Cited by 676
Self-citationThe ECME algorithm: A simple extension of EM and ECM with faster monotone convergence
LIU, C., & RUBIN, D. B. (1994) · Biometrika · doi:10.1093/biomet/81.4.633 · Cited by 613
Self-citationMaximizing Generalized Linear Mixed Model Likelihoods With an Automated Monte Carlo EM Algorithm
Booth, J. G., & Hobert, J. P. (1999) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00176 · Cited by 551
Bayesian inference for causal effects in randomized experiments with noncompliance
Imbens, G. W., & Rubin, D. B. (1997) · The Annals of Statistics · doi:10.1214/aos/1034276631 · Cited by 538
Self-citationA Straightforward Approach to Markov Chain Monte Carlo Methods for Item Response Models
Patz, R. J., & Junker, B. W. (1999) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986024002146 · Cited by 476
MM algorithms for generalized Bradley-Terry models
Hunter, D. R. (2004) · The Annals of Statistics · doi:10.1214/aos/1079120141 · Cited by 467
Excoffier, L., & Foll, M. (2011) · Bioinformatics · doi:10.1093/bioinformatics/btr124 · Cited by 463
Parameter expansion to accelerate EM: the PX-EM algorithm
Liu, C. (1998) · Biometrika · doi:10.1093/biomet/85.4.755 · Cited by 433
fastsimcoal2: demographic inference under complex evolutionary scenarios
Excoffier, L., Marchi, N., Marques, D. A., Matthey-Doret, R., Gouy, A., & Sousa, V. C. (2021) · Bioinformatics · doi:10.1093/bioinformatics/btab468 · Cited by 426
Bactericidal Effects of Natural Nanotopography of Dragonfly Wing on Escherichia coli
Bandara, C. D., Singh, S., Afara, I. O., Wolff, A., Tesfamichael, T., Ostrikov, K., & Oloyede, A. (2017) · ACS Applied Materials & Interfaces · doi:10.1021/acsami.6b13666 · Cited by 416
Understanding egocentric activities
Fathi, A., Farhadi, A., & Rehg, J. M. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126269 · Cited by 384
Statistical guarantees for the EM algorithm: From population to sample-based analysis
Balakrishnan, S., Wainwright, M. J., & Yu, B. (2017) · The Annals of Statistics · doi:10.1214/16-aos1435 · Cited by 384
Computational Strategies for Multivariate Linear Mixed-Effects Models With Missing Values
Schafer, J. L., & Yucel, R. M. (2002) · Journal of Computational and Graphical Statistics · doi:10.1198/106186002760180608 · Cited by 380
A Gradient Algorithm Locally Equivalent to the Em Algorithm
Lange, K. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02037.x · Cited by 376
Li, H., Ribaut, J.-M., Li, Z., & Wang, J. (2008) · Theoretical and Applied Genetics · doi:10.1007/s00122-007-0663-5 · Cited by 373
Simple and Globally Convergent Methods for Accelerating the Convergence of Any EM Algorithm
VARADHAN, R., & ROLAND, C. (2008) · Scandinavian Journal of Statistics · doi:10.1111/j.1467-9469.2007.00585.x · Cited by 352
Inpainting and Zooming Using Sparse Representations
Fadili, M. J., Starck, J.-L., & Murtagh, F. (2008) · The Computer Journal · doi:10.1093/comjnl/bxm055 · Cited by 333
ARGOS – III. Stellar populations in the Galactic bulge of the Milky Way
Ness, M., Freeman, K., Athanassoula, E., Wylie-de-Boer, E., Bland-Hawthorn, J., Asplund, M., Lewis, G. F., Yong, D., Lane, R. R., & Kiss, L. L. (2013) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/sts629 · Cited by 328
On a Mixture Autoregressive Model
Wong, C. S., & Li, W. K. (2000) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00222 · Cited by 323
Latent Variable Models for Mixed Discrete and Continuous Outcomes
Sammel, M. D., Ryan, L. M., & Legler, J. M. (1997) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00090 · Cited by 313
Ancient genomes show social and reproductive behavior of early Upper Paleolithic foragers
Sikora, M., Seguin-Orlando, A., Sousa, V. C., Albrechtsen, A., Korneliussen, T., Ko, A., Rasmussen, S., Dupanloup, I., Nigst, P. R., Bosch, M. D., et al. (2017) · Science · doi:10.1126/science.aao1807 · Cited by 312
Chimpanzee genomic diversity reveals ancient admixture with bonobos
de Manuel, M., Kuhlwilm, M., Frandsen, P., Sousa, V. C., Desai, T., Prado-Martinez, J., Hernandez-Rodriguez, J., Dupanloup, I., Lao, O., Hallast, P., et al. (2016) · Science · doi:10.1126/science.aag2602 · Cited by 310
Mixed Effects Models for Complex Data
Wu, L. (2009) · Chapman & Hall/CRC eBooks · doi:10.1201/9781420074086 · Cited by 310
Estimating and Using Propensity Scores with Partially Missing Data
D'Agostino, R. B., & Rubin, D. B. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10474263 · Cited by 300
Self-citationA taxonomy of privacy-preserving record linkage techniques
Vatsalan, D., Christen, P., & Verykios, V. S. (2013) · Information Systems · doi:10.1016/j.is.2012.11.005 · Cited by 295
Improved Inference for Respondent-Driven Sampling Data With Application to HIV Prevalence Estimation
Gile, K. J. (2011) · Journal of the American Statistical Association · doi:10.1198/jasa.2011.ap09475 · Cited by 292
Pinheiro, J. C., Liu, C., & Wu, Y. N. (2001) · Journal of Computational and Graphical Statistics · doi:10.1198/10618600152628059 · Cited by 287
Modelling high-dimensional data by mixtures of factor analyzers
McLachlan, G. J., Peel, D., & Bean, R. W. (2003) · Computational Statistics & Data Analysis · doi:10.1016/s0167-9473(02)00183-4 · Cited by 278
Gene Genealogies in a Metapopulation
Wakeley, J., & Aliacar, N. (2001) · Genetics · doi:10.1093/genetics/159.2.893 · Cited by 277
A Short History of Markov Chain Monte Carlo: Subjective Recollections from Incomplete Data
Robert, C., & Casella, G. (2011) · Statistical Science · doi:10.1214/10-sts351 · Cited by 274
Partially Collapsed Gibbs Samplers: Theory and Methods
van Dyk, D. A., & Park, T. (2008) · Journal of the American Statistical Association · doi:10.1198/016214508000000409 · Cited by 267
Coupling a stochastic approximation version of EM with an MCMC procedure
Kuhn, E., & Lavielle, M. (2004) · ESAIM: Probability and Statistics · doi:10.1051/ps:2004007 · Cited by 262
Robust mixture modeling using multivariate skew t distributions
Lin, T.-I. (2010) · Statistics and Computing · doi:10.1007/s11222-009-9128-9 · Cited by 262
Markov chain Monte Carlo methods in biostatistics
Gelman, A., & Rubin, D. B. (1996) · Statistical Methods in Medical Research · doi:10.1177/096228029600500402 · Cited by 255
Self-citationKaiser, T. S., & Heckel, D. G. (2012) · PLoS ONE · doi:10.1371/journal.pone.0032092 · Cited by 37
Metadata
- Authors
- MENG, X.-L., & RUBIN, D. B.
- Venue
- Biometrika
- Publisher
- Oxford University Press (OUP)
- Published
- 1993
- Volume
- 80
- Issue
- 2
- Pages
- 267-278
- ISSN
- 0006-3444 (ISSN-L)
- 1464-3510
- OpenAlex
- W1967639437
- Cited by
- 1,861
- References
- 15
- FWCI
- 21.72
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.