The DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.
Mixture Densities, Maximum Likelihood and the EM Algorithm
Abstract
The problem of estimating the parameters which determine a mixture density has been the subject of a large, diverse body of literature spanning nearly ninety years. During the last two decades, the method of maximum likelihood has become the most widely followed approach to this problem, thanks primarily to the advent of high speed electronic computers. Here, we first offer a brief survey of the literature directed toward this problem and review maximum-likelihood estimation for it. We then turn to the subject of ultimate interest, which is a particular iterative procedure for numerically approximating maximum-likelihood estimates for mixture density problems. This procedure, known as the EM algorithm, is a specialization to the mixture density context of a general algorithm of the same name used to approximate maximum-likelihood estimates for incomplete data problems. We discuss the formulation and theoretical and practical properties of the EM algorithm for mixture densities, focussing in particular on mixtures of densities from exponential families.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Optimization by Vector Space Methods
(1970) · Students Quarterly Journal · doi:10.1049/sqj.1970.0088 · Cited by 6,004
Mathematical Methods of Statistics.
Geary, R. C., & Cramer, H. (1947) · The Economic Journal · doi:10.2307/2226151 · Cited by 5,927
Iterative Solution of Nonlinear Equations in Several Variables
I., E., Ortega, J. M., & Rheinboldt, W. C. (1971) · Mathematics of Computation · doi:10.2307/2004942 · Cited by 4,408
Baum, L. E., Petrie, T., Soules, G., & Weiss, N. (1970) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177697196 · Cited by 4,297
Levary, R. R. (1982) · European Journal of Operational Research · doi:10.1016/0377-2217(82)90093-5 · Cited by 4,158
Pattern classification and scene analysis
Chien, Y. (1974) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1974.1100577 · Cited by 3,398
On the Convergence Properties of the EM Algorithm
Wu, C. F. J. (1983) · The Annals of Statistics · doi:10.1214/aos/1176346060 · Cited by 3,269
Computer methods for mathematical computations
Forsythe, G. E., Malcolm, M. A., & Moler, C. (1977) · UCLA Biblioteca de Ingenieria Civil · Cited by 2,683
Gordon, A. D., & Hartigan, J. A. (1976) · Journal of the American Statistical Association · doi:10.2307/2286880 · Cited by 2,569
Mayer, T. F., Lazarsfeld, P. F., & Henry, N. W. (1969) · American Sociological Review · doi:10.2307/2092222 · Cited by 2,384
Introduction to matrix computations
Stewart, G. W. (1973) · International Linear Collider · Cited by 2,381
Introduction to Statistical Pattern Recognition
(2011) · Statistical Pattern Recognition · doi:10.1002/9781119952954.ch1 · Cited by 1,597
Quasi-Newton Methods, Motivation and Theory
Dennis, Jr., & Moré, J. J. (1977) · SIAM Review · doi:10.1137/1019005 · Cited by 1,553
III. Contributions to the mathematical theory of evolution
Pearson, K. (1894) · Philosophical Transactions of the Royal Society of London. (A.) · doi:10.1098/rsta.1894.0003 · Cited by 1,550
A Simple Method of Resolution of a Distribution into Gaussian Components
Bhattacharya, C. G. (1967) · Biometrics · doi:10.2307/2528285 · Cited by 1,210
Information and Exponential Families in Statistical Theory.
Kingman, J. F. C., & Barndorff-Nielsen, O. (1979) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2344658 · Cited by 1,173
Note on the Consistency of the Maximum Likelihood Estimate
Wald, A. (1949) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729952 · Cited by 1,100
Everitt, B. S., & Hand, D. J. (1981) · Springer eBooks · doi:10.1007/978-94-009-5897-5 · Cited by 1,058
Nonlinear Programming: A Unified Approach.
Beale, E. M. L., & Zangwill, W. (1970) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2343701 · Cited by 1,057
Kiefer, J., & Wolfowitz, J. (1956) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177728066 · Cited by 1,023
Solution of Equations and Systems of Equations
I., E., & Ostrowski, A. M. (1967) · Mathematics of Computation · doi:10.2307/2005025 · Cited by 937
The Art of Computer Programming, Vol. 2
Knuth, D. E. (1981) · Medical Entomology and Zoology · Cited by 886
The Utilization of Multiple Measurements in Problems of Biological Classification
Rao, C. R. (1948) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1948.tb00008.x · Cited by 871
Estimating the components of a mixture of normal distributions
DAY, N. E. (1969) · Biometrika · doi:10.1093/biomet/56.3.463 · Cited by 824
Nonparametric maximum likelihood estimation of a mixing distribution
Laird, N. (1978) · Journal of the American Statistical Association · doi:10.1080/01621459.1978.10480103 · Cited by 753
The Use of Probability Paper for the Graphical Analysis of Polymodal Frequency Distributions
Harding, J. P. (1949) · Journal of the Marine Biological Association of the United Kingdom · doi:10.1017/s0025315400055259 · Cited by 670
A New Approach to Estimating Switching Regressions
Quandt, R. E. (1972) · Journal of the American Statistical Association · doi:10.1080/01621459.1972.10482378 · Cited by 633
PATTERN CLUSTERING BY MULTIVARIATE MIXTURE ANALYSIS
Wolfe, J. H. (1970) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr0503_6 · Cited by 609
Numerical Methods for Unconstrained Optimization and Nonlinear Equations.
Kass, R. E., Dennis, J. E., & Schnabel, R. B. (1985) · Journal of the American Statistical Association · doi:10.2307/2288097 · Cited by 602
Maximum-Likelihood Estimation of Parameters Subject to Restraints
Aitchison, J., & Silvey, S. D. (1958) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177706538 · Cited by 595
Some Uses of Probability Paper in the Analysis of Size Frequency Distributions
Cassie, R. (1954) · Australian Journal of Marine and Freshwater Research · doi:10.1071/mf9540513 · Cited by 583
Identifiability of Finite Mixtures
Teicher, H. (1963) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177703862 · Cited by 573
Estimating Mixtures of Normal Distributions and Switching Regressions
Quandt, R. E., & Ramsey, J. B. (1978) · Journal of the American Statistical Association · doi:10.1080/01621459.1978.10480085 · Cited by 519
Goodman, L. A. (1974) · American Journal of Sociology · doi:10.1086/225676 · Cited by 502
Estimation of Parameters for a Mixture of Normal Distributions
Hasselblad, V. (1966) · Technometrics · doi:10.1080/00401706.1966.10490375 · Cited by 492
The Analysis of Exponentially Distributed Life-Times with Two Types of Failure
Cox, D. R. (1959) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1959.tb00349.x · Cited by 485
The Theory of Statistical Inference.
Cox, D. R., & Zacks, S. (1972) · Biometrika · doi:10.2307/2334646 · Cited by 453
On the Identifiability of Finite Mixtures
Yakowitz, S. J., & Spragins, J. D. (1968) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177698520 · Cited by 401
Teicher, H. (1961) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177705155 · Cited by 346
THE ESTIMATION OF GENE FREQUENCIES IN A RANDOM‐MATING POPULATION
CEPPELLINI, B. R., SINISCALCO, M., & SMITH, C. A. B. (1955) · Annals of Human Genetics · doi:10.1111/j.1469-1809.1955.tb01360.x · Cited by 342
On the Convergence of the EM Algorithm
Boyles, R. A. (1983) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1983.tb01229.x · Cited by 333
Classification, estimation, and pattern recognition
Young, T. Y., & Calvert, T. W. (1974) · International Linear Collider · Cited by 332
Wolfowitz, J. (1957) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177707038 · Cited by 270
Estimation in Mixtures of Two Normal Distributions
Cohen, A. C. (1967) · Technometrics · doi:10.1080/00401706.1967.10490438 · Cited by 205
Note on the Consistency of the Maximum Likelihood Estimate for Nonidentifiable Distributions
Redner, R. (1981) · The Annals of Statistics · doi:10.1214/aos/1176345353 · Cited by 193
Self-citationHosmer, D. W. (1973) · Biometrics · doi:10.2307/2529141 · Cited by 185
Maximum Likelihood Estimation of a Compound Poisson Process
Simar, L. (1976) · The Annals of Statistics · doi:10.1214/aos/1176343651 · Cited by 179
Estimation of Finite Mixtures of Distributions from the Exponential Family
Hasselblad, V. (1969) · Journal of the American Statistical Association · doi:10.1080/01621459.1969.10501071 · Cited by 176
An Estimation Procedure for Mixtures of Distributions
Choi, K., & Bulgren, W. G. (1968) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1968.tb00743.x · Cited by 175
On the Mixture of Distributions
Teicher, H. (1960) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177705987 · Cited by 160
Krutchkoff, R. G., & Maritz, J. S. (1971) · Revue de l Institut International de Statistique / Review of the International Statistical Institute · doi:10.2307/1402244 · Cited by 146
ON THE GENERALISED PROBABLE ERROR IN MULTIPLE NORMAL CORRELATION
Pearson, K., & LEE, A. (1908) · Biometrika · doi:10.1093/biomet/6.1.59 · Cited by 115
Sundberg, R. (1976) · Communications in Statistics - Simulation and Computation · doi:10.1080/03610917608812007 · Cited by 112
Log-Linear Models for Frequency Tables Derived by Indirect Observation: Maximum Likelihood Equations
Haberman, S. J. (1974) · The Annals of Statistics · doi:10.1214/aos/1176342813 · Cited by 83
Information for Estimating the Proportions in Mixtures of Exponential and Normal Distributions
Hill, B. M. (1963) · Journal of the American Statistical Association · doi:10.1080/01621459.1963.10480678 · Cited by 74
Nonparametric Estimation in Renewal Processes
Vardi, Y. (1982) · The Annals of Statistics · doi:10.1214/aos/1176345870 · Cited by 70
On MLE of the Parameters of a Mixture of two Normal Distributions When the Sample Size is Small
Hosmer, D. W. (1973) · Communications in Statistics - Simulation and Computation · doi:10.1080/03610927308827019 · Cited by 69
Product Models for Frequency Tables Involving Indirect Observation
Haberman, S. J. (1977) · The Annals of Statistics · doi:10.1214/aos/1176344000 · Cited by 67
Construction of Sequences Estimating the Mixing Distribution
Deely, J., & Kruse, R. L. (1968) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177698536 · Cited by 60
The Probability Distribution of Protection Test Results
Muench, H. (1936) · Journal of the American Statistical Association · doi:10.1080/01621459.1936.10502297 · Cited by 9
Cited by
Maximum a posteriori estimation for multivariate Gaussian mixture observations of Markov chains
Gauvain, J.-L., & Lee, C.-H. (1994) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.279278 · Cited by 2,108
Wavelet-based statistical signal processing using hidden Markov models
Crouse, M. S., Nowak, R. D., & Baraniuk, R. G. (1998) · IEEE Transactions on Signal Processing · doi:10.1109/78.668544 · Cited by 1,643
Statistical Color Models with Application to Skin Detection
Jones, M. J., & Rehg, J. M. (2002) · International Journal of Computer Vision · doi:10.1023/a:1013200319198 · Cited by 1,542
Assessing a mixture model for clustering with the integrated completed likelihood
Biernacki, C., Celeux, G., & Govaert, G. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.865189 · Cited by 1,535
Maximum Likelihood Estimation of Latent Interaction Effects with the LMS Method
Klein, A., & Moosbrugger, H. (2000) · Psychometrika · doi:10.1007/bf02296338 · Cited by 1,429
Metadata
- Authors
- Redner, R. A., & Walker, H. F.
- Venue
- SIAM Review
- Published
- 1984-04
- Volume
- 26
- Issue
- 2
- Pages
- 195-239
- ISSN
- 0036-1445 (ISSN-L)
- 1095-7200
- OpenAlex
- W1981367467
- Cited by
- 2,693
- References
- 61
- FWCI
- 17.59
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.