The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Space-alternating generalized expectation-maximization algorithm
Open accessAbstract
The expectation-maximization (EM) method can facilitate maximizing likelihood functions that arise in statistical estimation problems. In the classical EM paradigm, one iteratively maximizes the conditional log-likelihood of a single unobservable complete data space, rather than maximizing the intractable likelihood function for the measured or incomplete data. EM algorithms update all parameters simultaneously, which has two drawbacks: 1) slow convergence, and 2) difficult maximization steps due to coupling when smoothness penalties are used. The paper describes the space-alternating generalized EM (SAGE) method, which updates the parameters sequentially by alternating between several small hidden-data spaces defined by the algorithm designer. The authors prove that the sequence of estimates monotonically increases the penalized-likelihood objective, derive asymptotic convergence rates, and provide sufficient conditions for monotone convergence in norm. Two signal processing applications illustrate the method: estimation of superimposed signals in Gaussian noise, and image reconstruction from Poisson measurements. In both applications, the SAGE algorithms easily accommodate smoothness penalties and converge faster than the EM algorithms.>
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Press, W. H., Teukolsky, S. A., Vetterling, W. T., & Flannery, B. P. (1994) · Cited by 15,411
Iterative Solution of Nonlinear Equations in Several Variables
Ortega, J. M., & Rheinboldt, W. C. (2000) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9780898719468 · Cited by 6,860
Maximum Likelihood from Incomplete Data via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1976) · Cited by 4,517
Maximum Likelihood Reconstruction for Emission Tomography
Shepp, L. A., & Vardi, Y. (1982) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.1982.4307558 · Cited by 4,429
Iterative Solution of Nonlinear Equations in Several Variables
I., E., Ortega, J. M., & Rheinboldt, W. C. (1971) · Mathematics of Computation · doi:10.2307/2004942 · Cited by 4,408
On the Convergence Properties of the EM Algorithm
Wu, C. F. J. (1983) · The Annals of Statistics · doi:10.1214/aos/1176346060 · Cited by 3,269
Finding the Observed Information Matrix When Using the EM Algorithm
Louis, T. A. (1982) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1982.tb01203.x · Cited by 2,229
EM reconstruction algorithms for emission and transmission tomography.
Lange, K. L., & Carson, R. E. (1984) · PubMed · Cited by 1,769
Iterative Solution of Large Linear Systems
(1971) · Elsevier eBooks · doi:10.1016/c2013-0-11733-3 · Cited by 1,734
Maximum likelihood localization of multiple sources by alternating projection
Ziskind, I., & Wax, M. (1988) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/29.7543 · Cited by 1,272
Parameter estimation of superimposed signals using the EM algorithm
Feder, M., & Weinstein, E. (1988) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/29.1552 · Cited by 779
A generalized EM algorithm for 3-D Bayesian reconstruction from Poisson data using Gibbs priors
Hebert, T., & Leahy, R. (1989) · IEEE Transactions on Medical Imaging · doi:10.1109/42.24868 · Cited by 622
Penalized weighted least-squares image reconstruction for positron emission tomography
Fessler, J. A. (1994) · IEEE Transactions on Medical Imaging · doi:10.1109/42.293921 · Cited by 611
Self-citationA local update strategy for iterative reconstruction from projections
Sauer, K., & Bouman, C. (1993) · IEEE Transactions on Signal Processing · doi:10.1109/78.193196 · Cited by 494
De Pierro, A. R. (1995) · IEEE Transactions on Medical Imaging · doi:10.1109/42.370409 · Cited by 475
A unified approach to statistical tomography using coordinate descent optimization
Bouman, C. A., & Sauer, K. (1996) · IEEE Transactions on Image Processing · doi:10.1109/83.491321 · Cited by 442
On Use of the Em Algorithm for Penalized Likelihood Estimation
Green, P. J. (1990) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1990.tb01798.x · Cited by 417
Convergence of EM image reconstruction algorithms with Gibbs smoothing
Lange, K. (1990) · IEEE Transactions on Medical Imaging · doi:10.1109/42.61759 · Cited by 400
A Fast Improvement to the Em Algorithm on its Own Terms
Meilijson, I. (1989) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1989.tb01754.x · Cited by 371
On the Convergence of the EM Algorithm
Boyles, R. A. (1983) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1983.tb01229.x · Cited by 333
Implementing and Accelerating the EM Algorithm for Positron Emission Tomography
Kaufman, L. (1987) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.1987.4307796 · Cited by 293
Silverman, B. W., Jones, M. C., Wilson, J. D., & Nychka, D. W. (1990) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1990.tb01788.x · Cited by 274
Iterative image reconstruction algorithms based on cross-entropy minimization
Byrne, C. L. (1993) · IEEE Transactions on Image Processing · doi:10.1109/83.210869 · Cited by 239
Maximum likelihood, least squares, and penalized least squares for PET
Kaufman, L. (1993) · IEEE Transactions on Medical Imaging · doi:10.1109/42.232249 · Cited by 180
Conjugate Gradient Acceleration of the EM Algorithm
Jamshidian, M., & Jennrich, R. I. (1993) · Journal of the American Statistical Association · doi:10.1080/01621459.1993.10594313 · Cited by 176
Lewitt, R. M., & Muehllehner, G. (1986) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.1986.4307734 · Cited by 155
Politte, D. G., & Snyder, D. L. (1991) · IEEE Transactions on Medical Imaging · doi:10.1109/42.75614 · Cited by 147
On the Convergence of the Em Algorithm
Hero, A. O. (2005) · IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit.1993.748501 · Cited by 83
Self-citationOn complete-data spaces for PET reconstruction algorithms
Fessler, J. A., Clinthorne, N. H., & Rogers, W. L. (1993) · IEEE Transactions on Nuclear Science · doi:10.1109/23.256712 · Cited by 60
Self-citationOn methods for maximum a posteriori image reconstruction with a normal prior
Herman, G. T., Pierro, Á. R. D., & Gai, N. (1992) · Journal of Visual Communication and Image Representation · doi:10.1016/1047-3203(92)90035-r · Cited by 40
SPACE-ALTERNATING GENERALIZED EM ALGORITHMS FOR PENALIZED MAXIMUM-LIKELIHOOD IMAGE RECONSTRUCTION
Fessler, J. A., & Hero, A. O. (1997) · Cited by 18
Self-citationA Bayesian Reconstruction Algorithm for Emission Tomography using a Markov Random Field Prior
Hebert, T., & Leahy, R. M. (1989) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.953287 · Cited by 7
Cited by
Majorization-Minimization Algorithms in Signal Processing, Communications, and Machine Learning
Sun, Y., Babu, P., & Palomar, D. P. (2017) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2016.2601299 · Cited by 1,820
From RSSI to CSI: Indoor localization via channel response
Yang, Z., Zhou, Z., & Liu, Y. (2013) · ACM Computing Surveys · doi:10.1145/2543581.2543592 · Cited by 1,229
Ollinger, J. M., & Fessler, J. A. (1997) · IEEE Signal Processing Magazine · doi:10.1109/79.560323 · Cited by 1,167
Self-citationFévotte, C., Bertin, N., & Durrieu, J.-L. (2009) · Neural Computation · doi:10.1162/neco.2008.04-08-771 · Cited by 1,119
Channel parameter estimation in mobile radio environments using the SAGE algorithm
Fleury, B. H., Tschudin, M., Heddergott, R., Dahlhaus, D., & Ingeman Pedersen, K. (1999) · IEEE Journal on Selected Areas in Communications · doi:10.1109/49.753729 · Cited by 1,079
Metadata
- Authors
- Fessler, J. A., & Hero, A. O.
- Venue
- IEEE Transactions on Signal Processing
- Published
- 1994
- Volume
- 42
- Issue
- 10
- Pages
- 2664-2677
- ISSN
- 1053-587X (ISSN-L)
- OpenAlex
- W2161623414
- Cited by
- 1,063
- References
- 33
- FWCI
- 11.71
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.