The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
The expectation-maximization algorithm
Abstract
A common task in signal processing is the estimation of the parameters of a probability distribution function. Perhaps the most frequently encountered estimation problem is the estimation of the mean of a signal in noise. In many parameter estimation problems the situation is more complicated because direct access to the data necessary to estimate the parameters is impossible, or some of the data are missing. Such difficulties arise when an outcome is a result of an accumulation of simpler outcomes, or when outcomes are clumped together, for example, in a binning or histogram operation. There may also be data dropouts or clustering in such a way that the number of underlying data points is unknown (censoring and/or truncation). The EM (expectation-maximization) algorithm is ideally suited to problems of this sort, in that it produces maximum-likelihood (ML) estimates of parameters when there is a many-to-one mapping from an underlying distribution to the distribution governing the observation. The EM algorithm is presented at a level suitable for signal processing practitioners who have had some exposure to estimation theory.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
(2007) · Electronics: A First Course · doi:10.4324/9780080477527-64 · Cited by 24,923
A tutorial on hidden Markov models and selected applications in speech recognition
Rabiner, L. R. (1989) · Proceedings of the IEEE · doi:10.1109/5.18626 · Cited by 22,743 · cited 1×
“It has also been called the expectationhodification algorithm [ 9 ]).”
MethodFundamentals of speech recognition
Rabiner, L. R., & Juang, B.-H. F. (1993) · Cited by 7,680
Warnes, L. A. A. (1994) · Electronic and Electrical Engineering · doi:10.1007/978-1-349-13012-2_24 · Cited by 6,512
Detection, Estimation, And Modulation Theory
Trees, H. L. V. (1968) · Cited by 5,969
(1991) · Springer eBooks · doi:10.1007/978-3-7091-2840-4 · Cited by 5,095
Maximum Likelihood from Incomplete Data via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1976) · Cited by 4,517
Maximum Likelihood Reconstruction for Emission Tomography
Shepp, L. A., & Vardi, Y. (1982) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.1982.4307558 · Cited by 4,429
Baum, L. E., Petrie, T., Soules, G., & Weiss, N. (1970) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177697196 · Cited by 4,297
Cited by
Classification of hyperspectral remote sensing images with support vector machines
Melgani, F., & Bruzzone, L. (2004) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2004.831865 · Cited by 4,411
On hyperparameter optimization of machine learning algorithms: Theory and practice
Yang, L., & Shami, A. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.07.061 · Cited by 3,232
Spectral Analysis of Signals: The Missing Data Case
Wang, Y., Li, J., & Stoica, P. (2005) · Synthesis Lectures on Signal Processing · doi:10.1007/978-3-031-02525-9 · Cited by 2,890
Automatic analysis of the difference image for unsupervised change detection
Bruzzone, L., & Prieto, D. F. (2000) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/36.843009 · Cited by 1,339
A Unified Convergence Analysis of Block Successive Minimization Methods for Nonsmooth Optimization
Razaviyayn, M., Hong, M., & Luo, Z.-Q. (2013) · SIAM Journal on Optimization · doi:10.1137/120891009 · Cited by 1,304
Deepfakes and beyond: A Survey of face manipulation and fake detection
Tolosana, R., Vera-Rodriguez, R., Fierrez, J., Morales, A., & Ortega-Garcia, J. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.06.014 · Cited by 1,237
Map-Reduce for Machine Learning on Multicore
Chu, C.-T., Kim, S. K., Lin, Y.-A., Yu, Y., Bradski, G., Ng, A. Y., & Olukotun, K. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0040 · Cited by 1,229
Cooperative Localization in Wireless Networks
Wymeersch, H., Lien, J., & Win, M. Z. (2009) · Proceedings of the IEEE · doi:10.1109/jproc.2008.2008853 · Cited by 1,182
Transcriptome-wide noise controls lineage choice in mammalian progenitor cells
Chang, H. H., Hemberg, M., Barahona, M., Ingber, D. E., & Huang, S. (2008) · Nature · doi:10.1038/nature06965 · Cited by 1,092
Channel parameter estimation in mobile radio environments using the SAGE algorithm
Fleury, B. H., Tschudin, M., Heddergott, R., Dahlhaus, D., & Ingeman Pedersen, K. (1999) · IEEE Journal on Selected Areas in Communications · doi:10.1109/49.753729 · Cited by 1,079
The variational approximation for Bayesian inference
Tzikas, D. G., Likas, A. C., & Galatsanos, N. P. (2008) · IEEE Signal Processing Magazine · doi:10.1109/msp.2008.929620 · Cited by 1,039
An empirical comparison of botnet detection methods
García, S., Grill, M., Stiborek, J., & Zunino, A. (2014) · Computers & Security · doi:10.1016/j.cose.2014.05.011 · Cited by 962
Feature Selection for Unsupervised Learning
Dy, J., & Brodley, C. E. (2004) · doi:10.5555/1005332.1016787 · Cited by 885
Construction and evaluation of a robust multifeature speech/music discriminator
Scheirer, E., & Slaney, M. (2002) · 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1997.596192 · Cited by 873
A Tutorial on Text-Independent Speaker Verification
Bimbot, F., Bonastre, J.-F., Fredouille, C., Gravier, G., Magrin-Chagnolleau, I., Meignier, S., Merlin, T., Ortega-García, J., Petrovska-Delacrétaz, D., & Reynolds, D. A. (2004) · EURASIP Journal on Advances in Signal Processing · doi:10.1155/s1110865704310024 · Cited by 798
Anomaly detection from hyperspectral imagery
Stein, D. W. J., Beaven, S. G., Hoff, L. E., Winter, E. M., Schaum, A. P., & Stocker, A. D. (2002) · IEEE Signal Processing Magazine · doi:10.1109/79.974730 · Cited by 687
FEAST: fast expectation-maximization for microbial source tracking
Shenhav, L., Thompson, M., Joseph, T. A., Briscoe, L., Furman, O., Bogumil, D., Mizrahi, I., Pe’er, I., & Halperin, E. (2019) · Nature Methods · doi:10.1038/s41592-019-0431-x · Cited by 644
Improved data analysis for the MinION nanopore sequencer
Jain, M., Fiddes, I. T., Miga, K. H., Olsen, H. E., Paten, B., & Akeson, M. (2015) · Nature Methods · doi:10.1038/nmeth.3290 · Cited by 639
Aggarwal, C. C. (2015) · Data Mining · doi:10.1007/978-3-319-14142-8_13 · Cited by 606
Improving Graph Collaborative Filtering with Neighborhood-enriched Contrastive Learning
Lin, Z., Tian, C., Hou, Y., & Zhao, W. X. (2022) · Proceedings of the ACM Web Conference 2022 · doi:10.1145/3485447.3512104 · Cited by 572
Blood vessel segmentation algorithms — Review of methods, datasets and evaluation metrics
Moccia, S., De Momi, E., El Hadji, S., & Mattos, L. S. (2018) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2018.02.001 · Cited by 567
Predicting students' final performance from participation in on-line discussion forums
Romero, C., López, M.-I., Luna, J.-M., & Ventura, S. (2013) · Computers & Education · doi:10.1016/j.compedu.2013.06.009 · Cited by 546
A survey of anomaly detection techniques in financial domain
Ahmed, M., Mahmood, A. N., & Islam, M. R. (2016) · Future Generation Computer Systems · doi:10.1016/j.future.2015.01.001 · Cited by 528
Thirty Years of Machine Learning: The Road to Pareto-Optimal Wireless Networks
Wang, J., Jiang, C., Zhang, H., Ren, Y., Chen, K.-C., & Hanzo, L. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2965856 · Cited by 486
Maseer, Z. K., Yusof, R., Bahaman, N., Mostafa, S. A., & Foozy, C. F. M. (2021) · IEEE Access · doi:10.1109/access.2021.3056614 · Cited by 473
Deep Learning for Deepfakes Creation and Detection: A Survey
Nguyen, T. T., Nguyen, Q. V. H., Nguyen, D. T., Nguyen, D. T., Huynh-The, T., Nahavandi, S., Nguyen, T. T., Pham, Q.-V., & Nguyen, C. M. (2019) · arXiv · doi:10.48550/arxiv.1909.11573 · Cited by 464
A Global Human Settlement Layer From Optical HR/VHR RS Data: Concept and First Results
Pesaresi, M., Huadong, G., Blaes, X., Ehrlich, D., Ferri, S., Gueguen, L., Halkia, M., Kauffmann, M., Kemper, T., Lu, L., et al. (2013) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2013.2271445 · Cited by 460
Deep learning for deepfakes creation and detection: A survey
Nguyen, T. T., Nguyen, Q. V. H., Nguyen, D. T., Nguyen, D. T., Huynh-The, T., Nahavandi, S., Nguyen, T. T., Pham, Q.-V., & Nguyen, C. M. (2022) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2022.103525 · Cited by 464
“Using convolutional traces on GAN-based images [162] KNN, SVM, and LDA Training the expectation-maximization algorithm [163] to detect and extract discriminative features via a fingerprint that represents the convolutional traces left by GANs during image generation.”
MethodTravel time estimation for urban road networks using low frequency probe vehicle data
Jenelius, E., & Koutsopoulos, H. N. (2013) · Transportation Research Part B: Methodological · doi:10.1016/j.trb.2013.03.008 · Cited by 434
Bruzzone, L., & Prieto, D. F. (2002) · IEEE Transactions on Image Processing · doi:10.1109/tip.2002.999678 · Cited by 412
An overview of topic modeling and its current applications in bioinformatics
Liu, L., Tang, L., Dong, W., Yao, S., & Zhou, W. (2016) · SpringerPlus · doi:10.1186/s40064-016-3252-8 · Cited by 392
Temporal sequence learning and data reduction for anomaly detection
Lane, T., & Brodley, C. E. (1999) · ACM Transactions on Information and System Security · doi:10.1145/322510.322526 · Cited by 386
DeepFake Detection by Analyzing Convolutional Traces
Guarnera, L., Giudice, O., & Battiato, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00341 · Cited by 374
An Overview of Voice Conversion and Its Challenges: From Statistical Modeling to Deep Learning
Sisman, B., Yamagishi, J., King, S., & Li, H. (2021) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2020.3038524 · Cited by 357
Miller, C. S., Baker, B. J., Thomas, B. C., Singer, S. W., & Banfield, J. F. (2011) · Genome Biology · doi:10.1186/gb-2011-12-5-r44 · Cited by 347
Bruzzone, L., & Bovolo, F. (2013) · Proceedings of the IEEE · doi:10.1109/jproc.2012.2197169 · Cited by 330
A Framework for Automatic and Unsupervised Detection of Multiple Changes in Multitemporal Images
Bovolo, F., Marchesi, S., & Bruzzone, L. (2012) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2011.2171493 · Cited by 328
Construction of an abdominal probabilistic atlas and its application in segmentation
Park, H., Bland, P. H., & Meyer, C. R. (2003) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2003.809139 · Cited by 328
Machine learning for multi-omics data integration in cancer
Cai, Z., Poulos, R. C., Liu, J., & Zhong, Q. (2022) · iScience · doi:10.1016/j.isci.2022.103798 · Cited by 327
Godino-Llorente, J. I., Gomez-Vilda, P., & Blanco-Velasco, M. (2006) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2006.871883 · Cited by 322
Source camera identification based on CFA interpolation
Bayram, S., Sencar, H., Memon, N., & Avcibas, I. (2005) · IEEE International Conference on Image Processing 2005 · doi:10.1109/icip.2005.1530330 · Cited by 321
Events Detection for an Audio-Based Surveillance System
Clavel, C., Ehrette, T., & Richard, G. (2005) · 2005 IEEE International Conference on Multimedia and Expo · doi:10.1109/icme.2005.1521669 · Cited by 314
Zhu, J., Ge, Z., Song, Z., & Gao, F. (2018) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2018.09.003 · Cited by 308
Model-based estimation of ultrasonic echoes. Part I: Analysis and algorithms
Demirli, R., & Saniie, J. (2001) · IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control · doi:10.1109/58.920713 · Cited by 306
DeepFake Detection for Human Face Images and Videos: A Survey
Malik, A., Kuribayashi, M., Abdullahi, S. M., & Khan, A. N. (2022) · IEEE Access · doi:10.1109/access.2022.3151186 · Cited by 297
Comparison of quantitative methods for cell‐shape analysis
PINCUS, Z., & THERIOT, J. A. (2007) · Journal of Microscopy · doi:10.1111/j.1365-2818.2007.01799.x · Cited by 288
Off-Grid Channel Estimation With Sparse Bayesian Learning for OTFS Systems
Wei, Z., Yuan, W., Li, S., Yuan, J., & Ng, D. W. K. (2022) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2022.3158616 · Cited by 277
Pattipati, B., Sankavaram, C., & Pattipati, K. (2011) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2010.2089979 · Cited by 267
da Silva, A. M., Povinelli, R. J., & Demerdash, N. A. O. (2008) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2007.909060 · Cited by 266
Bruzzone, L., & Prieto, D. F. (2001) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/36.905255 · Cited by 253
Prediction of Functional Outcome in Individuals at Clinical High Risk for Psychosis
Carrión, R. E., McLaughlin, D., Goldberg, T. E., Auther, A. M., Olsen, R. H., Olvet, D. M., Correll, C. U., & Cornblatt, B. A. (2013) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2013.1909 · Cited by 250
Huang, F., Wang, Y., & Zhang, H. (2024) · European Journal of Education · doi:10.1111/ejed.12770 · Cited by 243
Prediction of students’ early dropout based on their interaction logs in online learning environment
Mubarak, A. A., Cao, H., & Zhang, W. (2022) · Interactive Learning Environments · doi:10.1080/10494820.2020.1727529 · Cited by 170
“The expectation-maximization (EM) algorithm is used to estimate parameters (maximization step) (Moon, 1996).”
MethodFighting Deepfake by Exposing the Convolutional Traces on Images
Guarnera, L., Giudice, O., & Battiato, S. (2020) · IEEE Access · doi:10.1109/access.2020.3023037 · Cited by 149
A Likelihood and Local Constraint Level Set Model for Liver Tumor Segmentation from CT Volumes
Li, C., Wang, X., Eberl, S., Fulham, M., Yin, Y., Chen, J., & Feng, D. D. (2013) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2013.2267212 · Cited by 139
Elmannai, H., El-Rashidy, N., Mashal, I., Alohali, M. A., Farag, S., El-Sappagh, S., & Saleh, H. (2023) · Diagnostics · doi:10.3390/diagnostics13081506 · Cited by 140
Predictive Analytics for Complex IoT Data Streams
Akbar, A., Khan, A., Carrez, F., & Moessner, K. (2017) · IEEE Internet of Things Journal · doi:10.1109/jiot.2017.2712672 · Cited by 136
Interacting with computers by voice: automatic speech recognition and synthesis
O'Shaughnessy, D. (2003) · Proceedings of the IEEE · doi:10.1109/jproc.2003.817117 · Cited by 132
Incorporating AI and learning analytics to build trustworthy peer assessment systems
Darvishi, A., Khosravi, H., Sadiq, S., & Gašević, D. (2022) · British Journal of Educational Technology · doi:10.1111/bjet.13233 · Cited by 120
Fighting Deepfakes by Detecting GAN DCT Anomalies
Giudice, O., Guarnera, L., & Battiato, S. (2021) · Journal of Imaging · doi:10.3390/jimaging7080128 · Cited by 118
Clemins, P. J., Johnson, M. T., Leong, K. M., & Savage, A. (2005) · The Journal of the Acoustical Society of America · doi:10.1121/1.1847850 · Cited by 115
Machine Learning for DDoS Attack Detection in Industry 4.0 CPPSs
Saghezchi, F. B., Mantas, G., Violas, M. A., de Oliveira Duarte, A. M., & Rodriguez, J. (2022) · Electronics · doi:10.3390/electronics11040602 · Cited by 81
“Table 2 illustrates the confusion matrix, showing two possible predictive classes (benign or malicious) for each of the two actual classes.”
The face deepfake detection challenge
Guarnera, L., Giudice, O., Guarnera, F., Ortis, A., Puglisi, G., Paratore, A., Bui, L. M. Q., Fontani, M., Coccomini, D. A., Caldelli, R., et al. (2022) · Journal of Imaging · doi:10.3390/jimaging8100263 · Cited by 79
Event-based media processing and analysis: A survey of the literature
Tzelepis, C., Ma, Z., Mezaris, V., Ionescu, B., Kompatsiaris, I., Boato, G., Sebe, N., & Yan, S. (2016) · Image and Vision Computing · doi:10.1016/j.imavis.2016.05.005 · Cited by 49
“ing the traditional Expectation-Maximization algorithm [136], initialized by a basic binary splitting vector quantization algorithm.”
MethodIncorporating Training, Self-monitoring and AI-Assistance to Improve Peer Feedback Quality
Darvishi, A., Khosravi, H., Abdi, S., Sadiq, S., & Gašević, D. (2022) · Proceedings of the Ninth ACM Conference on Learning @ Scale · doi:10.1145/3491140.3528265 · Cited by 31
Casu, M., Guarnera, L., Caponnetto, P., & Battiato, S. (2024) · Forensic Science International: Digital Investigation · doi:10.1016/j.fsidi.2024.301795 · Cited by 30
Alabdulhafith, M., Saleh, H., Elmannai, H., Ali, Z. H., El-Sappagh, S., Hu, J.-W., & El-Rashidy, N. (2023) · IEEE Access · doi:10.1109/access.2023.3312343 · Cited by 27
MARBLE: Mining for Boilerplate Code to Identify API Usability Problems
Nam, D., Horvath, A., Macvean, A., Myers, B., & Vasilescu, B. (2019) · 2019 34th IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2019.00063 · Cited by 19
Root Cause and Liability Analysis in the Microservices Architecture for Edge IoT Services
Kalinagac, O., Soussi, W., Anser, Y., Gaber, C., & Gür, G. (2023) · ICC 2023 - IEEE International Conference on Communications · doi:10.1109/icc45041.2023.10279721 · Cited by 6
FFT-Based Efficient Algorithms for Time Delay Estimation
Wu, R., Wang, W., & Ji, Q. (2012) · Fourier Transform - Signal Processing · doi:10.5772/36242 · Cited by 2
Metadata
- Authors
- Moon, T. K.
- Venue
- IEEE Signal Processing Magazine
- Published
- 1996
- Volume
- 13
- Issue
- 6
- Pages
- 47-60
- ISSN
- 1053-5888 (ISSN-L)
- OpenAlex
- W1985690171
- Cited by
- 3,181
- References
- 32
- FWCI
- 16.82
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.