Background Modeling using Mixture of Gaussians for Foreground Detection - A Survey
Open accessThe DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Abstract
Mixture of Gaussians is a widely used approach for background modeling to detect moving objects from static cameras. Numerous improvements of the original method developed by Stauffer and Grimson [1] have been proposed over the recent years and the purpose of this paper is to provide a survey and an original classification of these improvements. We also discuss relevant issues to reduce the computation time. Firstly, the original MOG are reminded and discussed following the challenges met in video sequences. Then, we categorize the different improvements found in the literature. We have classified them in term of strategies used to improve the original MOG and we have discussed them in term of the critical situations they claim to handle. After analyzing the strategies and identifying their limitations, we conclude with several promising directions for future research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Adaptive background mixture models for real-time tracking
Stauffer, C., & Grimson, W. E. L. (2003) · Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149) · doi:10.1109/cvpr.1999.784637 · Cited by 6,923
The relationship between Precision-Recall and ROC curves
Davis, J., & Goadrich, M. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143874 · Cited by 6,559
Pfinder: real-time tracking of the human body
Wren, C. R., Azarbayejani, A., Darrell, T., & Pentland, A. P. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.598236 · Cited by 4,169
Learning patterns of activity using real-time tracking
Stauffer, C., & Grimson, W. E. L. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.868677 · Cited by 3,248
Non-parametric Model for Background Subtraction
Elgammal, A., Harwood, D., & Davis, L. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-45053-x_48 · Cited by 2,118
Background subtraction techniques: a review
Piccardi, M. (2005) · 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583) · doi:10.1109/icsmc.2004.1400815 · Cited by 2,083
Wallflower: principles and practice of background maintenance
Toyama, K., Krumm, J., Brumitt, B., & Meyers, B. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.791228 · Cited by 1,696
Improved Adaptive Gaussian Mixture Model for Background Subtraction
Živković, Z. (2004) · Cited by 1,671
An Improved Adaptive Background Mixture Model for Real-time Tracking with Shadow Detection
KaewTraKulPong, P., & Bowden, R. (2002) · Video-Based Surveillance Systems · doi:10.1007/978-1-4615-0913-4_11 · Cited by 1,471
Real-time foreground–background segmentation using codebook model
Kim, K., Chalidabhongse, T. H., Harwood, D., & Davis, L. (2005) · Real-Time Imaging · doi:10.1016/j.rti.2004.12.004 · Cited by 1,422
Statistical Modeling of Complex Backgrounds for Foreground Object Detection
Li, L., Huang, W., Gu, I. Y.-H., & Tian, Q. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2004.836169 · Cited by 991
A Statistical Approach for Real-time Robust Background Subtraction and Shadow Detection
Horprasert, T. (1999) · IEEE/CVF International Conference on Computer Vision (ICCV) · Cited by 944
Image Segmentation in Video Sequences: A Probabilistic Approach
Friedman, N., & Russell, S. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1302.1539 · Cited by 833
Effective Gaussian mixture learning for video background subtraction
Lee, D.-S. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.102 · Cited by 823
Robust analysis of feature spaces: color image segmentation
Comaniciu, D., & Meer, P. (2002) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.1997.609410 · Cited by 683
Segmentation and tracking of piglets in images
McFarlane, N. J. B., & Schofield, C. P. (1995) · Machine Vision and Applications · doi:10.1007/bf01215814 · Cited by 559
Free-viewpoint video of human actors
Carranza, J., Theobalt, C., Magnor, M. A., & Seidel, H.-P. (2003) · ACM SIGGRAPH 2003 Papers · doi:10.1145/1201775.882309 · Cited by 482
Moving Object Detection in Spatial Domain using Background Removal Techniques - State-of-Art
Elhabian, S. Y., El-Sayed, K. M., & Ahmed, S. H. (2010) · Recent Patents on Computer Science · doi:10.2174/1874479610801010032 · Cited by 385
A Study of Global Optimization Using Particle Swarms
Schutte, J. F., & Groenwold, A. A. (2005) · Journal of Global Optimization · doi:10.1007/s10898-003-6454-x · Cited by 367
Human Body Model Acquisition and Tracking Using Voxel Data
Mikić, I., Trivedi, M., Hunter, E., & Cosman, P. (2003) · International Journal of Computer Vision · doi:10.1023/a:1023012723347 · Cited by 291
Performance evaluation of object detection algorithms for video surveillance
Nascimento, J. C., & Marques, J. S. (2006) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2006.876287 · Cited by 283
Understanding Background Mixture Models for Foreground Segmentation
Power, P. W., & Schoonees, J. A. (2002) · Cited by 263
Tracking multiple vehicles using foreground, background and motion models
Magee, D. R. (2004) · Image and Vision Computing · doi:10.1016/s0262-8856(03)00145-8 · Cited by 231
Robust and Efficient Foreground Analysis for Real-Time Video Surveillance
Tian, Y.-L., Lu, M., & Hampapur, A. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.304 · Cited by 231
A Framework for High-Level Feedback to Adaptive, Per-Pixel, Mixture-of-Gaussian Background Models
Harville, M. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-47977-5_36 · Cited by 214
Foreground segmentation using adaptive mixture models in color and depth
Harville, M., Gordon, G., & Woodfill, J. (2002) · Proceedings IEEE Workshop on Detection and Recognition of Events in Video · doi:10.1109/event.2001.938860 · Cited by 213
Efficiently solving dynamic Markov random fields using graph cuts
Kohli, P., & Torr, P. H. S. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.81 · Cited by 173
Scene modeling for wide area surveillance and image synthesis
Mittal, A., & Huttenlocher, D. P. (2002) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2000.854767 · Cited by 125
Fuzzy integral for moving object detection
Baf, F. E., Bouwmans, T., & Vachon, B. (2008) · IEEE International Conference on Fuzzy Systems (FUZZ-IEEE) · doi:10.1109/fuzzy.2008.4630604 · Cited by 124
Self-citationType-2 Fuzzy Mixture of Gaussians Model: Application to Background Modeling
Baf, F. E., Bouwmans, T., & Vachon, B. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-89639-5_74 · Cited by 121
Self-citationKaewtrakulpong, P., & Bowden, R. (2003) · Image and Vision Computing · doi:10.1016/s0262-8856(03)00076-3 · Cited by 121
Fuzzy Running Average and Fuzzy Background Subtraction: Concepts and Application
Sigari, M. H., Mozayani, N., & Pourreza, H. R. (2008) · Cited by 117
Modified GMM Background Modeling and Optical Flow for Detection of Moving Objects
Zhou, D., & Zhang, H. (2006) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2005.1571479 · Cited by 109
Extracting Roadway Background Image: Mode-Based Approach
Zheng, J., Wang, Y., Nihan, N. L., & Hallenbeck, M. E. (2006) · Transportation Research Record Journal of the Transportation Research Board · doi:10.3141/1944-11 · Cited by 107
Fusing Color and Texture Features for Background Model
Zhang, H., & Xu, D. (2006) · Lecture notes in computer science · doi:10.1007/11881599_110 · Cited by 94
Dynamic Control of Adaptive Mixture-of-Gaussians Background Model
Shimada, A., Arita, D., & Taniguchi, R.-I. (2006) · doi:10.1109/avss.2006.44 · Cited by 92
A Kalman Filter Based Background Updating Algorithm Robust to Sharp Illumination Changes
Messelodi, S., Modena, C. M., Segata, N., & Zanin, M. (2005) · Lecture notes in computer science · doi:10.1007/11553595_20 · Cited by 90
Vision modules for a multi-sensory bridge monitoring approach
Chang, R., Gandhi, T., & Trivedi, M. M. (2005) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2004.1399038 · Cited by 67
Integrated region- and pixel-based approach to background modelling
Cristani, M., Bicego, M., & Murino, V. (2003) · IEEE Workshop on Motion and Video Computing · doi:10.1109/motion.2002.1182206 · Cited by 55
Hand Image Segmentation in Video Sequence by GMM: a comparative analysis
Ribeiro, H. L., & Gonzaga, A. (2006) · Proceedings - Brazilian Symposium on Computer Graphics and Image Processing/Proceedings · doi:10.1109/sibgrapi.2006.23 · Cited by 53
A single-chip FPGA implementation of real-time adaptive background model
Appiah, K., & Hunter, A. (2006) · International Conference on Field-Programmable Technology (FPT) · doi:10.1109/fpt.2005.1568531 · Cited by 50
Haque, M., Murshed, M., & Paul, M. (2008) · IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2008.12 · Cited by 49
Multispectral Object Segmentation and Retrieval in Surveillance Video
Conaire, C. Ó., O'Connor, N. E., Cooke, E., & Smeaton, A. F. (2006) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2006.312905 · Cited by 45
Pentland, A., Wren, C. R., Harwood, D., Haritaoğlu, I., Davis, L. S., & Horprasert, T. (1998) · Cited by 43
Robust Foreground Extraction Technique Using Gaussian Family Model and Multiple Thresholds
Kim, H., Sakamoto, R., Kitahara, I., Toriyama, T., & Kogure, K. (2007) · Springer eBooks · doi:10.1007/978-3-540-76386-4_72 · Cited by 42
DETER: Detection of events for threat evaluation and recognition
Morellas, V., Pavlidis, I. T., & Tsiamyrtzis, P. (2003) · Machine Vision and Applications · doi:10.1007/s00138-003-0121-6 · Cited by 42
Background Modeling Based on Subpixel Edges
Jain, V. K., Kimia, B. B., & Mundy, J. L. (2007) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2007.4379586 · Cited by 35
COMPARISON OF BACKGROUND SUBTRACTION METHODS FOR A MULTIMEDIA LEARNING SPACE
Baf, F. E., Bouwmans, T., & Vachon, B. (2007) · International Conference on Signal Processing and Multimedia Applications · doi:10.5220/0002134201490154 · Cited by 33
Self-citationRobust Silhouette Extraction Technique Using Background Subtraction
Kim, H., Sakamoto, R., Kitahara, I., et al. (2007) · Cited by 28
Traffic Video Segmentation Using Adaptive-K Gaussian Mixture Model
Tan, R., Huo, H., Qian, J., & Fang, T. (2006) · Lecture notes in computer science · doi:10.1007/11821045_13 · Cited by 24
Online Adaptive Gaussian Mixture Learning for Video Applications
Lee, D.-S. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-30212-4_10 · Cited by 20
A Gaussian-Mixture Based Approach To Spatial Image Background Modeling And Compensation
Saranlı, A. (2007) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.40500 · Cited by 3
Cited by
CDnet 2014: An Expanded Change Detection Benchmark Dataset
Wang, Y., Jodoin, P.-M., Porikli, F., Konrad, J., Benezeth, Y., & Ishwar, P. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2014.126 · Cited by 882
Changedetection.net: A new change detection benchmark dataset
Goyette, N., Jodoin, P.-M., Porikli, F., Konrad, J., & Ishwar, P. (2012) · 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2012.6238919 · Cited by 807
Traditional and recent approaches in background modeling for foreground detection: An overview
Bouwmans, T. (2014) · Computer Science Review · doi:10.1016/j.cosrev.2014.04.001 · Cited by 676
Self-citationA comprehensive review of background subtraction algorithms evaluated with synthetic and real videos
Sobral, A., & Vacavant, A. (2014) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2013.12.005 · Cited by 654
Evaluation of background subtraction techniques for video surveillance
Brutzer, S., Hoferlin, B., & Heidemann, G. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995508 · Cited by 622
Metadata
- Authors
- Bouwmans, T., El Baf, F., & Vachon, B.
- Venue
- Recent Patents on Computer Science
- Publisher
- Bentham Science Publishers Ltd.
- Published
- 2010-01-09
- Volume
- 1
- Issue
- 3
- Pages
- 219-237
- ISSN
- 1874-4796 (ISSN-L)
- OpenAlex
- W2065441822
- Cited by
- 374
- References
- 53
- FWCI
- 37.96
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.