The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
SuBSENSE: A Universal Change Detection Method With Local Adaptive Sensitivity
Abstract
Foreground/background segmentation via change detection in video sequences is often used as a stepping stone in high-level analytics and applications. Despite the wide variety of methods that have been proposed for this problem, none has been able to fully address the complex nature of dynamic scenes in real surveillance tasks. In this paper, we present a universal pixel-level segmentation method that relies on spatiotemporal binary features as well as color information to detect changes. This allows camouflaged foreground objects to be detected more easily while most illumination variations are ignored. Besides, instead of using manually set, frame-wide constants to dictate model sensitivity and adaptation speed, we use pixel-level feedback loops to dynamically adjust our method's internal parameters without user intervention. These adjustments are based on the continuous monitoring of model fidelity and local segmentation noise levels. This new approach enables us to outperform all 32 previously tested state-of-the-art methods on the 2012 and 2014 versions of the ChangeDetection.net dataset in terms of overall F-Measure. The use of local binary image descriptors for pixel-level modeling also facilitates high-speed parallel implementations: our own version, which used no low-level or architecture-specific instruction, reached real-time processing speed on a midlevel desktop CPU. A complete C++ implementation based on OpenCV is available online.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adaptive background mixture models for real-time tracking
Stauffer, C., & Grimson, W. E. L. (2003) · Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149) · doi:10.1109/cvpr.1999.784637 · Cited by 6,923
Non-parametric Model for Background Subtraction
Elgammal, A., Harwood, D., & Davis, L. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-45053-x_48 · Cited by 2,118
Improved adaptive Gaussian mixture model for background subtraction
Zivkovic, Z. (2004) · Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004. · doi:10.1109/icpr.2004.1333992 · Cited by 1,951
ViBe: A Universal Background Subtraction Algorithm for Video Sequences
Barnich, O., & Van Droogenbroeck, M. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2101613 · Cited by 1,885
Wallflower: principles and practice of background maintenance
Toyama, K., Krumm, J., Brumitt, B., & Meyers, B. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.791228 · Cited by 1,696
Improved Adaptive Gaussian Mixture Model for Background Subtraction
Živković, Z. (2004) · Cited by 1,671
A Bayesian computer vision system for modeling human interactions
Oliver, N. M., Rosario, B., & Pentland, A. P. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.868684 · Cited by 1,578
Efficient adaptive density estimation per image pixel for the task of background subtraction
Zivkovic, Z., & van der Heijden, F. (2006) · Pattern Recognition Letters · doi:10.1016/j.patrec.2005.11.005 · Cited by 1,557
An Improved Adaptive Background Mixture Model for Real-time Tracking with Shadow Detection
KaewTraKulPong, P., & Bowden, R. (2002) · Video-Based Surveillance Systems · doi:10.1007/978-1-4615-0913-4_11 · Cited by 1,471
A texture-based method for modeling the background and detecting moving objects
Heikkila, M., & Pietikainen, M. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.68 · Cited by 1,249
CDnet 2014: An Expanded Change Detection Benchmark Dataset
Wang, Y., Jodoin, P.-M., Porikli, F., Konrad, J., Benezeth, Y., & Ishwar, P. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2014.126 · Cited by 882
Image Segmentation in Video Sequences: A Probabilistic Approach
Friedman, N., & Russell, S. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1302.1539 · Cited by 833
Effective Gaussian mixture learning for video background subtraction
Lee, D.-S. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.102 · Cited by 823
Changedetection.net: A new change detection benchmark dataset
Goyette, N., Jodoin, P.-M., Porikli, F., Konrad, J., & Ishwar, P. (2012) · 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2012.6238919 · Cited by 807
A Self-Organizing Approach to Background Subtraction for Visual Surveillance Applications
Maddalena, L., & Petrosino, A. (2008) · IEEE Transactions on Image Processing · doi:10.1109/tip.2008.924285 · Cited by 786
Bayesian modeling of dynamic scenes for object detection
Sheikh, Y., & Shah, M. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.213 · Cited by 637
Evaluation of background subtraction techniques for video surveillance
Brutzer, S., Hoferlin, B., & Heidemann, G. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995508 · Cited by 622
Motion-based background subtraction using adaptive kernel density estimation
Mittal, A., & Paragios, N. (2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315179 · Cited by 590
Background segmentation with feedback: The Pixel-Based Adaptive Segmenter
Hofmann, M., Tiefenbacher, P., & Rigoll, G. (2012) · 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2012.6238925 · Cited by 579
Background modeling and subtraction by codebook construction
Kim, K., Chalidabhongse, T. H., Harwood, D., & Davis, L. S. (2005) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2004.1421759 · Cited by 382
Liao, S., Zhao, G., Kellokumpu, V., Pietikainen, M., & Li, S. Z. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539817 · Cited by 380
Independent Component Analysis-Based Background Subtraction for Indoor Surveillance
Tsai, D.-M., & Lai, S.-C. (2009) · IEEE Transactions on Image Processing · doi:10.1109/tip.2008.2007558 · Cited by 279
Static and Moving Object Detection Using Flux Tensor with Split Gaussian Models
Wang, R., Bunyak, F., Seetharaman, G., & Palaniappan, K. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2014.68 · Cited by 217
Background Subtraction with DirichletProcess Mixture Models
Haines, T. S. F., & Xiang, T. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.239 · Cited by 211
A consensus-based method for tracking: Modelling background scenario and foreground appearance
Wang, H., & Suter, D. (2007) · Pattern Recognition · doi:10.1016/j.patcog.2006.05.024 · Cited by 163
Improving background subtraction using Local Binary Similarity Patterns
St-Charles, P.-L., & Bilodeau, G.-A. (2014) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2014.6836059 · Cited by 154
Self-citationFlexible Background Subtraction with Self-Balanced Local Sensitivity
St-Charles, P.-L., Bilodeau, G.-A., & Bergevin, R. (2014) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2014.67 · Cited by 114
Self-citationChange Detection in Feature Space Using Local Binary Similarity Patterns
Bilodeau, G.-A., Jodoin, J.-P., & Saunier, N. (2013) · Canadian Conference on Computer and Robot Vision · doi:10.1109/crv.2013.29 · Cited by 109
Self-citationDynamic background modeling and subtraction using spatio-temporal local binary patterns
Zhang, S., Yao, H., & Liu, S. (2008) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2008.4712065 · Cited by 105
Improving foreground segmentations with probabilistic superpixel Markov random fields
Schick, A., Bäuml, M., & Stiefelhagen, R. (2012) · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2012.6238923 · Cited by 99
Background Subtraction for Moving Cameras
Bouwmans, T., Porikli, F., Höferlin, B., & Vacavant, A. (2014) · Chapman & Hall/CRC eBooks · doi:10.1201/b17223-10 · Cited by 35
Learning a background model for change detection
Morde, A., Ma, X., & Guler, S. (2012) · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2012.6238921 · Cited by 32
Background Subtraction on Embedded Hardware
Bouwmans, T., Porikli, F., Höferlin, B., & Vacavant, A. (2014) · Chapman & Hall/CRC eBooks · doi:10.1201/b17223-30 · Cited by 20
Cited by
Recognition in Terra Incognita
Beery, S., Van Horn, G., & Perona, P. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01270-0_28 · Cited by 679
A deep convolutional neural network for video sequence background subtraction
Babaee, M., Dinh, D. T., & Rigoll, G. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.09.040 · Cited by 406
Robust Subspace Learning: Robust PCA, Robust Subspace Tracking, and Robust Subspace Recovery
Vaswani, N., Bouwmans, T., Javed, S., & Narayanamurthy, P. (2018) · IEEE Signal Processing Magazine · doi:10.1109/msp.2018.2826566 · Cited by 356
Interactive deep learning method for segmenting moving objects
Wang, Y., Luo, Z., & Jodoin, P.-M. (2017) · Pattern Recognition Letters · doi:10.1016/j.patrec.2016.09.014 · Cited by 334
Deep background subtraction with scene-specific convolutional neural networks
Braham, M., & Van Droogenbroeck, M. (2016) · 2016 International Conference on Systems, Signals and Image Processing (IWSSIP) · doi:10.1109/iwssip.2016.7502717 · Cited by 313
Metadata
- Authors
- St-Charles, P.-L., Bilodeau, G.-A., & Bergevin, R.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2015-01
- Volume
- 24
- Issue
- 1
- Pages
- 359-373
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W1994634851
- Cited by
- 653
- References
- 33
- FWCI
- 39.76
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.