The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Foreground segmentation using convolutional neural networks for multiscale feature encoding
Open accessAbstract
Several methods have been proposed to solve moving objects segmentation problem accurately in different scenes. However, many of them lack the ability of handling various difficult scenarios such as illumination changes, background or camera motion, camouflage effect, shadow etc. To address these issues, we propose two robust encoder-decoder type neural networks that generate multi-scale feature encodings in different ways and can be trained end-to-end using only a few training samples. Using the same encoder-decoder configurations, in the first model, a triplet of encoders take the inputs in three scales to embed an image in a multi-scale feature space; in the second model, a Feature Pooling Module (FPM) is plugged on top of a single input encoder to extract multi-scale features in the middle layers. Both models use a transposed convolutional network in the decoder part to learn a mapping from feature space to image space. In order to evaluate our models, we entered the Change Detection 2014 Challenge (changedetection.net) and our models, namely FgSegNet_M and FgSegNet_S, outperformed all the existing state-of-the-art methods by an average F-Measure of 0.9770 and 0.9804, respectively. We also evaluate our models on SBI2015 and UCSD Background Subtraction datasets. Our source code is made publicly available at https://github.com/lim-anggun/FgSegNet .
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., & Adam, H. (2018) · arXiv · doi:10.48550/arxiv.1802.02611 · Cited by 20,063
Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., & Adam, H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_49 · Cited by 20,054
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1993.341010 · Cited by 14,265
Advances in Neural Information Processing Systems 25
Zhang, Y., Sutton, C. A., Storkey, A., & Zoubin Ghahramani, A. (2012) · Cited by 12,653
He, H., & Garcia, E. A. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2008.239 · Cited by 10,359 · cited 1×
“In a supervised training setting, the imbalanced number of training examples for different class categories may cause bias problems in classi-fication; this is an active research problem [33,34].”
BackgroundShow, Attend and Tell: Neural Image Caption Generation with Visual Attention
Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhutdinov, R., Zemel, R., & Bengio, Y. (2015) · arXiv · doi:10.48550/arxiv.1502.03044 · Cited by 8,248
Adaptive background mixture models for real-time tracking
Stauffer, C., & Grimson, W. E. L. (2003) · Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149) · doi:10.1109/cvpr.1999.784637 · Cited by 6,923
Show and tell: A neural image caption generator
Vinyals, O., Toshev, A., Bengio, S., & Erhan, D. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298935 · Cited by 6,318
Comparison of the predicted and observed secondary structure of T4 phage lysozyme
Matthews, B. W. (1975) · Biochimica et Biophysica Acta (BBA) - Protein Structure · doi:10.1016/0005-2795(75)90109-9 · Cited by 5,399 · cited 1×
“valuate model performances. However, as it is also claimed by [35], F-Measure is sensitive to imbalanced data since it does not incorporate true negatives into account. In [35], it is argued that MCC [36] is more suitable in imbalanced classes classication problems due to the incorporation of true negatives into consi…”
MethodDeep visual-semantic alignments for generating image descriptions
Karpathy, A., & Fei-Fei, L. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298932 · Cited by 4,902
Learning Hierarchical Features for Scene Labeling
Farabet, C., Couprie, C., Najman, L., & LeCun, Y. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.231 · Cited by 2,620
Fully Convolutional Networks for Semantic Segmentation
Long, J., Shelhamer, E., & Darrell, T. J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1411.4038 · Cited by 2,489
Recurrent Convolutional Neural Networks for Text Classification
Lai, S., Xu, L., Liu, K., & Zhao, J. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9513 · Cited by 2,280
A survey on vision-based human action recognition
Poppe, R. (2010) · Image and Vision Computing · doi:10.1016/j.imavis.2009.11.014 · Cited by 2,242
Editorial: special issue on learning from imbalanced data sets
Chawla, N. V., Japkowicz, N., & Kotcz, A. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007733 · Cited by 2,063
Improved adaptive Gaussian mixture model for background subtraction
Zivkovic, Z. (2004) · Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004. · doi:10.1109/icpr.2004.1333992 · Cited by 1,951
ViBe: A Universal Background Subtraction Algorithm for Video Sequences
Barnich, O., & Van Droogenbroeck, M. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2101613 · Cited by 1,885
Improved Adaptive Gaussian Mixture Model for Background Subtraction
Živković, Z. (2004) · Cited by 1,671
An Improved Adaptive Background Mixture Model for Real-time Tracking with Shadow Detection
KaewTraKulPong, P., & Bowden, R. (2002) · Video-Based Surveillance Systems · doi:10.1007/978-1-4615-0913-4_11 · Cited by 1,471
Efficient object localization using Convolutional Networks
Tompson, J., Goroshin, R., Jain, A., LeCun, Y., & Bregler, C. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298664 · Cited by 1,365
Optimal classifier for imbalanced data using Matthews Correlation Coefficient metric
Boughorbel, S., Jarray, F., & El-Anbari, M. (2017) · PLOS ONE · doi:10.1371/journal.pone.0177678 · Cited by 1,222 · cited 2×
“However, as it is also claimed by [35], F-Measure is sensitive to imbalanced data since it does not incorporate true negatives into account.”
BackgroundTranslating Videos to Natural Language Using Deep Recurrent Neural Networks
Venugopalan, S., Xu, H., Donahue, J., Rohrbach, M., Mooney, R., & Saenko, K. (2015) · Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.3115/v1/n15-1173 · Cited by 959
CDnet 2014: An Expanded Change Detection Benchmark Dataset
Wang, Y., Jodoin, P.-M., Porikli, F., Konrad, J., Benezeth, Y., & Ishwar, P. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2014.126 · Cited by 882
Recurrent Convolutional Neural Networks for Scene Labeling
Pinheiro, P. O., & Collobert, R. (2014) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 757
Robust techniques for background subtraction in urban traffic video
Cheung, S.-C. S., & Kamath, C. (2004) · SPIE Proceedings · doi:10.1117/12.526886 · Cited by 679
SuBSENSE: A Universal Change Detection Method With Local Adaptive Sensitivity
St-Charles, P.-L., Bilodeau, G.-A., & Bergevin, R. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2378053 · Cited by 653
Evaluation of background subtraction techniques for video surveillance
Brutzer, S., Hoferlin, B., & Heidemann, G. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995508 · Cited by 622
Spatiotemporal Saliency in Dynamic Scenes
Mahadevan, V., & Vasconcelos, N. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.112 · Cited by 409
A deep convolutional neural network for video sequence background subtraction
Babaee, M., Dinh, D. T., & Rigoll, G. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.09.040 · Cited by 406
Learning object motion patterns for anomaly detection and improved object detection
Basharat, A., Gritai, A., & Shah, M. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587510 · Cited by 373
Interactive deep learning method for segmenting moving objects
Wang, Y., Luo, Z., & Jodoin, P.-M. (2017) · Pattern Recognition Letters · doi:10.1016/j.patrec.2016.09.014 · Cited by 334
SPECIAL ISSUE ON LEARNING FROM IMBALANCED DATA SETS
Chawla, N. V., Japkowicz, N., & Kołcz, A. (2004) · Cited by 325
Deep background subtraction with scene-specific convolutional neural networks
Braham, M., & Van Droogenbroeck, M. (2016) · 2016 International Conference on Systems, Signals and Image Processing (IWSSIP) · doi:10.1109/iwssip.2016.7502717 · Cited by 313
A Self-Adjusting Approach to Change Detection Based on Background Word Consensus
St-Charles, P.-L., Bilodeau, G.-A., & Bergevin, R. (2015) · 2015 IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2015.137 · Cited by 211
End-to-end video background subtraction with 3d convolutional neural networks
Sakkos, D., Liu, H., Han, J., & Shao, L. (2017) · Multimedia Tools and Applications · doi:10.1007/s11042-017-5460-9 · Cited by 124
Background subtraction using encoder-decoder structured convolutional neural network
Lim, K., Jang, W.-D., & Kim, C. (2017) · IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2017.8078547 · Cited by 63
A Deep Convolutional Neural Network for Background SubtractionPreprint
Babaee, M., Dinh, D. T., & Rigoll, G. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.01731 · Cited by 54
Towards Benchmarking Scene Background InitializationPreprint
Maddalena, L., & Petrosino, A. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.04051 · Cited by 32
Zhu, S., & Xia, L. (2015) · Mathematical Problems in Engineering · doi:10.1155/2015/387464 · Cited by 18
Cited by
Bouwmans, T., Javed, S., Sultana, M., & Jung, S. K. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.04.024 · Cited by 396
Ammar, S., Bouwmans, T., Zaghden, N., & Neji, M. (2020) · IET Image Processing · doi:10.1049/iet-ipr.2019.0769 · Cited by 43
Unsupervised Anomaly Detection in Traffic Surveillance Based on Global Foreground Modeling
Shi, H., Ghahremannezhad, H., & Liu, C. (2022) · 2022 IEEE International Conference on Imaging Systems and Techniques (IST) · doi:10.1109/ist55454.2022.9827759 · Cited by 6
Metadata
- Authors
- Lim, L. A., & Yalim Keles, H.
- Venue
- Pattern Recognition Letters
- Publisher
- Elsevier BV
- Published
- 2018-09
- Volume
- 112
- Pages
- 256-262
- ISSN
- 0167-8655 (ISSN-L)
- OpenAlex
- W2783946051
- Cited by
- 305
- References
- 45
- FWCI
- 19.81
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.