The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Fast Video Object Segmentation by Reference-Guided Mask Propagation
Abstract
We present an efficient method for the semi-supervised video object segmentation. Our method achieves accuracy competitive with state-of-the-art methods while running in a fraction of time compared to others. To this end, we propose a deep Siamese encoder-decoder network that is designed to take advantage of mask propagation and object detection while avoiding the weaknesses of both approaches. Our network, learned through a two-stage training process that exploits both synthetic and real data, works robustly without any online learning or post-processing. We validate our method on four benchmark sets that cover single and multiple object segmentation. On all the benchmark sets, our method shows comparable accuracy while having the order of magnitude faster runtime. We also provide extensive ablation and add-on studies to analyze and evaluate our framework.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.322 · Cited by 29,137
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2016) · arXiv · doi:10.48550/arxiv.1606.00915 · Cited by 22,392
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2699184 · Cited by 22,392
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599
Identity mappings in deep residual networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_38 · Cited by 10,741
Identity Mappings in Deep Residual Networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · arXiv · doi:10.48550/arxiv.1603.05027 · Cited by 10,665
Backpropagation through time: what it does and how to do it
Werbos, P. J. (1990) · Proceedings of the IEEE · doi:10.1109/5.58337 · Cited by 4,879
Global contrast based salient region detection
Cheng, M.-M., Zhang, G.-X., Mitra, N. J., Huang, X., & Hu, S.-M. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995344 · Cited by 2,976
Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials
Krähenbühl, P., & Koltun, V. (2012) · arXiv · doi:10.48550/arxiv.1210.5644 · Cited by 2,908
Global Contrast Based Salient Region Detection
Cheng, M.-M., Mitra, N. J., Huang, X., Torr, P. H. S., & Hu, S.-M. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2345401 · Cited by 2,463
A Benchmark Dataset and Evaluation Methodology for Video Object Segmentation
Perazzi, F., Pont-Tuset, J., McWilliams, B., Van Gool, L., Gross, M., & Sorkine-Hornung, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.85 · Cited by 1,989
Large Kernel Matters — Improve Semantic Segmentation by Global Convolutional Network
Peng, C., Zhang, X., Yu, G., Luo, G., & Sun, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.189 · Cited by 1,750
Semantic contours from inverse detectors
Hariharan, B., Arbelaez, P., Bourdev, L., Maji, S., & Malik, J. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126343 · Cited by 1,624
Fully Convolutional Instance-Aware Semantic Segmentation
Li, Y., Qi, H., Dai, J., Ji, X., & Wei, Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.472 · Cited by 1,116
One-Shot Video Object Segmentation
Caelles, S., Maninis, K.-K., Pont-Tuset, J., Leal-Taixe, L., Cremers, D., & Van Gool, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.565 · Cited by 927
Object Segmentation by Long Term Analysis of Point Trajectories
Brox, T., & Malik, J. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15555-0_21 · Cited by 744
Learning to Refine Object Segments
Pinheiro, P. O., Lin, T.-Y., Collobert, R., & Dollár, P. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_5 · Cited by 731
Efficient hierarchical graph-based video segmentation
Grundmann, M., Kwatra, V., Han, M., & Essa, I. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539893 · Cited by 628
Learning Video Object Segmentation from Static Images
Perazzi, F., Khoreva, A., Benenson, R., Schiele, B., & Sorkine-Hornung, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.372 · Cited by 581
Hierarchical Image Saliency Detection on Extended CSSD
Shi, J., Yan, Q., Xu, L., & Jia, J. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2465960 · Cited by 574
Saliency-aware geodesic video object segmentation
Wang, W., Shen, J., & Porikli, F. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298961 · Cited by 524
Video Segmentation by Tracking Many Figure-Ground Segments
Li, F., Kim, T., Humayun, A., Tsai, D., & Rehg, J. M. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.273 · Cited by 512
SegFlow: Joint Learning for Video Object Segmentation and Optical Flow
Cheng, J., Tsai, Y.-H., Wang, S., & Yang, M.-H. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.81 · Cited by 446
Online Adaptation of Convolutional Neural Networks for Video Object Segmentation
Voigtlaender, P., & Leibe, B. (2017) · Procedings of the British Machine Vision Conference 2017 · doi:10.5244/c.31.116 · Cited by 443
Video SnapCut: robust video object cutout using localized classifiers
Bai, X., Wang, J., Simons, D., & Sapiro, G. (2009) · ACM Transactions on Graphics · doi:10.1145/1531326.1531376 · Cited by 367
Video Object Segmentation without Temporal Information
Maninis, K.-K., Caelles, S., Chen, Y., Pont-Tuset, J., Leal-Taixe, L., Cremers, D., & Van Gool, L. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2838670 · Cited by 354
Wang, J., Bhat, P., Colburn, R. A., Agrawala, M., & Cohen, M. F. (2005) · ACM Transactions on Graphics · doi:10.1145/1073204.1073233 · Cited by 321
Video Segmentation via Object Flow
Tsai, Y.-H., Yang, M.-H., & Black, M. J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.423 · Cited by 318
Learning Video Object Segmentation with Visual Memory
Tokmakov, P., Alahari, K., & Schmid, C. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.480 · Cited by 316
Learning Motion Patterns in Videos
Tokmakov, P., Alahari, K., & Schmid, C. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.64 · Cited by 267
Weakly-supervised Disentangling with Recurrent Transformations for 3D View Synthesis
Yang, J., Reed, S., Yang, M., & Lee, H. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1601.00706 · Cited by 246
Jampani, V., Gadde, R., & Gehler, P. V. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.336 · Cited by 224
Motion Coherent Tracking Using Multi-label MRF Optimization
Tsai, D., Flagg, M., Nakazawa, A., & Rehg, J. M. (2012) · International Journal of Computer Vision · doi:10.1007/s11263-011-0512-5 · Cited by 216
Bilateral Space Video Segmentation
Marki, N., Perazzi, F., Wang, O., & Sorkine-Hornung, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.87 · Cited by 208
Pixel-Level Matching for Video Object Segmentation Using Convolutional Neural Networks
Yoon, J. S., Rameau, F., Kim, J., Lee, S., Shin, S., & Kweon, I. S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.238 · Cited by 188
Fan, Q., Zhong, F., Lischinski, D., Cohen‐Or, D., & Chen, B. (2015) · ACM Transactions on Graphics · doi:10.1145/2816795.2818105 · Cited by 125
SeamSeg: Video Object Segmentation Using Patch Seams
Ramakanth, S. A., & Babu, R. V. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.55 · Cited by 121
Online Video Object Segmentation via Convolutional Trident Network
Jang, W.-D., & Kim, C. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.790 · Cited by 116
Learning Video Object Segmentation from Static ImagesPreprint
Khoreva, A., Perazzi, F., Benenson, R., Schiele, B., & Sorkine‐Hornung, A. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.02646 · Cited by 102
Wang, J., Bhat, P., Colburn, A., Agrawala, M., & Cohen, M. F. (2005) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1186822.1073233 · Cited by 93
Lucid Data Dreaming for Object Tracking
Khoreva, A., Benenson, R., Ilg, E., Brox, T., & Schiele, B. (2017) · MPG.PuRe (Max Planck Society) · Cited by 92
Roto++: accelerating professional rotoscoping using shape manifolds
Li, W., Viola, F., Starck, J., Brostow, G., & Campbell, N. D. F. (2016) · ACM Transactions on Graphics · doi:10.1145/2897824.2925973 · Cited by 44
Discontinuity-aware video object cutout
Zhong, F., Qin, X., Peng, Q., & Meng, X. (2012) · ACM Transactions on Graphics · doi:10.1145/2366145.2366194 · Cited by 39
Cited by
Fast Online Object Tracking and Segmentation: A Unifying Approach
Wang, Q., Zhang, L., Bertinetto, L., Hu, W., & Torr, P. H. S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00142 · Cited by 1,554
Video Object Segmentation Using Space-Time Memory Networks
Oh, S. W., Lee, J.-Y., Xu, N., & Kim, S. J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00932 · Cited by 745
Self-citationSG-One: Similarity Guidance Network for One-Shot Semantic Segmentation
Zhang, X., Wei, Y., Yang, Y., & Huang, T. S. (2020) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2020.2992433 · Cited by 570
FEELVOS: Fast End-To-End Embedding Learning for Video Object Segmentation
Voigtlaender, P., Chai, Y., Schroff, F., Adam, H., Leibe, B., & Chen, L.-C. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00971 · Cited by 468
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model
Cheng, H. K., & Schwing, A. G. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-19815-1_37 · Cited by 449
Metadata
- Authors
- Oh, S. W., Lee, J.-Y., Sunkavalli, K., & Kim, S. J.
- Venue
- 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
- Publisher
- IEEE
- Published
- 2018-06
- Pages
- 7376-7385
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2799157347
- Cited by
- 420
- References
- 48
- FWCI
- 15.15
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.