The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Online Adaptation of Convolutional Neural Networks for Video Object Segmentation
Open accessAbstract
We tackle the task of semi-supervised video object segmentation, i.e. segmenting the pixels belonging to an object in the video using the ground truth pixel mask for the first frame. We build on the recently introduced one-shot video object segmentation (OSVOS) approach which uses a pretrained network and fine-tunes it on the first frame. While achieving impressive performance, at test time OSVOS uses the fine-tuned network in unchanged form and is not able to adapt to large changes in object appearance. To overcome this limitation, we propose Online Adaptive Video Object Segmentation (OnAVOS) which updates the network online using training examples selected based on the confidence of the network and the spatial configuration. Additionally, we add a pretraining step based on objectness, which is learned on PASCAL. Our experiments show that both extensions are highly effective and improve the state of the art on DAVIS to an intersection-over-union score of 85.7%.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“To address the above challenges, adopting a memory architecture to store the object information from past frames is indispensable for accurately tracking objects in video [5,7,10,29,40,52,56,57,64,66,68].”
From SAM2LONG: Enhancing SAM 2 for Long Video Segmentation with a Training-Free Memory Tree (2025) · cites this paper as [56]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466
Multi-scale context aggregation by dilated convolutions
Yu, F., & Koltun, V. (2015) · arXiv · doi:10.48550/arxiv.1511.07122 · Cited by 7,738
The Pascal Visual Object Classes Challenge: A Retrospective
Everingham, M., Eslami, S. M. A., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-014-0733-5 · Cited by 7,139
Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials
Krähenbühl, P., & Koltun, V. (2012) · arXiv · doi:10.48550/arxiv.1210.5644 · Cited by 2,908
Learning Multi-domain Convolutional Neural Networks for Visual Tracking
Nam, H., & Han, B. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.465 · Cited by 2,806
A Benchmark Dataset and Evaluation Methodology for Video Object Segmentation
Perazzi, F., Pont-Tuset, J., McWilliams, B., Gool, L. V., Groß, M. H., & Sorkine‐Hornung, A. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.85 · Cited by 2,039
Semantic contours from inverse detectors
Hariharan, B., Arbeláez, P., Bourdev, L. D., Maji, S., & Malik, J. (2011) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2011.6126343 · Cited by 1,743
Learning to Track at 100 FPS with Deep Regression Networks
Held, D., Thrun, S., & Savarese, S. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_45 · Cited by 1,199
Gräbner, H., & Bischof, H. (2006) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2006.215 · Cited by 998
Learning a Deep Compact Image Representation for Visual Tracking
Wang, N., & Yeung, D. (2013) · Rare & Special e-Zone (The Hong Kong University of Science and Technology) · Cited by 836
Learning Video Object Segmentation from Static Images
Perazzi, F., Khoreva, A., Benenson, R., Schiele, B., & Sorkine‐Hornung, A. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.372 · Cited by 616
Full-Resolution Residual Networks for Semantic Segmentation in Street Scenes
Pohlen, T., Hermans, A., Mathias, M., & Leibe, B. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.353 · Cited by 600
Self-citationLearning object class detectors from weakly annotated video
Prest, A., Leistner, C., Civera, J., Schmid, C., & Ferrari, V. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6248065 · Cited by 434
Bai, X., Wang, J., Simons, D., & Sapiro, G. (2009) · ACM Transactions on Graphics · doi:10.1145/1531326.1531376 · Cited by 365
Interactive deep learning method for segmenting moving objects
Wang, Y., Luo, Z., & Jodoin, P. (2016) · Pattern Recognition Letters · doi:10.1016/j.patrec.2016.09.014 · Cited by 331
Deep background subtraction with scene-specific convolutional neural networks
Braham, M., & Droogenbroeck, M. V. (2016) · International Conference on Systems, Signals and Image Processing · doi:10.1109/iwssip.2016.7502717 · Cited by 321
DeepTrack: Learning Discriminative Feature Representations Online for Robust Visual Tracking
Li, H., Li, Y., & Porikli, F. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2510583 · Cited by 285
Learning Motion Patterns in Videos
Tokmakov, P., Alahari, K., & Schmid, C. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.64 · Cited by 272
Supervoxel-Consistent Foreground Propagation in Video
Jain, S. D., & Grauman, K. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10593-2_43 · Cited by 231
Jampani, V., Gadde, R., & Gehler, P. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.336 · Cited by 229
Wider or Deeper: Revisiting the ResNet Model for Visual RecognitionPreprint
Wu, Z., Shen, C., & van den Hengel, A. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.10080 · Cited by 217
Bilateral Space Video Segmentation
Marki, N., Perazzi, F., Wang, O., & Sorkine‐Hornung, A. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.87 · Cited by 209
Fully Connected Object Proposals for Video Segmentation
Perazzi, F., Wang, O., Groß, M. H., & Sorkine‐Hornung, A. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.369 · Cited by 171
Bridging Category-level and Instance-level Semantic Image SegmentationPreprint
Wu, Z., Shen, C., & van den Hengel, A. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.06885 · Cited by 148
Jain, S. D., Xiong, B., & Grauman, K. L. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.05384 · Cited by 137
Fan, Q., Zhong, F., Lischinski, D., Cohen‐Or, D., & Chen, B. (2015) · ACM Transactions on Graphics · doi:10.1145/2816795.2818105 · Cited by 125
SeamSeg: Video Object Segmentation Using Patch Seams
Ramakanth, S. A., & Babu, R. V. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.55 · Cited by 121
A Deep Convolutional Neural Network for Background SubtractionPreprint
Babaee, M., Dinh, D. T., & Rigoll, G. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.01731 · Cited by 54
Super-Trajectory for Video Segmentation
Wang, W.-G., Shen, J.-B., Xie, J., & Porikli, F. (2017) · IEEE International Conference on Computer Vision · doi:10.1109/iccv.2017.185 · Cited by 50
Online Learning for Fast Segmentation of Moving Objects
Ellis, L., & Zografos, V. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-37444-9_5 · Cited by 9
Flagged first, then by citations
Research works printed but not linked: 12
- [4][4] X. Bai, J. Wang, and G. Sapiro. Dynamic color flow: A motion-adaptive color model for object segmentation in video. In ECCV , 2010. -
- [5][5] L. Bertinetto, J. Valmadre, J. F. Henriques, A. Vedaldi, and P. H. S. Torr. Fullyconvolutional siamese networks for object tracking. In ECCV Workshops , 2016. -
- [6][6] M. Braham and M. Van Droogenbroeck. Deep background subtraction with scenespecific convolutional neural networks. In Int. Conf. on Systems, Signals and Image Proc. , 2016. -
- [7][7] S. Caelles, K.-K. Maninis, J. Pont-Tuset, L. Leal-Taixé, D. Cremers, and L. Van Gool. One-shot video object segmentation. In CVPR , 2017. -
- [8][8] J. Chang, D. Wei, and J. W. Fisher III. A video representation using temporal superpixels. In CVPR , 2013. -
- [12][12] Q. Fan, F. Zhong, D. Lischinski, D. Cohen-Or, and B. Chen. Jumpcut: Non-successive mask transfer and interpolation for video cutout. SIGGRAPH Asia , 34(6), 2015. -
- [15][15] M. Grundmann, V. Kwatra, M. Han, and I. Essa. Efficient hierarchical graph-based video segmentation. In CVPR , 2010. -
- [21][21] S. D. Jain, B. Xiong, and K. Grauman. Pixel objectness. arXiv preprint arXiv:1701.05349 , 2017. - · arXiv
- [23][23] Z. Kalal, K. Mikolajczyk, and J. Matas. Tracking-learning-detection. PAMI , 34(7): 1409-1422, 2012. -
- [24][24] A. Khoreva, R. Benenson, E. Ilg, T. Brox, and B. Schiele. Lucid data dreaming for object tracking. In arXiv preprint arXiv: 1703.09554 , 2017. - · arXiv
- [32][32] K. E. Papoutsakis and A. A. Argyros. Integrating tracking with fine object segmentation. Image and Vision Computing , 31(10):771-785, 2013. -
- [41][41] Y-H. Tsai, M-H. Yang, and M. J. Black. Video segmentation via object flow. In CVPR , 2016. -
Cited by
Sorted by citations
Fast Online Object Tracking and Segmentation: A Unifying Approach
Wang, Q., Zhang, L., Bertinetto, L., Hu, W., & Torr, P. H. S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00142 · Cited by 1,554
Video Object Segmentation Using Space-Time Memory Networks
Oh, S. W., Lee, J., Xu, N., & Kim, S. J. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00932 · Cited by 775
The 2018 DAVIS Challenge on Video Object SegmentationPreprint
Caelles, S., Montes, A., Maninis, K.-K., Chen, Y., Gool, L. V., Perazzi, F., & Pont-Tuset, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.00557 · Cited by 790
YouTube-VOS: Sequence-to-Sequence Video Object Segmentation
Xu, N., Yang, L., Fan, Y., Yang, J., Yue, D., Liang, Y., Price, B. L., Cohen, S. D., & Huang, T. S. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01228-1_36 · Cited by 641
FEELVOS: Fast End-To-End Embedding Learning for Video Object Segmentation
Voigtlaender, P., Chai, Y., Schroff, F., Adam, H., Leibe, B., & Chen, L.-C. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00971 · Cited by 468
Self-citation
Metadata
- Authors
- Voigtlaender, P., & Leibe, B.
- Affiliations
- RWTH Aachen University (DE)
- ORCID
- Leibe, Bastian
- Venue
- Procedings of the British Machine Vision Conference 2017
- Publisher
- British Machine Vision Association
- Published
- 2017
- OpenAlex
- W2724418412
- Cited by
- 443
- References
- 36
- Citations by year
- 2026: 4 · 2025: 24 · 2024: 40 · 2023: 53 · 2022: 76 · 2021: 75 · 2020: 74 · 2019: 66 · 2018: 30 · 2017: 1
- FWCI
- 13.67
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- British Machine Vision Conference (BMVC) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- RWTH Publications (RWTH Aachen) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Visual Attention and Saliency Detection
- Keywords
- video object segmentation, semi-supervised learning, online adaptation, fine-tuning, PASCAL dataset, spatial configuration
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
