Online Adaptation of Convolutional Neural Networks for Video Object Segmentation
Open accessAbstract
We tackle the task of semi-supervised video object segmentation, i.e. segmenting the pixels belonging to an object in the video using the ground truth pixel mask for the first frame. We build on the recently introduced one-shot video object segmentation (OSVOS) approach which uses a pretrained network and fine-tunes it on the first frame. While achieving impressive performance, at test time OSVOS uses the fine-tuned network in unchanged form and is not able to adapt to large changes in object appearance. To overcome this limitation, we propose Online Adaptive Video Object Segmentation (OnAVOS) which updates the network online using training examples selected based on the confidence of the network and the spatial configuration. Additionally, we add a pretraining step based on objectness, which is learned on PASCAL. Our experiments show that both extensions are highly effective and improve the state of the art on DAVIS to an intersection-over-union score of 85.7%.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Adopting a memory architecture to store object information from past frames is indispensable for accurately tracking objects in video.
“To address the above challenges, adopting a memory architecture to store the object information from past frames is indispensable for accurately tracking objects in video [5,7,10,29,40,52,56,57,64,66,68].”
From SAM2LONG: Enhancing SAM 2 for Long Video Segmentation with a Training-Free Memory Tree (2025) · cites this paper as [56]
Related Work (p. 2) says the method stores temporal context from video frames implicitly in adapted network weights, and the ablation study (p. 9) reports better segmentation accuracy with online adaptation. The paper does not describe a dedicated memory architecture or establish that one is indispensable for accurate object tracking. (LLM, conf=0.88)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · see citing works
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · see citing works
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 74,248 · see citing works
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333 · see citing works
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460 · see citing works
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834 · see citing works
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466 · see citing works
Multi-scale context aggregation by dilated convolutions
Yu, F., & Koltun, V. (2015) · arXiv · doi:10.48550/arxiv.1511.07122 · Cited by 7,738 · see citing works
The Pascal Visual Object Classes Challenge: A Retrospective
Everingham, M., Eslami, S. M. A., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-014-0733-5 · Cited by 7,139 · see citing works
Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials
Krähenbühl, P., & Koltun, V. (2012) · arXiv · doi:10.48550/arxiv.1210.5644 · Cited by 2,908 · see citing works
Learning Multi-domain Convolutional Neural Networks for Visual Tracking
Nam, H., & Han, B. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.465 · Cited by 2,806 · see citing works
A Benchmark Dataset and Evaluation Methodology for Video Object Segmentation
Perazzi, F., Pont-Tuset, J., McWilliams, B., Gool, L. V., Groß, M. H., & Sorkine‐Hornung, A. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.85 · Cited by 2,039 · see citing works
Semantic contours from inverse detectors
Hariharan, B., Arbeláez, P., Bourdev, L. D., Maji, S., & Malik, J. (2011) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2011.6126343 · Cited by 1,714 · see citing works
Learning to Track at 100 FPS with Deep Regression Networks
Held, D., Thrun, S., & Savarese, S. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_45 · Cited by 1,199 · see citing works
Gräbner, H., & Bischof, H. (2006) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2006.215 · Cited by 998 · see citing works
Learning a Deep Compact Image Representation for Visual Tracking
Wang, N., & Yeung, D. (2013) · Rare & Special e-Zone (The Hong Kong University of Science and Technology) · Cited by 836 · see citing works
Learning Video Object Segmentation from Static Images
Perazzi, F., Khoreva, A., Benenson, R., Schiele, B., & Sorkine‐Hornung, A. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.372 · Cited by 602 · see citing works
Full-Resolution Residual Networks for Semantic Segmentation in Street Scenes
Pohlen, T., Hermans, A., Mathias, M., & Leibe, B. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.353 · Cited by 591 · see citing works
Self-citationLearning object class detectors from weakly annotated video
Prest, A., Leistner, C., Civera, J., Schmid, C., & Ferrari, V. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6248065 · Cited by 434 · see citing works
Bai, X., Wang, J., Simons, D., & Sapiro, G. (2009) · ACM Transactions on Graphics · doi:10.1145/1531326.1531376 · Cited by 365 · see citing works
Interactive deep learning method for segmenting moving objects
Wang, Y., Luo, Z., & Jodoin, P. (2016) · Pattern Recognition Letters · doi:10.1016/j.patrec.2016.09.014 · Cited by 327 · see citing works
Deep background subtraction with scene-specific convolutional neural networks
Braham, M., & Droogenbroeck, M. V. (2016) · International Conference on Systems, Signals and Image Processing · doi:10.1109/iwssip.2016.7502717 · Cited by 321 · see citing works
DeepTrack: Learning Discriminative Feature Representations Online for Robust Visual Tracking
Li, H., Li, Y., & Porikli, F. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2510583 · Cited by 285 · see citing works
Learning Motion Patterns in Videos
Tokmakov, P., Alahari, K., & Schmid, C. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.64 · Cited by 272 · see citing works
Supervoxel-Consistent Foreground Propagation in Video
Jain, S. D., & Grauman, K. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10593-2_43 · Cited by 231 · see citing works
Jampani, V., Gadde, R., & Gehler, P. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.336 · Cited by 229 · see citing works
Wider or Deeper: Revisiting the ResNet Model for Visual RecognitionPreprint
Wu, Z., Shen, C., & van den Hengel, A. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.10080 · Cited by 217 · see citing works
Bilateral Space Video Segmentation
Marki, N., Perazzi, F., Wang, O., & Sorkine‐Hornung, A. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.87 · Cited by 209 · see citing works
Fully Connected Object Proposals for Video Segmentation
Perazzi, F., Wang, O., Groß, M. H., & Sorkine‐Hornung, A. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.369 · Cited by 171 · see citing works
Bridging Category-level and Instance-level Semantic Image SegmentationPreprint
Wu, Z., Shen, C., & van den Hengel, A. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.06885 · Cited by 148 · see citing works
Jain, S. D., Xiong, B., & Grauman, K. L. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.05384 · Cited by 137 · see citing works
Fan, Q., Zhong, F., Lischinski, D., Cohen‐Or, D., & Chen, B. (2015) · ACM Transactions on Graphics · doi:10.1145/2816795.2818105 · Cited by 125 · see citing works
SeamSeg: Video Object Segmentation Using Patch Seams
Ramakanth, S. A., & Babu, R. V. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.55 · Cited by 121 · see citing works
A Deep Convolutional Neural Network for Background SubtractionPreprint
Babaee, M., Dinh, D. T., & Rigoll, G. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.01731 · Cited by 54 · see citing works
Super-Trajectory for Video Segmentation
Wang, W.-G., Shen, J.-B., Xie, J., & Porikli, F. (2017) · IEEE International Conference on Computer Vision · doi:10.1109/iccv.2017.185 · Cited by 50 · see citing works
Online Learning for Fast Segmentation of Moving Objects
Ellis, L., & Zografos, V. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-37444-9_5 · Cited by 9 · see citing works
Flagged first, then by citations
Research works printed but not linked: 12
- [4][4] X. Bai, J. Wang, and G. Sapiro. Dynamic color flow: A motion-adaptive color model for object segmentation in video. In ECCV , 2010. -
- [5][5] L. Bertinetto, J. Valmadre, J. F. Henriques, A. Vedaldi, and P. H. S. Torr. Fullyconvolutional siamese networks for object tracking. In ECCV Workshops , 2016. -
- [6][6] M. Braham and M. Van Droogenbroeck. Deep background subtraction with scenespecific convolutional neural networks. In Int. Conf. on Systems, Signals and Image Proc. , 2016. -
- [7][7] S. Caelles, K.-K. Maninis, J. Pont-Tuset, L. Leal-Taixé, D. Cremers, and L. Van Gool. One-shot video object segmentation. In CVPR , 2017. -
- [8][8] J. Chang, D. Wei, and J. W. Fisher III. A video representation using temporal superpixels. In CVPR , 2013. -
- [12][12] Q. Fan, F. Zhong, D. Lischinski, D. Cohen-Or, and B. Chen. Jumpcut: Non-successive mask transfer and interpolation for video cutout. SIGGRAPH Asia , 34(6), 2015. -
- [15][15] M. Grundmann, V. Kwatra, M. Han, and I. Essa. Efficient hierarchical graph-based video segmentation. In CVPR , 2010. -
- [21][21] S. D. Jain, B. Xiong, and K. Grauman. Pixel objectness. arXiv preprint arXiv:1701.05349 , 2017. - · arXiv
- [23][23] Z. Kalal, K. Mikolajczyk, and J. Matas. Tracking-learning-detection. PAMI , 34(7): 1409-1422, 2012. -
- [24][24] A. Khoreva, R. Benenson, E. Ilg, T. Brox, and B. Schiele. Lucid data dreaming for object tracking. In arXiv preprint arXiv: 1703.09554 , 2017. - · arXiv
- [32][32] K. E. Papoutsakis and A. A. Argyros. Integrating tracking with fine object segmentation. Image and Vision Computing , 31(10):771-785, 2013. -
- [41][41] Y-H. Tsai, M-H. Yang, and M. J. Black. Video segmentation via object flow. In CVPR , 2016. -
Cited by
Sorted by citations
Fast Online Object Tracking and Segmentation: A Unifying Approach
Wang, Q., Zhang, L., Bertinetto, L., Hu, W., & Torr, P. H. S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00142 · Cited by 1,554 · see citing works
Video Object Segmentation Using Space-Time Memory Networks
Oh, S. W., Lee, J., Xu, N., & Kim, S. J. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00932 · Cited by 775 · see citing works
The 2018 DAVIS Challenge on Video Object SegmentationPreprint
Caelles, S., Montes, A., Maninis, K.-K., Chen, Y., Gool, L. V., Perazzi, F., & Pont-Tuset, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.00557 · Cited by 763 · see citing works
YouTube-VOS: Sequence-to-Sequence Video Object Segmentation
Xu, N., Yang, L., Fan, Y., Yang, J., Yue, D., Liang, Y., Price, B. L., Cohen, S. D., & Huang, T. S. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01228-1_36 · Cited by 618 · see citing works
FEELVOS: Fast End-To-End Embedding Learning for Video Object Segmentation
Voigtlaender, P., Chai, Y., Schroff, F., Adam, H., Leibe, B., & Chen, L.-C. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00971 · Cited by 468 · see citing works
Self-citationXMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model
Cheng, H. K., & Schwing, A. G. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-19815-1_37 · Cited by 449 · see citing works
Fast Video Object Segmentation by Reference-Guided Mask Propagation
Oh, S. W., Lee, J., Sunkavalli, K., & Kim, S. J. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00770 · Cited by 433 · see citing works
Video Object Segmentation without Temporal Information
Maninis, K.-K., Caelles, S., Chen, Y., Pont-Tuset, J., Leal-Taixe, L., Cremers, D., & Van Gool, L. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2838670 · Cited by 354 · see citing works
PReMVOS: Proposal-Generation, Refinement and Merging for Video Object Segmentation
Luiten, J., Voigtlaender, P., & Leibe, B. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-20870-7_35 · Cited by 310 · see citing works
Self-citationYouTube-VOS: A Large-Scale Video Object Segmentation Benchmark
Xu, N., Yang, L., Fan, Y., Yue, D., Liang, Y., Yang, J., & Huang, T. (2018) · arXiv · doi:10.48550/arxiv.1809.03327 · Cited by 301 · see citing works
D3S – A Discriminative Single Shot Segmentation Tracker
Lukezic, A., Matas, J., & Kristan, M. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00716 · Cited by 300 · see citing works
Video Object Segmentation with Episodic Graph Memory Networks
Lu, X., Wang, W., Danelljan, M., Zhou, T., Shen, J., & Gool, L. V. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58580-8_39 · Cited by 288 · see citing works
Fast and Accurate Online Video Object Segmentation via Tracking Parts
Cheng, J., Tsai, Y., Hung, W.-C., Wang, S., & Yang, M. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00774 · Cited by 284 · see citing works
VideoMatch: Matching Based Video Object Segmentation
Hu, Y.-T., Huang, J.-B., & Schwing, A. G. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01237-3_4 · Cited by 274 · see citing works
Blazingly Fast Video Object Segmentation with Pixel-Wise Metric Learning
Chen, Y., Pont-Tuset, J., Montes, A., & Gool, L. V. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00130 · Cited by 273 · see citing works
A Survey on Deep Learning Technique for Video Segmentation
Zhou, T., Porikli, F., Crandall, D., Gool, L. V., & Wang, W. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3225573 · Cited by 273 · see citing works
Collaborative Video Object Segmentation by Foreground-Background Integration
Yang, Z., Wei, Y., & Yang, Y. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58558-7_20 · Cited by 257 · see citing works
RVOS: End-To-End Recurrent Network for Video Object Segmentation
Ventura, C., Bellver, M., Girbau, A., Salvador, A., Marqués, F., & Giró-i-Nieto, X. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00542 · Cited by 255 · see citing works
RANet: Ranking Attention Network for Fast Video Object Segmentation
Wang, Z., Xu, J., Liu, L., Zhu, F., & Shao, L. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00408 · Cited by 247 · see citing works
AMP: Adaptive Masked Proxies for Few-Shot Segmentation
Siam, M., Oreshkin, B. N., & Jägersand, M. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00535 · Cited by 226 · see citing works
Rethinking Space-Time Networks with Improved Memory Coverage for Efficient Video Object SegmentationPreprint
Cheng, H. K., Tai, Y., & Tang, C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.05210 · Cited by 224 · see citing works
Video Object Segmentation and Tracking
Yao, R., Lin, G., Xia, S., Zhao, J., & Zhou, Y. Z. (2020) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3391743 · Cited by 222 · see citing works
Video Object Segmentation with Joint Re-identification and Attention-Aware Mask Propagation
Li, X., & Loy, C. C. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01219-9_6 · Cited by 211 · see citing works
Cheng, H. K., Tai, Y., & Tang, C. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00551 · Cited by 209 · see citing works
SwiftNet: Real-time Video Object Segmentation
Wang, H., Jiang, X., Ren, H., Hu, Y. G., & Bai, S. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00135 · Cited by 208 · see citing works
CNN in MRF: Video Object Segmentation via Inference in a CNN-Based Higher-Order Spatio-Temporal MRF
Bao, L., Wu, B., & Liu, W. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00626 · Cited by 207 · see citing works
Kernelized Memory Network for Video Object Segmentation
Seong, H., Hyun, J., & Kim, E. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58542-6_38 · Cited by 204 · see citing works
A Generative Appearance Model for End-To-End Video Object Segmentation
Johnander, J., Danelljan, M., Brissman, E., Khan, F. S., & Felsberg, M. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00916 · Cited by 196 · see citing works
Efficient Regional Memory Network for Video Object Segmentation
Xie, H., Yao, H., Zhou, S., Zhang, S., & Sun, W. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00134 · Cited by 196 · see citing works
SSTVOS: Sparse Spatiotemporal Transformers for Video Object Segmentation
Duke, B., Ahmed, A. S., Wolf, C., Aarabi, P., & Taylor, G. W. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00585 · Cited by 195 · see citing works
Associating Objects with Transformers for Video Object SegmentationPreprint
Yang, Z., Wei, Y., & Yang, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.02638 · Cited by 183 · see citing works
Learning Video Object Segmentation From Unlabeled Videos
Lu, X., Wang, W., Shen, J., Tai, Y., Crandall, D., & Hoi, S. C. H. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00898 · Cited by 182 · see citing works
Video Object Segmentation with Language Referring Expressions
Khoreva, A., Rohrbach, A., & Schiele, B. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-20870-7_8 · Cited by 180 · see citing works
MAST: A Memory-Augmented Self-Supervised Tracker
Lai, Z., Lu, E., & Xie, W. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00651 · Cited by 176 · see citing works
Space-Time Correspondence as a Contrastive Random WalkPreprint
Jabri, A., Owens, A., & Efros, A. A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.14613 · Cited by 167 · see citing works
TAO: A Large-Scale Benchmark for Tracking Any Object
Dave, A., Khurana, T., Tokmakov, P., Schmid, C., & Ramanan, D. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58558-7_26 · Cited by 166 · see citing works
Occluded Video Instance Segmentation: A Benchmark
Qi, J., Gao, Y., Hu, Y. G., Wang, X., Liu, X., Bai, X., Belongie, S., Yuille, A., Torr, P. H. S., & Bai, S. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-022-01629-1 · Cited by 165 · see citing works
Learning What to Learn for Video Object Segmentation
Bhat, G., Lawin, F. J., Danelljan, M., Robinson, A., Felsberg, M., Van Gool, L., & Timofte, R. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58536-5_46 · Cited by 160 · see citing works
Semi-Supervised Video Object Segmentation with Super-Trajectories
Wang, W.-G., Shen, J.-B., Porikli, F., & Yang, R.-G. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2819173 · Cited by 151 · see citing works
Lucid Data Dreaming for Video Object Segmentation
Khoreva, A., Benenson, R., Ilg, E., Brox, T., & Schiele, B. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-019-01164-6 · Cited by 158 · see citing works
Learning Fast and Robust Target Models for Video Object Segmentation
Robinson, A., Jaremo Lawin, F., Danelljan, M., Khan, F. S., & Felsberg, M. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00743 · Cited by 158 · see citing works
Collaborative Video Object Segmentation by Multi-Scale Foreground-Background Integration
Yang, Z., Wei, Y., & Yang, Y. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3081597 · Cited by 154 · see citing works
MoNet: Deep Motion Exploitation for Video Object Segmentation
Xiao, H., Feng, J., Lin, G., Liu, Y., & Zhang, M. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00125 · Cited by 151 · see citing works
Putting the Object Back into Video Object Segmentation
Cheng, H. K., Oh, S. W., Price, B., Lee, J.-Y., & Schwing, A. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.00304 · Cited by 148 · see citing works
Unsupervised Video Object Segmentation with Motion-Based Bilateral Networks
Li, S., Seybold, B., Vorobyov, A., Lei, X., & Kuo, C. ‐. J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01219-9_13 · Cited by 145 · see citing works
Fast Video Object Segmentation Using the Global Context Module
Li, Y., Shen, Z., & Shan, Y. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58607-2_43 · Cited by 141 · see citing works
Self-supervised Video Object Segmentation by Motion Grouping
Yang, C., Lamdouar, H., Lu, E., Zisserman, A., & Xie, W. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00709 · Cited by 140 · see citing works
A Transductive Approach for Video Object Segmentation
Zhang, Y., Wu, Z., Peng, H., & Lin, S. C.-F. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00698 · Cited by 137 · see citing works
Video Object Segmentation with Adaptive Feature Bank and Uncertain-Region RefinementPreprint
Liang, Y., Li, X., Jafari, N. H., & Chen, Q. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.07958 · Cited by 134 · see citing works
Learning Position and Target Consistency for Memory-based Video Object Segmentation
Hu, L., Zhang, P., Zhang, B., Pan, P., Xu, Y., & Jin, R. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00413 · Cited by 129 · see citing works
Hierarchical Memory Matching Network for Video Object Segmentation
Seong, H., Oh, S. W., Lee, J., Lee, S., Lee, S., & Kim, E. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01265 · Cited by 129 · see citing works
Siam R-CNN: Visual Tracking by Re-Detection
Voigtlaender, P., Luiten, J., Torr, P. H. S., & Leibe, B. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00661 · Cited by 115 · see citing works
Self-citationAnchor Diffusion for Unsupervised Video Object Segmentation
Yang, Z., Wang, Q., Bertinetto, L., Bai, S., Hu, W., & Torr, P. H. S. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00102 · Cited by 115 · see citing works
The 2019 DAVIS Challenge on VOS: Unsupervised Multi-Object Segmentation
Caelles, S., Pont-Tuset, J., Perazzi, F., Montes, A., Maninis, K.-K., & Gool, L. V. (2019) · Lirias · doi:10.48550/arxiv.1905.00737 · Cited by 113 · see citing works
Instance Embedding Transfer to Unsupervised Video Object Segmentation
Li, S., Seybold, B., Vorobyov, A., Fathi, A., Huang, Q., & Kuo, C. ‐. J. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00683 · Cited by 110 · see citing works
Non-rigid object tracking via deep multi-scale spatial-temporal discriminative saliency maps
Zhang, P., Liu, W., Wang, D., Lei, Y., Wang, H., & Lu, H. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2019.107130 · Cited by 108 · see citing works
Local-Global Context Aware Transformer for Language-Guided Video Segmentation
Liang, C., Wang, W., Zhou, T., Miao, J., Luo, Y., & Yang, Y. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3262578 · Cited by 106 · see citing works
Iteratively Trained Interactive SegmentationPreprint
Mahadevan, S., Voigtlaender, P., & Leibe, B. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.04398 · Cited by 106 · see citing works
Self-citationSpatiotemporal CNN for Video Object Segmentation
Xu, K., Wen, L., Li, G., Bo, L., & Huang, Q. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00147 · Cited by 104 · see citing works
Joint Inductive and Transductive Learning for Video Object Segmentation
Mao, Y., Wang, N., Zhou, W., & Li, H. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00953 · Cited by 104 · see citing works
Betrayed by Motion: Camouflaged Object Discovery via Motion Segmentation
Lamdouar, H., Yang, C., Xie, W., & Zisserman, A. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-69532-3_30 · Cited by 103 · see citing works
Deep learning for video object segmentation: a review
Gao, M., Zheng, F., Yu, J. J. Q., Shan, C., Ding, G., & Han, J. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-022-10176-7 · Cited by 103 · see citing works
Unsupervised Online Video Object Segmentation With Motion Property Understanding
Zhuo, T., Cheng, Z., Zhang, P., Wong, Y., & Kankanhalli, M. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2930152 · Cited by 99 · see citing works
Online Model Distillation for Efficient Video Inference
Mullapudi, R. T., Chen, S., Zhang, K., Ramanan, D., & Fatahalian, K. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00367 · Cited by 96 · see citing works
Reinforcement Cutting-Agent Learning for Video Object Segmentation
Han, J., Yang, L., Zhang, D., Chang, X., & Liang, X. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00946 · Cited by 95 · see citing works
Motion-Guided Cascaded Refinement Network for Video Object Segmentation
Hu, P., Wang, G., Kong, X., Kuen, J., & Tan, Y. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00152 · Cited by 94 · see citing works
AGSS-VOS: Attention Guided Single-Shot Video Object Segmentation
Lin, H., Qi, X., & Jia, J. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00405 · Cited by 90 · see citing works
Robust Visual Tracking by Segmentation
Paul, M., Danelljan, M., Mayer, C., & Gool, L. V. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20047-2_33 · Cited by 90 · see citing works
Siam, M., Jiang, C., Lu, S., Petrich, L., Gamal, M., Elhoseiny, M., & Jägersand, M. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8794254 · Cited by 86 · see citing works
Scribble-Supervised Video Object Segmentation
Huang, P., Han, J., Liu, N., Ren, J., & Zhang, D. (2021) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2021.1004210 · Cited by 86 · see citing works
Hu, Y.-T., Chen, H.-S., Hui, K., Huang, J., & Schwing, A. G. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00322 · Cited by 85 · see citing works
Graph Moving Object Segmentation
Giraldo, J. H., Javed, S., & Bouwmans, T. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3042093 · Cited by 85 · see citing works
Fast Template Matching and Update for Video Object Tracking and Segmentation
Sun, M., Xiao, J., Lim, E. G., Zhang, B., & Zhao, Y. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01080 · Cited by 80 · see citing works
Siam-U-Net: encoder-decoder siamese network for knee cartilage tracking in ultrasound images
Dunnhofer, M., Antico, M., Sasazawa, F., Takeda, Y., Camps, S., Martinel, N., Micheloni, C., Carneiro, G., & Fontanarosa, D. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.101631 · Cited by 78 · see citing works
Active Boundary Loss for Semantic Segmentation
Wang, C., Zhang, Y., Cui, M., Ren, P., Yang, Y., Xie, X., Hua, X., Bao, H., & Xu, W. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i2.20139 · Cited by 75 · see citing works
Deep Spatio-Temporal Random Fields for Efficient Video Segmentation
Chandra, S., Couprie, C., & Kokkinos, I. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00929 · Cited by 75 · see citing works
DMM-Net: Differentiable Mask-Matching Network for Video Object Segmentation
Zeng, X., Liao, R., Gu, L., Xiong, Y., Fidler, S., & Urtasun, R. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00403 · Cited by 74 · see citing works
Video Instance Segmentation Tracking With a Modified VAE Architecture
Lin, C.-C., Hung, Y., Feris, R. S., & He, L. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01316 · Cited by 66 · see citing works
Track, Then Decide: Category-Agnostic Vision-Based Multi-Object Tracking
Ošep, A., Mehner, W., Voigtlaender, P., & Leibe, B. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8460975 · Cited by 66 · see citing works
Self-citationGuided Co-Segmentation Network for Fast Video Object Segmentation
Liu, W., Lin, G., Zhang, T., & Liu, Z. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.3010293 · Cited by 65 · see citing works
Fast User-Guided Video Object Segmentation by Interaction-And-Propagation Networks
Oh, S. W., Lee, J., Xu, N., & Kim, S. J. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00539 · Cited by 65 · see citing works
LVOS: A Benchmark for Long-term Video Object Segmentation
Hong, L., Chen, W., Liu, Z., Zhang, W., Guo, P., Chen, Z., & Zhang, W. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01240 · Cited by 64 · see citing works
Video Object Segmentation by Learning Location-Sensitive Embeddings
Ci, H., Wang, C., & Wang, Y. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01252-6_31 · Cited by 62 · see citing works
Continuous Adaptation for Interactive Object Segmentation by Learning from Corrections
Kontogianni, T., Gygli, M., Uijlings, J., & Ferrari, V. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58517-4_34 · Cited by 61 · see citing works
UnOVOST: Unsupervised Offline Video Object Segmentation and Tracking
Luiten, J., Zulfikar, I. E., & Leibe, B. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093285 · Cited by 61 · see citing works
Self-citationCompFeat: Comprehensive Feature Aggregation for Video Instance Segmentation
Fu, Y. L., Yang, L., Liu, D., Huang, T. S., & Shi, H. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i2.16225 · Cited by 60 · see citing works
Video Object Segmentation Using Global and Instance Embedding Learning
Wen-bin, G., Lu, X., & Shen, J. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01656 · Cited by 59 · see citing works
Real-time and light-weighted unsupervised video object segmentation network
Zhao, Z., Zhao, S., & Shen, J. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.108120 · Cited by 59 · see citing works
Learning Quality-aware Dynamic Memory for Video Object Segmentation
Liu, Y., Yu, R., Yin, F., Zhao, X., Zhao, W. Z., Xia, W., & Yang, Y. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19818-2_27 · Cited by 56 · see citing works
Fast Video Object Segmentation via Dynamic Targeting Network
Zhang, L., Lin, Z., Zhang, J., Lu, H., & He, Y. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00568 · Cited by 56 · see citing works
Reliable Propagation-Correction Modulation for Video Object Segmentation
Xu, X., Wang, J., Li, X., & Lu, Y. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i3.20200 · Cited by 54 · see citing works
Per-Clip Video Object Segmentation
Park, K., Woo, S., Oh, S. W., Kweon, I. S., & Lee, J. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00141 · Cited by 52 · see citing works
Real Time Video Object Segmentation in Compressed Domain
Tan, Z., Liu, B., Chu, Q., Zhong, H., Wu, Y., Li, W., & Yu, N. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.2971641 · Cited by 49 · see citing works
Bilevel Online Adaptation for Out-of-Domain Human Mesh Reconstruction
Guan, S., Xu, J., Wang, Y., Ni, B., & Yang, X. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01033 · Cited by 49 · see citing works
MHP-VOS: Multiple Hypotheses Propagation for Video Object Segmentation
Xu, S., Liu, D., Bao, L., Liu, W., & Zhou, P. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00040 · Cited by 49 · see citing works
Boosting Video Object Segmentation via Space-Time Correspondence Learning
Zhang, Y., Li, L., Wang, W., Xie, R., Song, L., & Zhang, W. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00223 · Cited by 48 · see citing works
Griffin, B., & Corso, J. J. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00912 · Cited by 48 · see citing works
Separable Structure Modeling for Semi-Supervised Video Object Segmentation
Zhu, W., Li, J., Lu, J., & Zhou, J. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3060015 · Cited by 47 · see citing works
A Novel Video Salient Object Detection Method via Semisupervised Motion Quality Perception
Chen, C., Song, J., Peng, C., Wang, G., & Fang, Y. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3095843 · Cited by 47 · see citing works
Locality-Aware Inter-and Intra-Video Reconstruction for Self-Supervised Correspondence Learning
Li, L.-L., Zhou, T.-F., Wang, W.-G., Yang, L., Li, J.-W., & Yang, Y. (2022) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr52688.2022.00852 · Cited by 63 · see citing works
- Authors
- Voigtlaender, P., & Leibe, B.
- Affiliations
- RWTH Aachen University (DE)
- ORCID
- Leibe, Bastian
- Venue
- Procedings of the British Machine Vision Conference 2017
- Publisher
- British Machine Vision Association
- Published
- 2017
- OpenAlex
- W2724418412
- Cited by
- 443
- References
- 36
- Citations by year
- 2026: 4 · 2025: 24 · 2024: 40 · 2023: 53 · 2022: 76 · 2021: 75 · 2020: 74 · 2019: 66 · 2018: 30 · 2017: 1
- FWCI
- 13.67
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- British Machine Vision Conference (BMVC) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- RWTH Publications (RWTH Aachen) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Visual Attention and Saliency Detection
- Keywords
- video object segmentation, semi-supervised learning, online adaptation, fine-tuning, PASCAL dataset, spatial configuration
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
