The DOI matches its Crossref record; 264 of the 264 references it cites were found in a registry or an index.
A Survey on Deep Learning Technique for Video Segmentation
Open accessAbstract
Video segmentation-partitioning video frames into multiple segments or objects-plays a critical role in a broad range of practical applications, from enhancing visual effects in movie, to understanding scenes in autonomous driving, to creating virtual background in video conferencing. Recently, with the renaissance of connectionism in computer vision, there has been an influx of deep learning based approaches for video segmentation that have delivered compelling performance. In this survey, we comprehensively review two basic lines of research - generic object segmentation (of unknown categories) in videos, and video semantic segmentation - by introducing their respective task settings, background concepts, perceived need, development history, and main challenges. We also offer a detailed overview of representative literature on both methods and datasets. We further benchmark the reviewed methods on several well-known datasets. Finally, we point out open issues in this field, and suggest opportunities for further research. We also provide a public website to continuously track developments in this fast advancing field: https://github.com/tfzhou/VS-Survey.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.322 · Cited by 29,137
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897
The Cityscapes Dataset for Semantic Urban Scene Understanding
Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., & Schiele, B. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.350 · Cited by 12,433
The Pascal Visual Object Classes Challenge: A Retrospective
Everingham, M., Eslami, S. M. A., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-014-0733-5 · Cited by 7,139
Shape matching and object recognition using shape contexts
Belongie, S., Malik, J., & Puzicha, J. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.993558 · Cited by 6,306
Indoor segmentation and support inference from rgbd images
Silberman, N., Hoiem, D., Kohli, P., & Fergus, R. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33715-4_54 · Cited by 5,760
Yilmaz, A., Javed, O., & Shah, M. (2006) · ACM Computing Surveys · doi:10.1145/1177352.1177355 · Cited by 4,792
Pfinder: real-time tracking of the human body
Wren, C. R., Azarbayejani, A., Darrell, T., & Pentland, A. P. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.598236 · Cited by 4,169
Global contrast based salient region detection
Cheng, M.-M., Zhang, G.-X., Mitra, N. J., Huang, X., & Hu, S.-M. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995344 · Cited by 2,976
BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learning
Yu, F., Chen, H., Wang, X., Xian, W., Chen, Y., Liu, F., Madhavan, V., & Darrell, T. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00271 · Cited by 2,641
The Kinetics Human Action Video Dataset
Kay, W., Carreira, J., Simonyan, K., Zhang, B., Hillier, C., Vijayanarasimhan, S., Viola, F., Green, T., Back, T., Natsev, P., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.06950 · Cited by 2,593
Saliency Detection via Graph-Based Manifold Ranking
Yang, C., Zhang, L., Lu, H., Ruan, X., & Yang, M.-H. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.407 · Cited by 2,554
Mayer, N., Ilg, E., Hausser, P., Fischer, P., Cremers, D., Dosovitskiy, A., & Brox, T. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.438 · Cited by 2,488
Global Contrast Based Salient Region Detection
Cheng, M.-M., Mitra, N. J., Huang, X., Torr, P. H. S., & Hu, S.-M. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2345401 · Cited by 2,463
Learning to detect natural image boundaries using local brightness, color, and texture cues
Martin, D. R., Fowlkes, C. C., & Malik, J. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.1273918 · Cited by 2,420
Self-Supervised Visual Feature Learning With Deep Neural Networks: A Survey
Jing, L., & Tian, Y. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2992393 · Cited by 2,036
A Benchmark Dataset and Evaluation Methodology for Video Object Segmentation
Perazzi, F., Pont-Tuset, J., McWilliams, B., Van Gool, L., Gross, M., & Sorkine-Hornung, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.85 · Cited by 1,989
Self-citationHierarchical Saliency Detection
Yan, Q., Xu, L., Shi, J., & Jia, J. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.153 · Cited by 1,773
The kinetics human action video dataset
Kay, W. (2024) · TIB Data Manager · doi:10.57702/jtuxnt5m · Cited by 1,646
Fast Online Object Tracking and Segmentation: A Unifying Approach
Wang, Q., Zhang, L., Bertinetto, L., Hu, W., & Torr, P. H. S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00142 · Cited by 1,554 · cited 4×
“Core Architecture Flow Technical Feature Training Dataset 2017 OSVOS [18] CVPR FCN Online Fine-tuning DAVIS16 [17] MaskTrack [117] CVPR FCN ✓ Propagation-based ECSSD [118] + MSRA10K [84] + PASCAL- S [88] + DAVIS16 [17] CTN [119] CVPR FCN ✓ Propagation-based PASCAL VOC 2012 [103] VPN [120] CVPR Bilateral Network Propag…”
BackgroundMethodInfluentialMACHINE PERCEPTION OF THREE-DIMENSIONAL SOLIDS,
Roberts, L. G. (1963) · Defense Technical Information Center (DTIC) · Cited by 1,551
Visual Tracking: An Experimental Survey
(2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.230 · Cited by 1,513
A survey on deep learning techniques for image and video semantic segmentation
Garcia-Garcia, A., Orts-Escolano, S., Oprea, S., Villena-Martinez, V., Martinez-Gonzalez, P., & Garcia-Rodriguez, J. (2018) · Applied Soft Computing · doi:10.1016/j.asoc.2018.05.018 · Cited by 1,490
Semantic object classes in video: A high-definition ground truth database
Brostow, G. J., Fauqueur, J., & Cipolla, R. (2009) · Pattern Recognition Letters · doi:10.1016/j.patrec.2008.04.005 · Cited by 1,397
Sukhbaatar, S., Szlam, A., Weston, J., & Fergus, R. (2015) · arXiv · doi:10.48550/arxiv.1503.08895 · Cited by 1,345
The Secrets of Salient Object Segmentation
Li, Y., Hou, X., Koch, C., Rehg, J. M., & Yuille, A. L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.43 · Cited by 1,338
MOT16: A Benchmark for Multi-Object Tracking
Milan, A., Leal-Taixe, L., Reid, I., Roth, S., & Schindler, K. (2016) · arXiv · doi:10.48550/arxiv.1603.00831 · Cited by 1,309 · cited 2×
“•MOTSChallenge[210] annotates 4 of 7 training sequences of MOTChallenge2017 [260].”
BackgroundLearning to Detect Salient Objects with Image-Level Supervision
Wang, L., Lu, H., Wang, Y., Feng, M., Wang, D., Yin, B., & Ruan, X. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.404 · Cited by 1,265
Mayer, N., Ilg, E., Cremers, D., Dosovitskiy, A., & Brox, T. (2016) · Cited by 1,214
Visual saliency based on multiscale deep features
Li, G., & Yu, Y. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299184 · Cited by 1,163
Visual Tracking with Fully Convolutional Networks
Wang, L., Ouyang, W., Wang, X., & Lu, H. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.357 · Cited by 983
Localizing Moments in Video with Natural Language
Hendricks, L. A., Wang, O., Shechtman, E., Sivic, J., Darrell, T., & Russell, B. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.618 · Cited by 958
One-Shot Video Object Segmentation
Caelles, S., Maninis, K.-K., Pont-Tuset, J., Leal-Taixe, L., Cremers, D., & Van Gool, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.565 · Cited by 927
Matrix capsules with EM routing
Hinton, G. E., Sabour, S., & Frosst, N. (2018) · International Conference on Learning Representations · Cited by 918
Towards Understanding Action Recognition
Jhuang, H., Gall, J., Zuffi, S., Schmid, C., & Black, M. J. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.396 · Cited by 879
TALL: Temporal Activity Localization via Language Query
Gao, J., Sun, C., Yang, Z., & Nevatia, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.563 · Cited by 842
Video Object Segmentation Using Space-Time Memory Networks
Oh, S. W., Lee, J.-Y., Xu, N., & Kim, S. J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00932 · Cited by 745
Object Segmentation by Long Term Analysis of Point Trajectories
Brox, T., & Malik, J. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15555-0_21 · Cited by 744
Jiang, M., Huang, S., Duan, J., & Zhao, Q. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298710 · Cited by 729
End-to-End Video Instance Segmentation with Transformers
Wang, Y., Xu, Z., Wang, X., Shen, C., Cheng, B., Shen, H., & Xia, H. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00863 · Cited by 679
MOTS: Multi-Object Tracking and Segmentation
Voigtlaender, P., Krause, M., Osep, A., Luiten, J., Sekar, B. B. G., Geiger, A., & Leibe, B. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00813 · Cited by 658
Deep Feature Flow for Video Recognition
Zhu, X., Xiong, Y., Dai, J., Yuan, L., & Wei, Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.441 · Cited by 653
Video Salient Object Detection via Fully Convolutional Networks
Wang, W., Shen, J., & Shao, L. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2754941 · Cited by 642
Self-citationEfficient hierarchical graph-based video segmentation
Grundmann, M., Kwatra, V., Han, M., & Essa, I. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539893 · Cited by 628
Evaluation of background subtraction techniques for video surveillance
Brutzer, S., Hoferlin, B., & Heidemann, G. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995508 · Cited by 622
Exploring Cross-Image Pixel Contrast for Semantic Segmentation
Wang, W., Zhou, T., Yu, F., Dai, J., Konukoglu, E., & Gool, L. V. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00721 · Cited by 604
Self-citationYouTube-VOS: Sequence-to-Sequence Video Object Segmentation
Xu, N., Yang, L., Fan, Y., Yang, J., Yue, D., Liang, Y., Price, B., Cohen, S., & Huang, T. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01228-1_36 · Cited by 598
Segmentation of Moving Objects by Long Term Video Analysis
Ochs, P., Malik, J., & Brox, T. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.242 · Cited by 585
Learning Video Object Segmentation from Static Images
Perazzi, F., Khoreva, A., Benenson, R., Schiele, B., & Sorkine-Hornung, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.372 · Cited by 581
Fast Object Segmentation in Unconstrained Video
Papazoglou, A., & Ferrari, V. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.223 · Cited by 533
See More, Know More: Unsupervised Video Object Segmentation With Co-Attention Siamese Networks
Lu, X., Wang, W., Ma, C., Shen, J., Shao, L., & Porikli, F. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00374 · Cited by 521
Self-citationVideo Segmentation by Tracking Many Figure-Ground Segments
Li, F., Kim, T., Humayun, A., Tsai, D., & Rehg, J. M. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.273 · Cited by 512
Shifting More Attention to Video Salient Object Detection
Fan, D.-P., Wang, W., Cheng, M.-M., & Shen, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00875 · Cited by 510
Self-citationPyramid Dilated Deeper ConvLSTM for Video Salient Object Detection
Song, H., Wang, W., Zhao, S., Shen, J., & Lam, K.-M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01252-6_44 · Cited by 492
Self-citationSaliency-Aware Video Object Segmentation
Wang, W., Shen, J., Yang, R., & Porikli, F. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2662005 · Cited by 472
Self-citationYang, L., Fan, Y., & Xu, N. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00529 · Cited by 470
FEELVOS: Fast End-To-End Embedding Learning for Video Object Segmentation
Voigtlaender, P., Chai, Y., Schroff, F., Adam, H., Leibe, B., & Chen, L.-C. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00971 · Cited by 468
Deep Interactive Object Selection
Xu, N., Price, B., Cohen, S., Yang, J., & Huang, T. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.47 · Cited by 460
SegFlow: Joint Learning for Video Object Segmentation and Optical Flow
Cheng, J., Tsai, Y.-H., Wang, S., & Yang, M.-H. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.81 · Cited by 446
Learning Correspondence From the Cycle-Consistency of Time
Wang, X., Jabri, A., & Efros, A. A. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00267 · Cited by 445
Online Adaptation of Convolutional Neural Networks for Video Object Segmentation
Voigtlaender, P., & Leibe, B. (2017) · Procedings of the British Machine Vision Conference 2017 · doi:10.5244/c.31.116 · Cited by 443
Learning object class detectors from weakly annotated video
Prest, A., Leistner, C., Civera, J., Schmid, C., & Ferrari, V. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248065 · Cited by 443
Key-segments for video object segmentation
Lee, Y. J., Kim, J., & Grauman, K. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126471 · Cited by 443
Category Independent Object Proposals
Endres, I., & Hoiem, D. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15555-0_42 · Cited by 432
Fast Video Object Segmentation by Reference-Guided Mask Propagation
Oh, S. W., Lee, J.-Y., Sunkavalli, K., & Kim, S. J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00770 · Cited by 420
Richter, S. R., Hayder, Z., & Koltun, V. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.243 · Cited by 419
Improving Semantic Segmentation via Video Propagation and Label Relaxation
Zhu, Y., Sapra, K., Reda, F. A., Shih, K. J., Newsam, S., Tao, A., & Catanzaro, B. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00906 · Cited by 411
Track to Detect and Segment: An Online Multi-Object Tracker
Wu, J., Cao, J., Song, L., Wang, Y., Yang, M., & Yuan, J. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01217 · Cited by 406
UPSNet: A Unified Panoptic Segmentation Network
Xiong, Y., Liao, R., Zhao, H., Hu, R., Bai, M., Yumer, E., & Urtasun, R. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00902 · Cited by 402
Efficient Video Object Segmentation via Network Modulation
Yang, L., Wang, Y., Xiong, X., Yang, J., & Katsaggelos, A. K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00680 · Cited by 386
On the Analysis of Accumulative Difference Pictures from Image Sequences of Real World Scenes
Jain, R., & Nagel, H.-H. (1979) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1979.4766907 · Cited by 385
Tracking Emerges by Colorizing Videos
Vondrick, C., Shrivastava, A., Fathi, A., Guadarrama, S., & Murphy, K. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01261-8_24 · Cited by 379
Rethinking Semantic Segmentation: A Prototype View
Zhou, T., Wang, W., Konukoglu, E., & Van Goo, L. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00261 · Cited by 376
Self-citationVideo SnapCut: robust video object cutout using localized classifiers
Bai, X., Wang, J., Simons, D., & Sapiro, G. (2009) · ACM Transactions on Graphics · doi:10.1145/1531326.1531376 · Cited by 367
Jain, S. D., Xiong, B., & Grauman, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.228 · Cited by 361
Conditional Computation in Neural Networks for faster modelsPreprint
Bengio, E., Bacon, P., Pineau, J., & Precup, D. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.06297 · Cited by 355
Video Object Segmentation without Temporal Information
Maninis, K.-K., Caelles, S., Chen, Y., Pont-Tuset, J., Leal-Taixe, L., Cremers, D., & Van Gool, L. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2838670 · Cited by 354
A unified approach to moving object detection in 2D and 3D scenes
Irani, M., & Anandan, P. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.683770 · Cited by 325
Video Segmentation via Object Flow
Tsai, Y.-H., Yang, M.-H., & Black, M. J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.423 · Cited by 318
Learning Video Object Segmentation with Visual Memory
Tokmakov, P., Alahari, K., & Schmid, C. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.480 · Cited by 316
Zhang, D., Javed, O., & Shah, M. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.87 · Cited by 309
Compact representations of videos through dominant and multiple motion estimation
Sawhney, H. S., & Ayer, S. (1996) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.531801 · Cited by 304
Zero-Shot Video Object Segmentation via Attentive Graph Neural Networks
Wang, W., Lu, X., Shen, J., Crandall, D., & Shao, L. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00933 · Cited by 303
Self-citationYouTube-VOS: A Large-Scale Video Object Segmentation Benchmark
Xu, N., Yang, L., Fan, Y., Yue, D., Liang, Y., Yang, J., & Huang, T. (2018) · arXiv · doi:10.48550/arxiv.1809.03327 · Cited by 301 · cited 18×
“PASCAL VOC 2012 [103] + COCO [123] + ECSSD [118] + DAVIS17 [81]/YouTubeVOS [95] Fasttan [155] CVPR Faster RCNN Propagation-based COCO [123] + DAVIS17 [81]”
BackgroundMethodInfluentialOccluded Video Instance Segmentation: A Benchmark
Qi, J., Gao, Y., Hu, Y. G., Wang, X., Liu, X., Bai, X., Belongie, S., Yuille, A., Torr, P. H. S., & Bai, S. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-022-01629-1 · Cited by 295
Video Object Segmentation by Non-Local Consensus voting
Faktor, A., & Irani, M. (2014) · British Machine Vision Conference (BMVC) · doi:10.5244/c.28.21 · Cited by 284
Fast and Accurate Online Video Object Segmentation via Tracking Parts
Cheng, J., Tsai, Y.-H., Hung, W.-C., Wang, S., & Yang, M.-H. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00774 · Cited by 275
VideoMatch: Matching Based Video Object Segmentation
Hu, Y.-T., Huang, J.-B., & Schwing, A. G. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01237-3_4 · Cited by 274
Blazingly Fast Video Object Segmentation with Pixel-Wise Metric Learning
Chen, Y., Pont-Tuset, J., Montes, A., & Gool, L. V. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00130 · Cited by 273
Self-citationLayered representation for motion analysis
Wang, J. Y. A., & Adelson, E. H. (2002) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1993.341105 · Cited by 273
Bilayer Segmentation of Live Video
Criminisi, A., Cross, G., Blake, A., & Kolmogorov, V. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPR'06) · doi:10.1109/cvpr.2006.69 · Cited by 268
Learning Motion Patterns in Videos
Tokmakov, P., Alahari, K., & Schmid, C. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.64 · Cited by 267
Video Object Segmentation with Episodic Graph Memory Networks
Lu, X., Wang, W., Danelljan, M., Zhou, T., Shen, J., & Van Gool, L. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58580-8_39 · Cited by 263
Self-citationNew Generation Deep Learning for Video Object Detection: A Survey
Jiao, L., Zhang, R., Liu, F., Yang, S., Hou, B., Li, L., & Tang, X. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3053249 · Cited by 259
Collaborative Video Object Segmentation by Foreground-Background Integration
Yang, Z., Wei, Y., & Yang, Y. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58558-7_20 · Cited by 257
Motion Competition: A Variational Approach to Piecewise Parametric Motion Segmentation
Cremers, D., & Soatto, S. (2005) · International Journal of Computer Vision · doi:10.1007/s11263-005-4882-4 · Cited by 253
RVOS: End-To-End Recurrent Network for Video Object Segmentation
Ventura, C., Bellver, M., Girbau, A., Salvador, A., Marques, F., & Giro-i-Nieto, X. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00542 · Cited by 246
The 2018 DAVIS Challenge on Video Object Segmentation
Caelles, S., Montes, A., Maninis, K.-K., Chen, Y., Gool, L. V., Perazzi, F., & Pont-Tuset, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.00557 · Cited by 241
RANet: Ranking Attention Network for Fast Video Object Segmentation
Wang, Z., Xu, J., Liu, L., Zhu, F., & Shao, L. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00408 · Cited by 241
Learning Unsupervised Video Object Segmentation Through Visual Attention
Wang, W., Song, H., Zhao, S., Shen, J., Zhao, S., Hoi, S. C. H., & Ling, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00318 · Cited by 236
Self-citationVideo Segmentation by Non-Local Consensus voting.
Faktor, A., & Irani, M. (2014) · Cited by 235
Jampani, V., Gadde, R., & Gehler, P. V. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.336 · Cited by 224
Statistical background subtraction for a mobile observer
Hayman, & Eklundh (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238315 · Cited by 221
Cross-Modal Progressive Comprehension for Referring Segmentation
Liu, S., Hui, T., Huang, S., Wei, Y., Li, B., & Li, G. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3079993 · Cited by 217
Motion Guided Attention for Video Salient Object Detection
Li, H., Chen, G., Li, G., & Yu, Y. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00737 · Cited by 216
A Video Representation Using Temporal Superpixels
Chang, J., Wei, D., & Fisher III, J. W. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.267 · Cited by 213
Supervoxel-Consistent Foreground Propagation in Video
Jain, S. D., & Grauman, K. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10593-2_43 · Cited by 210
Keyframe-based tracking for rotoscoping and animation
Agarwala, A., Hertzmann, A., Salesin, D. H., & Seitz, S. M. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015764 · Cited by 210
Bilateral Space Video Segmentation
Marki, N., Perazzi, F., Wang, O., & Sorkine-Hornung, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.87 · Cited by 208
Temporally Distributed Networks for Fast Video Semantic Segmentation
Hu, P., Caba, F., Wang, O., Lin, Z., Sclaroff, S., & Perazzi, F. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00884 · Cited by 208
Video Object Segmentation with Joint Re-identification and Attention-Aware Mask Propagation
Li, X., & Loy, C. C. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01219-9_6 · Cited by 207
Ochs, P., & Brox, T. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126418 · Cited by 205
Semantic Video Segmentation by Gated Recurrent Flow Propagation
Nilsson, D., & Sminchisescu, C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00713 · Cited by 204
The 2019 DAVIS Challenge on VOS: Unsupervised Multi-Object SegmentationPreprint
Caelles, S., Pont-Tuset, J., Perazzi, F., Montes, A., Maninis, K.-K., & Gool, L. V. (2019) · Lirias · doi:10.48550/arxiv.1905.00737 · Cited by 204
Motion Trajectory Segmentation via Minimum Cost Multicuts
Keuper, M., Andres, B., & Brox, T. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.374 · Cited by 199
CNN in MRF: Video Object Segmentation via Inference in a CNN-Based Higher-Order Spatio-Temporal MRF
Bao, L., Wu, B., & Liu, W. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00626 · Cited by 199
Cheng, H. K., Tai, Y.-W., & Tang, C.-K. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00551 · Cited by 199
Semantic Video CNNs Through Representation Warping
Gadde, R., Jampani, V., & Gehler, P. V. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.477 · Cited by 198
Self-supervised Video Object Segmentation by Motion Grouping
Yang, C., Lamdouar, H., Lu, E., Zisserman, A., & Xie, W. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00709 · Cited by 198
Clockwork Convnets for Video Semantic Segmentation
Shelhamer, E., Rakelly, K., Hoffman, J., & Darrell, T. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-49409-8_69 · Cited by 197
STEm-Seg: Spatio-Temporal Embeddings for Instance Segmentation in Videos
Athar, A., Mahadevan, S., Ošep, A., Leal-Taixé, L., & Leibe, B. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58621-8_10 · Cited by 196
SG-Net: Spatial Granularity Network for One-Stage Video Instance Segmentation
Liu, D., Cui, Y., Tan, W., & Chen, Y. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00969 · Cited by 194
Learning to segment moving objects in videos
Fragkiadaki, K., Arbelaez, P., Felsen, P., & Malik, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299035 · Cited by 193
Video Object Segmentation and Tracking: A Survey
Yao, R., Lin, G., Xia, S., Zhao, J., & Zhou, Y. (2020) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3391743 · Cited by 193
VSPW: A Large-scale Dataset for Video Scene Parsing in the Wild
Miao, J., Wei, Y., Wu, Y., Chen, L., Li, G., & Yang, Y. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00412 · Cited by 192
A Generative Appearance Model for End-To-End Video Object Segmentation
Johnander, J., Danelljan, M., Brissman, E., Khan, F. S., & Felsberg, M. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00916 · Cited by 190
Kernelized Memory Network for Video Object Segmentation
Seong, H., Hyun, J., & Kim, E. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58542-6_38 · Cited by 189
Pixel-Level Matching for Video Object Segmentation Using Convolutional Neural Networks
Yoon, J. S., Rameau, F., Kim, J., Lee, S., Shin, S., & Kweon, I. S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.238 · Cited by 188
ViP-DeepLab: Learning Visual Perception with Depth-aware Video Panoptic Segmentation
Qiao, S., Zhu, Y., Adam, H., Yuille, A., & Chen, L.-C. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00399 · Cited by 188
SSTVOS: Sparse Spatiotemporal Transformers for Video Object Segmentation
Duke, B., Ahmed, A., Wolf, C., Aarabi, P., & Taylor, G. W. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00585 · Cited by 187
Evaluation of super-voxel methods for early video processing
Xu, C., & Corso, J. J. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247802 · Cited by 186
Robust Real-Time Visual Tracking Using Pixel-Wise Posteriors
Bibby, C., & Reid, I. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88688-4_61 · Cited by 185
Efficient Regional Memory Network for Video Object Segmentation
Xie, H., Yao, H., Zhou, S., Zhang, S., & Sun, W. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00134 · Cited by 185
Flow Guided Recurrent Neural Encoder for Video Salient Object Detection
Li, G., Xie, Y., Wei, T., Wang, K., & Lin, L. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00342 · Cited by 184
Accel: A Corrective Fusion Network for Efficient Semantic Segmentation on Video
Jain, S., Wang, X., & Gonzalez, J. E. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00907 · Cited by 184
Learning Video Object Segmentation From Unlabeled Videos
Lu, X., Wang, W., Shen, J., Tai, Y.-W., Crandall, D. J., & Hoi, S. C. H. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00898 · Cited by 184
Self-citationTF-Blender: Temporal Feature Blender for Video Object Detection
Cui, Y., Yan, L., Cao, Z., & Liu, D. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00803 · Cited by 184
Motion Coherent Tracking with Multi-label MRF optimization
Tsai, D., Flagg, M., & Rehg, J. (2010) · Procedings of the British Machine Vision Conference 2010 · doi:10.5244/c.24.56 · Cited by 183
Semantic Instance Segmentation via Deep Metric Learning
Fathi, A., Wojna, Z., Rathod, V., Wang, P., Song, H. O., Guadarrama, S., & Murphy, K. P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.10277 · Cited by 182
Lucid Data Dreaming for Video Object Segmentation
Khoreva, A., Benenson, R., Ilg, E., Brox, T., & Schiele, B. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-019-01164-6 · Cited by 181
Motion-Attentive Transition for Zero-Shot Video Object Segmentation
Zhou, T., Wang, S., Zhou, Y., Yao, Y., Li, J., & Shao, L. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.7008 · Cited by 179
Self-citationTracking by Natural Language Specification
Li, Z., Tao, R., Gavves, E., Snoek, C. G. M., & Smeulders, A. W. M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.777 · Cited by 177
Long-Term Tracking in the Wild: A Benchmark
Valmadre, J., Bertinetto, L., Henriques, J. F., Ran, T., Vedaldi, A., Smeulders, A. W. M., Torr, P. H. S., & Gavves, E. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01219-9_41 · Cited by 176
Geodesic image and video editing
Criminisi, A., Sharp, T., Rother, C., & P'erez, P. (2010) · ACM Transactions on Graphics · doi:10.1145/1857907.1857910 · Cited by 175
Maximum weight cliques with mutex constraints for video object segmentation
Ma, T., & Latecki, L. J. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247735 · Cited by 175
Feature Space Optimization for Semantic Video Segmentation
Kundu, A., Vineet, V., & Koltun, V. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.345 · Cited by 175
Video segmentation by tracing discontinuities in a trajectory embedding
Fragkiadaki, K., Zhang, G., & Shi, J. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247883 · Cited by 174
URVOS: Unified Referring Video Object Segmentation Network with a Large-Scale Benchmark
Seo, S., Lee, J.-Y., & Han, B. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58555-6_13 · Cited by 174
SwiftNet: Real-time Video Object Segmentation
Wang, H., Jiang, X., Ren, H., Hu, Y., & Bai, S. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00135 · Cited by 174
Fully Connected Object Proposals for Video Segmentation
Perazzi, F., Wang, O., Gross, M., & Sorkine-Hornung, A. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.369 · Cited by 173
Unidentified Video Objects: A Benchmark for Dense, Open-World Segmentation
Wang, W., Feiszli, M., Wang, H., & Tran, D. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01060 · Cited by 173
Self-citationMAST: A Memory-Augmented Self-Supervised Tracker
Lai, Z., Lu, E., & Xie, W. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00651 · Cited by 170
Zero-Shot Video Object Segmentation with Co-Attention Siamese Networks
Lu, X., Wang, W., Shen, J., Crandall, D., & Luo, J. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3040258 · Cited by 170
Self-citationVideo Object Segmentation with Language Referring Expressions
Khoreva, A., Rohrbach, A., & Schiele, B. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-20870-7_8 · Cited by 168
Dynamic Video Segmentation Network
Xu, Y.-S., Fu, T.-J., Yang, H.-K., & Lee, C. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00686 · Cited by 167
Naive-Student: Leveraging Semi-Supervised Learning in Video Sequences for Urban Scene Segmentation
Chen, L.-C., Lopes, R. G., Cheng, B., Collins, M. D., Cubuk, E. D., Zoph, B., Adam, H., & Shlens, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58545-7_40 · Cited by 165
Kim, D., Woo, S., Lee, J.-Y., & Kweon, I. S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00988 · Cited by 165
MoNet: Deep Motion Exploitation for Video Object Segmentation
Xiao, H., Feng, J., Lin, G., Liu, Y., & Zhang, M. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00125 · Cited by 164
Classifying, Segmenting, and Tracking Object Instances in Video with Mask Propagation
Bertasius, G., & Torresani, L. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00976 · Cited by 164
Unsupervised Moving Object Detection via Contextual Information Separation
Yang, Y., Loquercio, A., Scaramuzza, D., & Soatto, S. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00097 · Cited by 163
Pyramid Constrained Self-Attention Network for Fast Video Salient Object Detection
Gu, Y., Wang, L., Wang, Z., Liu, Y., Cheng, M.-M., & Lu, S.-P. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6718 · Cited by 163
Semi-Supervised Video Object Segmentation with Super-Trajectories
Wang, W., Shen, J., Porikli, F., & Yang, R. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2819173 · Cited by 161
Self-citationLearning What to Learn for Video Object Segmentation
Bhat, G., Lawin, F. J., Danelljan, M., Robinson, A., Felsberg, M., Van Gool, L., & Timofte, R. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58536-5_46 · Cited by 160
Low-Latency Video Semantic Segmentation
Li, Y., Shi, J., & Lin, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00628 · Cited by 160
SipMask: Spatial Information Preservation for Fast Image and Video Instance Segmentation
Cao, J., Anwer, R. M., Cholakkal, H., Khan, F. S., Pang, Y., & Shao, L. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58568-6_1 · Cited by 160
Learning Fast and Robust Target Models for Video Object Segmentation
Robinson, A., Jaremo Lawin, F., Danelljan, M., Khan, F. S., & Felsberg, M. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00743 · Cited by 158
A Transductive Approach for Video Object Segmentation
Zhang, Y., Wu, Z., Peng, H., & Lin, S. C.-F. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00698 · Cited by 158
Fast Video Object Segmentation Using the Global Context Module
Li, Y., Shen, Z., & Shan, Y. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58607-2_43 · Cited by 158
State-Aware Tracker for Real-Time Video Object Segmentation
Chen, X., Li, Z., Yuan, Y., Yu, G., Shen, J., & Qi, D. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00940 · Cited by 156
Segmenting Objects From Relational Visual Data
Lu, X.-K., Wang, W.-G., Shen, J.-B., Crandall, D. J., & van Gool, L. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3115815 · Cited by 156
Self-citationLearning Position and Target Consistency for Memory-based Video Object Segmentation
Hu, L., Zhang, P., Zhang, B., Pan, P., Xu, Y., & Jin, R. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00413 · Cited by 154
Unsupervised Video Object Segmentation with Motion-Based Bilateral Networks
Li, S., Seybold, B., Vorobyov, A., Lei, X., & Kuo, C. ‐. J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01219-9_13 · Cited by 151
Crossover Learning for Fast Online Video Instance Segmentation
Yang, S., Fang, Y., Wang, X., Li, Y., Chen, F., Shan, Y., Feng, B., & Liu, W. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00794 · Cited by 150
Tracking as Repeated Figure/Ground Segmentation
Ren, X., & Malik, J. (2007) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2007.383177 · Cited by 148
Efficient Uncertainty Estimation for Semantic Segmentation in Videos
Huang, P., Hsu, W., Chiu, C.-Y., Wu, T., & Sun, M. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01246-5_32 · Cited by 143
Label propagation in video sequences
Badrinarayanan, V., Galasso, F., & Cipolla, R. (2010) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2010.5540054 · Cited by 141
Efficient Semantic Video Segmentation with Per-Frame Inference
Liu, Y., Shen, C., Yu, C., & Wang, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58607-2_21 · Cited by 139
Anchor Diffusion for Unsupervised Video Object Segmentation
Yang, Z., Wang, Q., Bertinetto, L., Bai, S., Hu, W., & Torr, P. H. S. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00102 · Cited by 138
Learning to Segment Moving Objects
Tokmakov, P., Schmid, C., & Alahari, K. (2018) · International Journal of Computer Vision · doi:10.1007/s11263-018-1122-2 · Cited by 137
Local-Global Context Aware Transformer for Language-Guided Video Segmentation
Liang, C., Wang, W., Zhou, T., Miao, J., Luo, Y., & Yang, Y. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3262578 · Cited by 135
Self-citationCan humans fly? Action understanding with multiple classes of actors
Xu, C., Hsieh, S.-H., Xiong, C., & Corso, J. J. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298839 · Cited by 133
Discriminative Segment Annotation in Weakly Labeled Video
Tang, K., Sukthankar, R., Yagnik, J., & Fei-Fei, L. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.321 · Cited by 129
Three Ways to Improve Semantic Segmentation with Self-Supervised Depth Estimation
Hoyer, L., Dai, D., Chen, Y., Köring, A., Saha, S., & Gool, L. V. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01098 · Cited by 128
Fan, Q., Zhong, F., Lischinski, D., Cohen‐Or, D., & Chen, B. (2015) · ACM Transactions on Graphics · doi:10.1145/2816795.2818105 · Cited by 125
Video Segmentation with Just a Few Strokes
Nagaraja, N. S., Schmidt, F. R., & Brox, T. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.370 · Cited by 123
Online Video Object Segmentation via Convolutional Trident Network
Jang, W.-D., & Kim, C. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.790 · Cited by 123
Instance Embedding Transfer to Unsupervised Video Object Segmentation
Li, S., Seybold, B., Vorobyov, A., Fathi, A., Huang, Q., & Kuo, C. ‐. J. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00683 · Cited by 123
Betrayed by Motion: Camouflaged Object Discovery via Motion Segmentation
Lamdouar, H., Yang, C., Xie, W., & Zisserman, A. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-69532-3_30 · Cited by 123
SeamSeg: Video Object Segmentation Using Patch Seams
Ramakanth, S. A., & Babu, R. V. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.55 · Cited by 121
Paying Attention to Video Object Pattern Understanding
Wang, W.-G., Shen, J.-B., Lu, X., Hoi, S., & Ling, H. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2966453 · Cited by 120
Self-citationChang, Y., Medioni, G. G., Kang, J., & Cohen, I. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1084 · Cited by 118
Reciprocal Transformations for Unsupervised Video Object Segmentation
Ren, S., Liu, W., Liu, Y., Chen, H., Han, G., & He, S. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01520 · Cited by 118
From Lifestyle Vlogs to Everyday Interactions
Fouhey, D. F., Kuo, W., Efros, A. A., & Malik, J. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00524 · Cited by 117
Video Instance Segmentation with a Propose-Reduce Paradigm
Lin, H., Wu, R., Liu, S., Lu, J., & Jia, J. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00176 · Cited by 116
JOTS: Joint Online Tracking and Segmentation
Wen, L., Du, D., Lei, Z., Li, S. Z., & Yang, M. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298835 · Cited by 113
Track and Segment: An Iterative Unsupervised Approach for Video Object Proposals
Xiao, F., & Lee, Y. J. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.107 · Cited by 113
Cited by
VideoMAC: Video Masked Autoencoders Meet ConvNets
Pei, G., Chen, T., Jiang, X., Liu, H., Sun, Z., & Yao, Y. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.02145 · Cited by 23
“Recently, researchers have embarked on exploring MVM approaches [16, 19, 65, 66] to comprehend unsupervised video representations, exhibiting effectiveness across a multitude of downstream tasks [4, 25, 31, 32, 40–44, 60, 61, 71, 74, 75].”
Background
Metadata
- Authors
- Zhou, T., Porikli, F., Crandall, D. J., Van Gool, L., & Wang, W.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2023-06-01
- Volume
- 45
- Issue
- 6
- Pages
- 7099-7122
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W3182236906
- Cited by
- 255
- References
- 264
- FWCI
- 17.89
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.