The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Saliency-Aware Video Object Segmentation
Abstract
Video saliency, aiming for estimation of a single dominant object in a sequence, offers strong object-level cues for unsupervised video object segmentation. In this paper, we present a geodesic distance based technique that provides reliable and temporally consistent saliency measurement of superpixels as a prior for pixel-wise labeling. Using undirected intra-frame and inter-frame graphs constructed from spatiotemporal edges or appearance and motion, and a skeleton abstraction step to further enhance saliency estimates, our method formulates the pixel-wise segmentation task as an energy minimization problem on a function that consists of unary terms of global foreground and background models, dynamic location models, and pairwise terms of label smoothness potentials. We perform extensive quantitative and qualitative experiments on benchmark datasets. Our method achieves superior performance in comparison to the current state-of-the-art in terms of accuracy and speed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A feature-integration theory of attention.
Treisman, A. M., & Gelade, G. (1980) · Cognitive Psychology · doi:10.1016/0010-0285(80)90005-5 · Cited by 12,366
A model of saliency-based visual attention for rapid scene analysis
Itti, L., Koch, C., & Niebur, E. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.730558 · Cited by 11,271
SLIC Superpixels Compared to State-of-the-Art Superpixel Methods
Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., & Süsstrunk, S. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.120 · Cited by 9,201
Fast approximate energy minimization via graph cuts
Boykov, Y., Veksler, O., & Zabih, R. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.969114 · Cited by 6,988
GrabCut: Interactive foreground extraction using iterated graph cuts
Rother, C., Kolmogorov, V., & Blake, A. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015720 · Cited by 5,703
Frequency-tuned salient region detection
Achanta, R., Hemami, S., Estrada, F., & Susstrunk, S. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206596 · Cited by 4,167
Harel, J., Koch, C., & Perona, P. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0073 · Cited by 3,439
Saliency Detection via Graph-Based Manifold Ranking
Yang, C., Zhang, L., Lu, H., Ruan, X., & Yang, M.-H. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.407 · Cited by 2,554
Saliency filters: Contrast based filtering for salient region detection
Perazzi, F., Krahenbuhl, P., Pritch, Y., & Hornung, A. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247743 · Cited by 2,110
A Benchmark Dataset and Evaluation Methodology for Video Object Segmentation
Perazzi, F., Pont-Tuset, J., McWilliams, B., Van Gool, L., Gross, M., & Sorkine-Hornung, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.85 · Cited by 1,989
ViBe: A Universal Background Subtraction Algorithm for Video Sequences
Barnich, O., & Van Droogenbroeck, M. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2101613 · Cited by 1,885
Saliency Optimization from Robust Background Detection
Zhu, W., Liang, S., Wei, Y., & Sun, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.360 · Cited by 1,330
Large Displacement Optical Flow: Descriptor Matching in Variational Motion Estimation
Brox, T., & Malik, J. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.143 · Cited by 1,295
Efficient Algorithms for Shortest Paths in Sparse Networks
Johnson, D. B. (1977) · Journal of the ACM · doi:10.1145/321992.321993 · Cited by 1,041
Geodesic Saliency Using Background Priors
Wei, Y., Wen, F., Zhu, W., & Sun, J. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33712-3_3 · Cited by 842
Alexe, B., Deselaers, T., & Ferrari, V. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540226 · Cited by 776
Spatio-temporal Saliency detection using phase spectrum of quaternion fourier transform
Guo, C., Ma, Q., & Zhang, L. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587715 · Cited by 754
Context-aware saliency detection
Goferman, S., Zelnik-Manor, L., & Tal, A. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539929 · Cited by 753
Object Segmentation by Long Term Analysis of Point Trajectories
Brox, T., & Malik, J. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15555-0_21 · Cited by 744
Static and space-time visual saliency detection by self-resemblance
Seo, H. J., & Milanfar, P. (2009) · Journal of Vision · doi:10.1167/9.12.15 · Cited by 633
Efficient hierarchical graph-based video segmentation
Grundmann, M., Kwatra, V., Han, M., & Essa, I. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539893 · Cited by 628
Efficient Salient Region Detection with Soft Image Abstraction
Cheng, M.-M., Warrell, J., Lin, W.-Y., Zheng, S., Vineet, V., & Crook, N. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.193 · Cited by 568
Fast Object Segmentation in Unconstrained Video
Papazoglou, A., & Ferrari, V. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.223 · Cited by 533
Saliency-aware geodesic video object segmentation
Wang, W., Shen, J., & Porikli, F. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298961 · Cited by 524
Self-citationSegmenting Salient Objects from Images and Videos
Rahtu, E., Kannala, J., Salo, M., & Heikkilä, J. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15555-0_27 · Cited by 520
Video Segmentation by Tracking Many Figure-Ground Segments
Li, F., Kim, T., Humayun, A., Tsai, D., & Rehg, J. M. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.273 · Cited by 512
Wang, S., Lu, H., Yang, F., & Yang, M.-H. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126385 · Cited by 479
Key-segments for video object segmentation
Lee, Y. J., Kim, J., & Grauman, K. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126471 · Cited by 443
A Geodesic Framework for Fast Interactive Image and Video Segmentation and Matting
Bai, X., & Sapiro, G. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4408931 · Cited by 438
Category Independent Object Proposals
Endres, I., & Hoiem, D. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15555-0_42 · Cited by 432
Cluster-Based Co-Saliency Detection
Fu, H., Cao, X., & Tu, Z. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2260166 · Cited by 427
Constrained parametric min-cuts for automatic object segmentation
Carreira, J., & Sminchisescu, C. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540063 · Cited by 420
Spatiotemporal Saliency in Dynamic Scenes
Mahadevan, V., & Vasconcelos, N. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.112 · Cited by 409
Center-surround divergence of feature statistics for salient object detection
Klein, D. A., & Frintrop, S. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126499 · Cited by 369
Detection of Co-salient Objects by Looking Deep and Wide
Zhang, D., Han, J., Li, C., Wang, J., & Li, X. (2016) · International Journal of Computer Vision · doi:10.1007/s11263-016-0907-4 · Cited by 328
Video Segmentation via Object Flow
Tsai, Y.-H., Yang, M.-H., & Black, M. J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.423 · Cited by 318
Zhang, D., Javed, O., & Shah, M. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.87 · Cited by 309
GeoS: Geodesic Image Segmentation
Criminisi, A., Sharp, T., & Blake, A. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88682-2_9 · Cited by 277
Video Segmentation by Non-Local Consensus voting.
Faktor, A., & Irani, M. (2014) · Cited by 235
Motion Coherent Tracking Using Multi-label MRF Optimization
Tsai, D., Flagg, M., Nakazawa, A., & Rehg, J. M. (2012) · International Journal of Computer Vision · doi:10.1007/s11263-011-0512-5 · Cited by 216
Bottom-up saliency is a discriminant process
Gao, D., & Vasconcelos, N. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4408851 · Cited by 214
Ochs, P., & Brox, T. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126418 · Cited by 205
The discriminant center-surround hypothesis for bottom-up saliency
Gao, D., Mahadevan, V., & Vasconcelos, N. M. (2007) · neural information processing systems · Cited by 195
Learning to segment moving objects in videos
Fragkiadaki, K., Arbelaez, P., Felsen, P., & Malik, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299035 · Cited by 193
Hough-based tracking of non-rigid objects
Godec, M., Roth, P. M., & Bischof, H. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126228 · Cited by 193
Track to the future: Spatio-temporal video segmentation with long-range motion cues
Lezama, J., Alahari, K., Sivic, J., & Laptev, I. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.6044588 · Cited by 184
Geodesic graph cut for interactive image segmentation
Price, B. L., Morse, B., & Cohen, S. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540079 · Cited by 181
Geodesic image and video editing
Criminisi, A., Sharp, T., Rother, C., & P'erez, P. (2010) · ACM Transactions on Graphics · doi:10.1145/1857907.1857910 · Cited by 175
Maximum weight cliques with mutex constraints for video object segmentation
Ma, T., & Latecki, L. J. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247735 · Cited by 175
Video segmentation by tracing discontinuities in a trajectory embedding
Fragkiadaki, K., Zhang, G., & Shi, J. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247883 · Cited by 174
Cosaliency Detection Based on Intrasaliency Prior Transfer and Deep Intersaliency Mining
Zhang, D., Han, J., Han, J., & Shao, L. (2016) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2495161 · Cited by 164
Correspondence Driven Saliency Transfer
Wang, W., Shen, J., Shao, L., et al. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2601784 · Cited by 143
Self-citationRobust Video Object Cosegmentation
Wang, W., Shen, J., Li, X., & Porikli, F. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2438550 · Cited by 135
Self-citationAdaptive fragments-based tracking of non-rigid objects using level sets
Chockalingam, P., Pradeep, N., & Birchfield, S. T. (2009) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2009.5459276 · Cited by 131
Time-Mapping Using Space-Time Saliency
Zhou, F., Kang, S. B., & Cohen, M. F. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.429 · Cited by 124
Probabilistic learning of task-specific visual attention
Borji, A., Sihite, D. N., & Itti, L. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247710 · Cited by 124
JOTS: Joint Online Tracking and Segmentation
Wen, L., Du, D., Lei, Z., Li, S. Z., & Yang, M. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298835 · Cited by 113
Track and Segment: An Iterative Unsupervised Approach for Video Object Proposals
Xiao, F., & Lee, Y. J. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.107 · Cited by 113
Efficient Closed-Form Solution to Generalized Boundary Detection
Leordeanu, M., Sukthankar, R., & Sminchisescu, C. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33765-9_37 · Cited by 84
Cited by
Salient Object Detection in the Deep Learning Era: An In-Depth Survey
Wang, W., Lai, Q., Fu, H., Shen, J., Ling, H., & Yang, R. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3051099 · Cited by 811
Self-citationVideo Salient Object Detection via Fully Convolutional Networks
Wang, W., Shen, J., & Shao, L. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2754941 · Cited by 642
Self-citationDeep Visual Attention Prediction
Wang, W., & Shen, J. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2787612 · Cited by 585
Self-citationShifting More Attention to Video Salient Object Detection
Fan, D.-P., Wang, W., Cheng, M.-M., & Shen, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00875 · Cited by 510
Self-citationPyramid Dilated Deeper ConvLSTM for Video Salient Object Detection
Song, H., Wang, W., Zhao, S., Shen, J., & Lam, K.-M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01252-6_44 · Cited by 492
Self-citation
Metadata
- Authors
- Wang, W., Shen, J., Yang, R., & Porikli, F.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2018-01-01
- Volume
- 40
- Issue
- 1
- Pages
- 20-33
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- OpenAlex
- W2585592883
- Cited by
- 472
- References
- 59
- FWCI
- 25.83
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.