The DOI matches its Crossref record; 83 of the 83 references it cites were found in a registry or an index.
Salient Object Detection via Structured Matrix Decomposition
Abstract
Low-rank recovery models have shown potential for salient object detection, where a matrix is decomposed into a low-rank matrix representing image background and a sparse matrix identifying salient objects. Two deficiencies, however, still exist. First, previous work typically assumes the elements in the sparse matrix are mutually independent, ignoring the spatial and pattern relations of image regions. Second, when the low-rank and sparse matrices are relatively coherent, e.g., when there are similarities between the salient objects and background or when the background is complicated, it is difficult for previous models to disentangle them. To address these problems, we propose a novel structured matrix decomposition model with two structural regularizations: (1) a tree-structured sparsity-inducing regularization that captures the image structure and enforces patches from the same object to have similar saliency values, and (2) a Laplacian regularization that enlarges the gaps between salient objects and the background in feature space. Furthermore, high-level priors are integrated to guide the matrix decomposition and boost the detection. We evaluate our model for salient object detection on five challenging datasets including single object, multiple objects and complex scene images, and show competitive results as compared with 24 state-of-the-art methods in terms of seven performance metrics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A feature-integration theory of attention.
Treisman, A. M., & Gelade, G. (1980) · Cognitive Psychology · doi:10.1016/0010-0285(80)90005-5 · Cited by 12,366
A model of saliency-based visual attention for rapid scene analysis
Itti, L., Koch, C., & Niebur, E. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.730558 · Cited by 11,271
SLIC Superpixels Compared to State-of-the-Art Superpixel Methods
Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., & Süsstrunk, S. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.120 · Cited by 9,201
Robust principal component analysis?
Candès, E. J., Li, X., Ma, Y., & Wright, J. (2011) · Journal of the ACM · doi:10.1145/1970392.1970395 · Cited by 6,921
Efficient Graph-Based Image Segmentation
Felzenszwalb, P. F., & Huttenlocher, D. P. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000022288.19776.77 · Cited by 6,176
A Singular Value Thresholding Algorithm for Matrix Completion
Cai, J.-F., Candès, E. J., & Shen, Z. (2010) · SIAM Journal on Optimization · doi:10.1137/080738970 · Cited by 5,809
Frequency-tuned salient region detection
Achanta, R., Hemami, S., Estrada, F., & Susstrunk, S. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206596 · Cited by 4,167
Shifts in Selective Visual Attention: Towards the Underlying Neural Circuitry
Koch, C., & Ullman, S. (1987) · Matters of Intelligence · doi:10.1007/978-94-009-3833-5_5 · Cited by 3,722
Robust Recovery of Subspace Structures by Low-Rank Representation
Liu, G., Lin, Z., Yan, S., Sun, J., Yu, Y., & Ma, Y. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.88 · Cited by 3,594
Harel, J., Koch, C., & Perona, P. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0073 · Cited by 3,439
Saliency Detection: A Spectral Residual Approach
Hou, X., & Zhang, L. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383267 · Cited by 3,422
Global contrast based salient region detection
Cheng, M.-M., Zhang, G.-X., Mitra, N. J., Huang, X., & Hu, S.-M. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995344 · Cited by 2,976
Saliency Detection via Graph-Based Manifold Ranking
Yang, C., Zhang, L., Lu, H., Ruan, X., & Yang, M.-H. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.407 · Cited by 2,554
Global Contrast Based Salient Region Detection
Cheng, M.-M., Mitra, N. J., Huang, X., Torr, P. H. S., & Hu, S.-M. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2345401 · Cited by 2,463
Graph Regularized Nonnegative Matrix Factorization for Data Representation
Cai, D., He, X., Han, J., & Huang, T. S. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.231 · Cited by 2,451
Saliency filters: Contrast based filtering for salient region detection
Perazzi, F., Krahenbuhl, P., Pritch, Y., & Hornung, A. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247743 · Cited by 2,110
Learning to predict where humans look
Judd, T., Ehinger, K., Durand, F., & Torralba, A. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459462 · Cited by 2,016
Learning to Detect a Salient Object
Liu, T., Yuan, Z., Sun, J., Wang, J., Zheng, N., Tang, X., & Shum, H.-Y. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.70 · Cited by 1,777
Hierarchical Saliency Detection
Yan, Q., Xu, L., Shi, J., & Jia, J. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.153 · Cited by 1,773
Context-Aware Saliency Detection
Goferman, S., Zelnik-Manor, L., & Tal, A. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.272 · Cited by 1,567
Salient Object Detection: A Benchmark
Borji, A., Cheng, M.-M., Jiang, H., & Li, J. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2487833 · Cited by 1,364
Saliency Optimization from Robust Background Detection
Zhu, W., Liang, S., Wei, Y., & Sun, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.360 · Cited by 1,330
Modeling attention to salient proto-objects
Walther, D., & Koch, C. (2006) · Neural Networks · doi:10.1016/j.neunet.2006.10.001 · Cited by 1,249
Measuring the Objectness of Image Windows
Alexe, B., Deselaers, T., & Ferrari, V. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.28 · Cited by 1,186
Multiscale Combinatorial Grouping
Arbelaez, P., Pont-Tuset, J., Barron, J., Marques, F., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.49 · Cited by 1,155
Salient Object Detection: A Discriminative Regional Feature Integration Approach
Jiang, H., Wang, J., Yuan, Z., Wu, Y., Zheng, N., & Li, S. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.271 · Cited by 1,147
Saliency Based on Information Maximization
Bruce, N. D. B., & Tsotsos, J. K. (2005) · neural information processing systems · Cited by 1,134
How to Evaluate Foreground Maps
Margolin, R., Zelnik-Manor, L., & Tal, A. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.39 · Cited by 1,106
The steerable pyramid: a flexible architecture for multi-scale derivative computation
Simoncelli, E. P., & Freeman, W. T. (2002) · Proceedings., International Conference on Image Processing · doi:10.1109/icip.1995.537667 · Cited by 1,070
Linearized Alternating Direction Method with Adaptive Penalty for Low-Rank Representation
Lin, Z., Liu, R., & Su, Z. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1109.0367 · Cited by 992
Visual attention detection in video sequences using spatiotemporal cues
Zhai, Y., & Shah, M. (2006) · Proceedings of the 14th ACM international conference on Multimedia · doi:10.1145/1180639.1180824 · Cited by 959
Geodesic Saliency Using Background Priors
Wei, Y., Wen, F., Zhu, W., & Sun, J. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33712-3_3 · Cited by 842
Image Signature: Highlighting Sparse Salient Regions
Hou, X., Harel, J., & Koch, C. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.146 · Cited by 834
1Salient Object Detection: A Survey
Borji, A., Jiang, H., & Li, J. (2016) · Cited by 761
Context-aware saliency detection
Goferman, S., Zelnik-Manor, L., & Tal, A. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539929 · Cited by 753
Saliency Detection via Dense and Sparse Reconstruction
Li, X., Lu, H., Zhang, L., Ruan, X., & Yang, M.-H. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.370 · Cited by 707
A unified approach to salient object detection via low rank matrix recovery
Shen, X., & Wu, Y. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247758 · Cited by 691
Zhou, D., Weston, J., Gretton, A., Bousquet, O., & Schölkopf, B. (2003) · MPG.PuRe (Max Planck Society) · Cited by 682
RGBD Salient Object Detection: A Benchmark and Algorithms
Peng, H., Li, B., Xiong, W., Hu, W., & Ji, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10578-9_7 · Cited by 668
Self-citationQuantitative Analysis of Human-Model Agreement in Visual Saliency Modeling: A Comparative Study
Borji, A., Sihite, D. N., & Itti, L. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2210727 · Cited by 613
Saliency Detection via Absorbing Markov Chain
Jiang, B., Zhang, L., Lu, H., Yang, C., & Yang, M.-H. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.209 · Cited by 602
(1998) · doi:10.1007/978-1-4612-2016-9 · Cited by 598
Is bottom-up attention useful for object recognition?
Rutishauser, U., Walther, D., Koch, C., & Perona, P. (2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315142 · Cited by 592
Grassmann discriminant analysis: a unifying view on subspace-based learning
Hamm, J., & Lee, D. D. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390204 · Cited by 592
Sketch2Photo: internet image montage
Chen, T., Cheng, M.-M., Tan, P., Shamir, A., & Hu, S.-M. (2009) · ACM Transactions on Graphics · doi:10.1145/1618452.1618470 · Cited by 574
Visual Saliency Based on Scale-Space Analysis in the Frequency Domain
Li, J., Levine, M. D., An, X., Xu, X., & He, H. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.147 · Cited by 574
Efficient Salient Region Detection with Soft Image Abstraction
Cheng, M.-M., Warrell, J., Lin, W.-Y., Zheng, S., Vineet, V., & Crook, N. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.193 · Cited by 568
Segmenting Salient Objects from Images and Videos
Rahtu, E., Kannala, J., Salo, M., & Heikkilä, J. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15555-0_27 · Cited by 520
Margolin, R., Tal, A., & Zelnik-Manor, L. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.151 · Cited by 513
A Benchmark of Computational Models of Saliency to Predict Human Fixations
Judd, T., Durand, F., & Torralba, A. B. (2012) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 511
Saliency Detection: A Boolean Map Approach
Zhang, J., & Sclaroff, S. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.26 · Cited by 495
Leveraging stereopsis for saliency analysis
Niu, Y., Geng, Y., Li, X., & Liu, F. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247708 · Cited by 479
Design and perceptual validation of performance measures for salient object segmentation
Movahedi, V., & Elder, J. H. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops · doi:10.1109/cvprw.2010.5543739 · Cited by 469
Automatic salient object segmentation based on context and shape prior
Jiang, H., Wang, J., Yuan, Z., Liu, T., & Zheng, N. (2011) · Procedings of the British Machine Vision Conference 2011 · doi:10.5244/c.25.110 · Cited by 450
Salient Object Detection: A Benchmark
Borji, A., Sihite, D. N., & Itti, L. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33709-3_30 · Cited by 416
Center-surround divergence of feature statistics for salient object detection
Klein, D. A., & Frintrop, S. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126499 · Cited by 369
An Integrated Model of Top-Down and Bottom-Up Attention for Optimizing Detection Speed
Navalpakkam, V., & Itti, L. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.54 · Cited by 369
Fusing generic objectness and visual saliency for salient object detection
Chang, K.-Y., Liu, T.-L., Chen, H.-T., & Lai, S.-H. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126333 · Cited by 345
A framework for visual saliency detection with applications to image thumbnailing
Marchesotti, L., Cifarelli, C., & Csurka, G. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459467 · Cited by 322
Salient Region Detection by UFO: Uniqueness, Focusness and Objectness
Jiang, P., Ling, H., Yu, J., & Peng, J. (2013) · IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.248 · Cited by 313
Self-citationSuperCNN: A Superpixelwise Convolutional Neural Network for Salient Object Detection
He, S., Lau, R. W. H., Liu, W., Huang, Z., & Yang, Q. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0822-0 · Cited by 289
Salient Region Detection via High-Dimensional Color Transform
Kim, J., Han, D., Tai, Y.-W., & Kim, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.118 · Cited by 273
Proximal Methods for Hierarchical Sparse Coding
Jenatton, R., Mairal, J., Obozinski, G., & Bach, F. (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1009.2139 · Cited by 272
Learning a saliency map using fixated locations in natural scenes
Zhao, Q., & Koch, C. (2011) · Journal of Vision · doi:10.1167/11.3.9 · Cited by 256
Contextual Hypergraph Modeling for Salient Object Detection
Li, X., Li, Y., Shen, C., Dick, A., & Hengel, A. V. D. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.413 · Cited by 205
The discriminant center-surround hypothesis for bottom-up saliency
Gao, D., Mahadevan, V., & Vasconcelos, N. M. (2007) · neural information processing systems · Cited by 195
Saliency Detection by Multitask Sparsity Pursuit
Lang, C., Liu, G., Yu, J., & Yan, S. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2169274 · Cited by 195
Depth Enhancement via Low-Rank Matrix Completion
Lu, S., Ren, X., & Liu, F. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.433 · Cited by 190
Visual Saliency Detection via Sparsity Pursuit
Yan, J., Zhu, M., Liu, H., & Liu, Y. (2010) · IEEE Signal Processing Letters · doi:10.1109/lsp.2010.2053200 · Cited by 171
Moreau-Yosida Regularization for Grouped Tree Structure Learning
Liu, J., & Ye, J. (2010) · Cited by 158
Top-Down Visual Saliency via Joint CRF and Dictionary Learning
Yang, J., & Yang, M. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2547384 · Cited by 158
Saliency Aggregation: A Data-Driven Approach
Mai, L., Niu, Y., & Liu, F. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.150 · Cited by 152
Category-Independent Object-Level Saliency Detection
Jia, Y., & Han, M. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.221 · Cited by 138
Statistical Textural Distinctiveness for Salient Region Detection in Natural Images
Scharfenberger, C., Wong, A. M., Fergani, K., Zelek, J., & Clausi, D. A. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.131 · Cited by 133
Robust and Practical Face Recognition via Structured Sparsity
Jia, K., Chan, T., & Ma, Y. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33765-9_24 · Cited by 120
Interactively Co-segmentating Topically Related Images with Intelligent Scribble Guidance
Batra, D., Kowdle, A., Parikh, D., Luo, J., & Chen, T. (2011) · International Journal of Computer Vision · doi:10.1007/s11263-010-0415-x · Cited by 116
Learning visual saliency by combining feature maps in a nonlinear manner using AdaBoost
Zhao, Q., & Koch, C. (2012) · Journal of Vision · doi:10.1167/12.6.22 · Cited by 111
Learning saliency-based visual attention: A review
Zhao, Q., & Koch, C. (2012) · Signal Processing · doi:10.1016/j.sigpro.2012.06.014 · Cited by 103
Segmentation Driven Low-rank Matrix Recovery for Saliency Detection
Zou, W., Kpalma, K., Liu, Z., & Ronsin, J. (2013) · British Machine Vision Conference (BMVC) · doi:10.5244/c.27.78 · Cited by 103
Salient object detection for searched web images via global saliency
Wang, P., Wang, J., Zeng, G., Feng, J. M., Zha, H., & Li, S. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6248054 · Cited by 97
Region Enhanced Scale-Invariant Saliency Detection
Liu, F., & Gleicher, M. L. (2006) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2006.262821 · Cited by 92
Scale and Object Aware Image Thumbnailing
Sun, J. G., & Ling, H. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-013-0618-z · Cited by 72
Self-citationJiang, M. X., Xu, J., & Zhao, Q. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10584-0_2 · Cited by 67
Cited by
Salient Object Detection in the Deep Learning Era: An In-Depth Survey
Wang, W., Lai, Q., Fu, H., Shen, J., Ling, H., & Yang, R. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3051099 · Cited by 811
Self-citationEmerging From Water: Underwater Image Color Correction Based on Weakly Supervised Color Transfer
Li, C., Guo, J., & Guo, C. (2018) · IEEE Signal Processing Letters · doi:10.1109/lsp.2018.2792050 · Cited by 531
Du, G., Wang, K., Lian, S., & Zhao, K. (2021) · Artificial Intelligence Review · doi:10.1007/s10462-020-09888-5 · Cited by 475
Review of Visual Saliency Detection With Comprehensive Information
Cong, R., Lei, J., Fu, H., Cheng, M.-M., Lin, W., & Huang, Q. (2019) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2018.2870832 · Cited by 419
Dense Attention Fluid Network for Salient Object Detection in Optical Remote Sensing Images
Zhang, Q., Cong, R., Li, C., Cheng, M.-M., Fang, Y., Cao, X., Zhao, Y., & Kwong, S. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3042084 · Cited by 350
Metadata
- Authors
- Peng, H., Li, B., Ling, H., Hu, W., Xiong, W., & Maybank, S. J.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2017-04-01
- Volume
- 39
- Issue
- 4
- Pages
- 818-832
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- OpenAlex
- W2346506533
- Cited by
- 378
- References
- 83
- FWCI
- 30.12
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.