The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Deep networks for saliency detection via local estimation and global search
Open accessAbstract
This paper presents a saliency detection algorithm by integrating both local estimation and global search. In the local estimation stage, we detect local saliency by using a deep neural network (DNN-L) which learns local patch features to determine the saliency value of each pixel. The estimated local saliency maps are further refined by exploring the high level object concepts. In the global search stage, the local saliency map together with global contrast and geometric information are used as global features to describe a set of object candidate regions. Another deep neural network (DNN-G) is trained to predict the saliency score of each object region based on the global features. The final saliency map is generated by a weighted sum of salient object regions. Our method presents two interesting insights. First, local features learned by a supervised scheme can effectively capture local contrast, texture and shape information for saliency detection. Second, the complex relationship between different global saliency cues can be captured by deep networks and exploited principally rather than heuristically. Quantitative and qualitative experiments on several benchmark data sets demonstrate that our algorithm performs favorably against the state-of-the-art methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
(2010) · International Conference on Machine Learning · Cited by 13,995
A model of saliency-based visual attention for rapid scene analysis
Itti, L., Koch, C., & Niebur, E. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.730558 · Cited by 11,271
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Selective Search for Object Recognition
Uijlings, J. R. R., van de Sande, K. E. A., Gevers, T., & Smeulders, A. W. M. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-013-0620-5 · Cited by 5,980
Frequency-tuned salient region detection
Achanta, R., Hemami, S., Estrada, F., & Susstrunk, S. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206596 · Cited by 4,167
DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition
Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., & Darrell, T. (2013) · arXiv · doi:10.48550/arxiv.1310.1531 · Cited by 4,019 · cited 1×
“Deep neural networks have achieved state-of-the-art re-sults in image classification [21, 8, 34], object detection [35, 10, 12] and scene parsing [9, 30].”
BackgroundHarel, J., Koch, C., & Perona, P. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0073 · Cited by 3,439
Cited by
Recent advances in convolutional neural networks
Gu, J., Wang, Z., Kuen, J., Ma, L., Shahroudy, A., Shuai, B., Liu, T., Wang, X., Wang, G., Cai, J., et al. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.10.013 · Cited by 6,576
Object Detection With Deep Learning: A Review
Zhao, Z.-Q., Zheng, P., Xu, S.-T., & Wu, X. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2876865 · Cited by 5,545
BASNet: Boundary-Aware Salient Object Detection
Qin, X., Zhang, Z., Huang, C., Gao, C., Dehghan, M., & Jagersand, M. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00766 · Cited by 1,565
Learning to Detect Salient Objects with Image-Level Supervision
Wang, L., Lu, H., Wang, Y., Feng, M., Wang, D., Yin, B., & Ruan, X. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.404 · Cited by 1,265
Self-citationEGNet: Edge Guidance Network for Salient Object Detection
Zhao, J., Liu, J.-J., Fan, D.-P., Cao, Y., Yang, J., & Cheng, M.-M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00887 · Cited by 1,202
Deeply Supervised Salient Object Detection with Short Connections
Hou, Q., Cheng, M.-M., Hu, X., Borji, A., Tu, Z., & Torr, P. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.563 · Cited by 1,143
Cascaded Partial Decoder for Fast and Accurate Salient Object Detection
Wu, Z., Su, L., & Huang, Q. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00403 · Cited by 1,136
A Simple Pooling-Based Design for Real-Time Salient Object Detection
Liu, J.-J., Hou, Q., Cheng, M.-M., Feng, J., & Jiang, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00404 · Cited by 1,100
Visual Tracking with Fully Convolutional Networks
Wang, L., Ouyang, W., Wang, X., & Lu, H. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.357 · Cited by 983
Self-citationAmulet: Aggregating Multi-level Convolutional Features for Salient Object Detection
Zhang, P., Wang, D., Lu, H., Wang, H., & Ruan, X. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.31 · Cited by 884
Self-citationDHSNet: Deep Hierarchical Saliency Network for Salient Object Detection
Liu, N., & Han, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.80 · Cited by 833
Salient Object Detection in the Deep Learning Era: An In-Depth Survey
Wang, W., Lai, Q., Fu, H., Shen, J., Ling, H., & Yang, R. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3051099 · Cited by 811
Anabranch network for camouflaged object segmentation
Le, T.-N., Nguyen, T. V., Nie, Z., Tran, M.-T., & Sugimoto, A. (2019) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2019.04.006 · Cited by 764
Deep Contrast Learning for Salient Object Detection
Li, G., & Yu, Y. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.58 · Cited by 704
Deeply Supervised Salient Object Detection with Short Connections
Hou, Q., Cheng, M.-M., Hu, X., Borji, A., Tu, Z., & Torr, P. H. S. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2815688 · Cited by 676
Kokkinos, I. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.579 · Cited by 657
Progressive Attention Guided Recurrent Network for Salient Object Detection
Zhang, X., Wang, T., Qi, J., Lu, H., & Wang, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00081 · Cited by 652
Self-citationVideo Salient Object Detection via Fully Convolutional Networks
Wang, W., Shen, J., & Shao, L. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2754941 · Cited by 642
Non-local Deep Features for Salient Object Detection
Luo, Z., Mishra, A., Achkar, A., Eichel, J., Li, S., & Jodoin, P.-M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.698 · Cited by 621
Advanced Deep-Learning Techniques for Salient and Category-Specific Object Detection: A Survey
Han, J., Zhang, D., Cheng, G., Liu, N., & Xu, D. (2018) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2749125 · Cited by 621
A review of object detection based on deep learning
Xiao, Y., Tian, Z., Yu, J., Zhang, Y., Liu, S., Du, S., & Lan, X. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-020-08976-6 · Cited by 584
“Multi-layer perceptron-based methods include superCNN [83], MAP [271], LEGS [235], and MDF [124].”
MethodDeepSaliency: Multi-Task Deep Neural Network Model for Salient Object Detection
Li, X., Zhao, L., Wei, L., Yang, M.-H., Wu, F., Zhuang, Y., Ling, H., & Wang, J. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2579306 · Cited by 538
Self-citationSalient Object Detection With Pyramid Attention and Salient Edges
Wang, W., Zhao, S., Shen, J., Hoi, S. C. H., & Borji, A. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00154 · Cited by 535
Saliency Detection with Recurrent Fully Convolutional Networks
Wang, L., Wang, L., Lu, H., Zhang, P., & Ruan, X. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_50 · Cited by 509
Self-citationApplication of Deep Learning for Object Detection
Pathak, A. R., Pandey, M., & Rautaray, S. (2018) · Procedia Computer Science · doi:10.1016/j.procs.2018.05.144 · Cited by 505
Attentive Feedback Network for Boundary-Aware Salient Object Detection
Feng, M., Lu, H., & Ding, E. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00172 · Cited by 497
Self-citationR³Net: Recurrent Residual Refinement Network for Saliency Detection
Deng, Z., Hu, X., Zhu, L., Xu, X., Qin, J., Han, G., & Heng, P.-A. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/95 · Cited by 495
Deep Saliency with Encoded Low Level Distance Map and High Level Features
Lee, G., Tai, Y.-W., & Kim, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.78 · Cited by 487
A Bi-Directional Message Passing Model for Salient Object Detection
Zhang, L., Dai, J., Lu, H., He, Y., & Wang, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00187 · Cited by 484
Self-citationLearning Uncertain Convolutional Features for Accurate Saliency Detection
Zhang, P., Wang, D., Lu, H., Wang, H., & Yin, B. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.32 · Cited by 481
Self-citationPredicting Human Eye Fixations via an LSTM-Based Saliency Attentive Model
Cornia, M., Baraldi, L., Serra, G., & Cucchiara, R. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2851672 · Cited by 474
Shallow and Deep Convolutional Networks for Saliency Prediction
Pan, J., Sayrol, E., Giro-I-Nieto, X., McGuinness, K., & OConnor, N. E. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.71 · Cited by 471
Detect Globally, Refine Locally: A Novel Approach to Saliency Detection
Wang, T., Zhang, L., Wang, S., Lu, H., Yang, G., Ruan, X., & Borji, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00330 · Cited by 461
Self-citationSaliency in VR: How Do People Explore Virtual Environments?
Sitzmann, V., Serrano, A., Pavel, A., Agrawala, M., Gutierrez, D., Masia, B., & Wetzstein, G. (2018) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2793599 · Cited by 459
A Stagewise Refinement Model for Detecting Salient Objects in Images
Wang, T., Borji, A., Zhang, L., Zhang, P., & Lu, H. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.433 · Cited by 450
Self-citationStacked Cross Refinement Network for Edge-Aware Salient Object Detection
Wu, Z., Su, L., & Huang, Q. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00736 · Cited by 448
CNNs-Based RGB-D Saliency Detection via Cross-View Transfer and Multiview Fusion
Han, J., Chen, H., Liu, N., Yan, C., & Li, X. (2018) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2017.2761775 · Cited by 423
Visual Saliency Detection Based on Multiscale Deep CNN Features
Li, G., & Yu, Y. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2602079 · Cited by 394
RGBD Salient Object Detection via Deep Fusion
Qu, L., He, S., Zhang, J., Tian, J., Tang, Y., & Yang, Q. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2682981 · Cited by 360
Salient Objects in Clutter: Bringing Salient Object Detection to the Foreground
Fan, D.-P., Cheng, M.-M., Liu, J.-J., Gao, S.-H., Hou, Q., & Borji, A. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01267-0_12 · Cited by 347
Contour Knowledge Transfer for Salient Object Detection
Li, X., Yang, F., Cheng, H., Liu, W., & Shen, D. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01267-0_22 · Cited by 301
Deep learning in multi-object detection and tracking: state of the art
Pal, S. K., Pramanik, A., Maiti, J., & Mitra, P. (2021) · Applied Intelligence · doi:10.1007/s10489-021-02293-7 · Cited by 298
Instance-Level Salient Object Segmentation
Li, G., Xie, Y., Lin, L., & Yu, Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.34 · Cited by 281
SAMNet: Stereoscopically Attentive Multi-Scale Network for Lightweight Salient Object Detection
Liu, Y., Zhang, X.-Y., Bian, J.-W., Zhang, L., & Cheng, M.-M. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3065239 · Cited by 271
Deep reinforcement learning in computer vision: a comprehensive survey
Le, N., Rathour, V. S., Yamazaki, K., Luu, K., & Savvides, M. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-10061-9 · Cited by 261
STCT: Sequentially Training Convolutional Networks for Visual Tracking
Wang, L., Ouyang, W., Wang, X., & Lu, H. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.153 · Cited by 258
Self-citationAdaptive Fusion for RGB-D Salient Object Detection
Wang, N., & Gong, X. (2019) · IEEE Access · doi:10.1109/access.2019.2913107 · Cited by 258
Yang, W., Ouyang, W., Li, H., & Wang, X. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.335 · Cited by 255
Synthesizing Supervision for Learning Deep Saliency Network without Human Annotation
Zhang, D., Han, J., Zhang, Y., & Xu, D. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2900649 · Cited by 118
Metadata
- Authors
- Wang, L., Lu, H., Ruan, X., & Yang, M.-H.
- Venue
- 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2015-06
- Pages
- 3183-3192
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W1947031653
- Cited by
- 676
- References
- 40
- FWCI
- 29.93
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.