The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
CNNs-Based RGB-D Saliency Detection via Cross-View Transfer and Multiview Fusion
Open accessAbstract
Salient object detection from RGB-D images aims to utilize both the depth view and RGB view to automatically localize objects of human interest in the scene. Although a few earlier efforts have been devoted to the study of this paper in recent years, two major challenges still remain: 1) how to leverage the depth view effectively to model the depth-induced saliency and 2) how to implement an optimal combination of the RGB view and depth view, which can make full use of complementary information among them. To address these two challenges, this paper proposes a novel framework based on convolutional neural networks (CNNs), which transfers the structure of the RGB-based deep neural network to be applicable for depth view and fuses the deep representations of both views automatically to obtain the final saliency map. In the proposed framework, the first challenge is modeled as a cross-view transfer problem and addressed by using the task-relevant initialization and adding deep supervision in hidden layer. The second challenge is addressed by a multiview CNN fusion model through a combination layer connecting the representation layers of RGB view and depth view. Comprehensive experiments on four benchmark datasets demonstrate the significant and consistent improvements of the proposed approach over other state-of-the-art methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Learning Internal Representations by Error Propagation
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1985) · doi:10.21236/ada164453 · Cited by 16,172
A model of saliency-based visual attention for rapid scene analysis
Itti, L., Koch, C., & Niebur, E. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.730558 · Cited by 11,271
Large-Scale Video Classification with Convolutional Neural Networks
Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., & Fei-Fei, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.223 · Cited by 6,354 · cited 2×
“Actually, this input fusion strategy even cannot guarantee the improvement after view fusion, which has been observed in [43].”
BackgroundResultShifts in Selective Visual Attention: Towards the Underlying Neural Circuitry
Koch, C., & Ullman, S. (1987) · Matters of Intelligence · doi:10.1007/978-94-009-3833-5_5 · Cited by 3,722
Harel, J., Koch, C., & Perona, P. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0073 · Cited by 3,439
Holistically-Nested Edge Detection
Xie, S., & Tu, Z. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.164 · Cited by 3,096
Global contrast based salient region detection
Cheng, M.-M., Zhang, G.-X., Mitra, N. J., Huang, X., & Hu, S.-M. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995344 · Cited by 2,976
Saliency Detection via Graph-Based Manifold Ranking
Yang, C., Zhang, L., Lu, H., Ruan, X., & Yang, M.-H. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.407 · Cited by 2,554 · cited 3×
“The third class of methods proposed background priors [19], [22] to direct the saliency detection, which are based on the idea of modeling the property of background first and thereby separating salient objects from the background.”
MethodLearning to detect natural image boundaries using local brightness, color, and texture cues
Martin, D. R., Fowlkes, C. C., & Malik, J. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.1273918 · Cited by 2,420
Saliency filters: Contrast based filtering for salient region detection
Perazzi, F., Krahenbuhl, P., Pritch, Y., & Hornung, A. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247743 · Cited by 2,110
Learning to Detect a Salient Object
Liu, T., Yuan, Z., Sun, J., Wang, J., Zheng, N., Tang, X., & Shum, H.-Y. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.70 · Cited by 1,777
Learning Rich Features from RGB-D Images for Object Detection and Segmentation
Gupta, S., Girshick, R., Arbeláez, P., & Malik, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10584-0_23 · Cited by 1,528
Visual saliency based on multiscale deep features
Li, G., & Yu, Y. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299184 · Cited by 1,163
Deeply Supervised Salient Object Detection with Short Connections
Hou, Q., Cheng, M.-M., Hu, X., Borji, A., Tu, Z., & Torr, P. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.563 · Cited by 1,143
Saliency detection by multi-context deep learning
Zhao, R., Ouyang, W., Li, H., & Wang, X. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298731 · Cited by 995
Lee, C., Xie, S., Gallagher, P., Zhang, Z., & Zhuowen Tu, A. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1409.5185 · Cited by 993
Deeplysupervised netsPreprint
Lee, C., Xie, S., Gallagher, P., Zhang, Z., & Tu, Z. (2015) · Cited by 849
Geodesic Saliency Using Background Priors
Wei, Y., Wen, F., Zhu, W., & Sun, J. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33712-3_3 · Cited by 842
DHSNet: Deep Hierarchical Saliency Network for Salient Object Detection
Liu, N., & Han, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.80 · Cited by 833
Self-citationSaliency Detection via Dense and Sparse Reconstruction
Li, X., Lu, H., Zhang, L., Ruan, X., & Yang, M.-H. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.370 · Cited by 707
Self-citationDeep Contrast Learning for Salient Object Detection
Li, G., & Yu, Y. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.58 · Cited by 704
Deep networks for saliency detection via local estimation and global search
Wang, L., Lu, H., Ruan, X., & Yang, M.-H. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298938 · Cited by 676
RGBD Salient Object Detection: A Benchmark and Algorithms
Peng, H., Li, B., Xiong, W., Hu, W., & Ji, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10578-9_7 · Cited by 668
Saliency Detection via Absorbing Markov Chain
Jiang, B., Zhang, L., Lu, H., Yang, C., & Yang, M.-H. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.209 · Cited by 602
Depth saliency based on anisotropic center-surround difference
Ju, R., Ge, L., Geng, W., Ren, T., & Wu, G. (2014) · 2014 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2014.7025222 · Cited by 523
Co-Saliency Detection via a Self-Paced Multiple-Instance Learning Framework
Zhang, D., Meng, D., & Han, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2567393 · Cited by 508
Self-citationLeveraging stereopsis for saliency analysis
Niu, Y., Geng, Y., Li, X., & Liu, F. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247708 · Cited by 479
Self-citationBackground Prior-Based Salient Object Detection via Deep Reconstruction Residual
Han, J., Zhang, D., Hu, X., Guo, L., Ren, J., & Wu, F. (2015) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2014.2381471 · Cited by 444
Self-citationIndoor Semantic Segmentation using depth information
Couprie, C., Farabet, C., Najman, L. A., & LeCun, Y. (2013) · HAL (Le Centre pour la Communication Scientifique Directe) · doi:10.48550/arxiv.1301.3572 · Cited by 372
Depth Enhanced Saliency Detection Method
Cheng, Y., Fu, H., Wei, X., Xiao, J., & Cao, X. (2014) · Proceedings of International Conference on Internet Multimedia Computing and Service · doi:10.1145/2632856.2632866 · Cited by 350
Salient Region Detection by UFO: Uniqueness, Focusness and Objectness
Jiang, P., Ling, H., Yu, J., & Peng, J. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.248 · Cited by 332
Detection of Co-salient Objects by Looking Deep and Wide
Zhang, D., Han, J., Li, C., Wang, J., & Li, X. (2016) · International Journal of Computer Vision · doi:10.1007/s11263-016-0907-4 · Cited by 328
Self-citationSalient Region Detection via High-Dimensional Color Transform
Kim, J., Han, D., Tai, Y.-W., & Kim, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.118 · Cited by 273
Recurrent Attentional Networks for Saliency Detection
Kuen, J., Wang, Z., & Wang, G. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.399 · Cited by 231
Yao, X., Han, J., Zhang, D., & Nie, F. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2694222 · Cited by 230
Self-citationLocality-Sensitive Deconvolution Networks with Gated Fusion for RGB-D Indoor Semantic Segmentation
Cheng, Y., Cai, R., Li, Z., Zhao, X., & Huang, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.161 · Cited by 229
Exploiting global priors for RGB-D saliency detection
Ren, J., Gong, X., Yu, L., Zhou, W., & Yang, M. Y. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2015.7301391 · Cited by 217
Saliency Detection by Multiple-Instance Learning
Wang, Q., Yuan, Y., Yan, P., & Li, X. (2013) · IEEE Transactions on Cybernetics · doi:10.1109/tsmcb.2012.2214210 · Cited by 173
Self-citationLSTM-CF: Unifying Context Modeling and Fusion with LSTMs for RGB-D Scene Labeling
Li, Z., Gan, Y., Liang, X., Yu, Y., Cheng, H., & Lin, L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_34 · Cited by 172
Saliency Detection for Stereoscopic Images
Fang, Y., Wang, J., Narwaria, M., Callet, P. L., & Lin, W. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2305100 · Cited by 171
Depth really Matters: Improving Visual Salient Region Detection with Depth
Desingh, K., K, M. K., Rajan, D., & Jawahar, C. (2013) · Procedings of the British Machine Vision Conference 2013 · doi:10.5244/c.27.98 · Cited by 171
Two-Stage Learning to Predict Human Eye Fixations via SDAEs
Han, J., Zhang, D., Wen, S., Guo, L., Liu, T., & Li, X. (2015) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2015.2404432 · Cited by 150
Self-citationRevealing Event Saliency in Unconstrained Video Collection
Zhang, D., Han, J., Jiang, L., Ye, S., & Chang, X. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2658957 · Cited by 128
Self-citationCiptadi, A., Hermans, T., & Rehg, J. M. (2013) · British Machine Vision Conference (BMVC) · doi:10.5244/c.27.112 · Cited by 124
Hierarchical Recurrent Neural Hashing for Image Retrieval With Hierarchical Convolutional Features
Lu, X., Chen, Y., & Li, X. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2755766 · Cited by 124
Self-citationCross-modal adaptation for RGB-D detection
Hoffman, J., Gupta, S., Leong, J., Guadarrama, S., & Darrell, T. (2016) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2016.7487708 · Cited by 103
Learning to Predict Eye Fixations via Multiresolution Convolutional Neural Networks
Liu, N., Han, J.-W., Liu, T., & Li, X.-L. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2628878 · Cited by 100
Self-citationSalient region detection for stereoscopic images
Fan, X., Liu, Z., & Sun, G. (2014) · doi:10.1109/icdsp.2014.6900706 · Cited by 82
Sun, L., & Shibata, T. (2014) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2013.2290573 · Cited by 9
Cited by
Cheng, G., Yang, C., Yao, X., Guo, L., & Han, J. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2783902 · Cited by 1,226
Self-citationRethinking RGB-D Salient Object Detection: Models, Data Sets, and Large-Scale Benchmarks
Fan, D.-P., Lin, Z., Zhang, Z., Zhu, M., & Cheng, M.-M. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2996406 · Cited by 702
Liu, N., Zhang, N., Wan, K., Shao, L., & Han, J. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00468 · Cited by 549
Self-citationDepth-Induced Multi-Scale Recurrent Attention Network for Saliency Detection
Piao, Y., Ji, W., Li, J., Zhang, M., & Lu, H. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00735 · Cited by 497
Infrared and visible image fusion via detail preserving adversarial learning
Ma, J., Liang, P., Yu, W., Chen, C., Guo, X., Wu, J., & Jiang, J. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.07.005 · Cited by 456
Metadata
- Authors
- Han, J., Chen, H., Liu, N., Yan, C., & Li, X.
- Venue
- IEEE Transactions on Cybernetics
- Published
- 2018-11
- Volume
- 48
- Issue
- 11
- Pages
- 3171-3183
- ISSN
- 2168-2267 (ISSN-L)
- 2168-2275
- OpenAlex
- W2765838470
- Cited by
- 423
- References
- 56
- FWCI
- 18.20
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.