The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Three-Stream Attention-Aware Network for RGB-D Salient Object Detection
Abstract
Previous RGB-D fusion systems based on convolutional neural networks (CNNs) typically employ a two-stream architecture, in which RGB and depth inputs are learnt independently. The multi-modal fusion stage is typically performed by concatenating the deep features from each stream in the inference process. The traditional two-stream architecture might experience insufficient multi-modal fusion due to two following limitations: (1) The cross-modal complementarity is rarely studied in the bottom-up path, wherein we believe the crossmodal complements can be combined to learn new discriminative features to enlarge the RGB-D representation community; (2) The cross-modal channels are typically combined by undifferentiated concatenation, which appears ambiguous to select cross-modal complementary features. In this work, we address these two limitations by proposing a novel three-stream attention-aware multi-modal fusion network. In the proposed architecture, a cross-modal distillation stream, accompanying the RGB-specific and depth-specific streams, is introduced to extract new RGB-D features in each level in the bottom-up path. Furthermore, the channel-wise attention mechanism is innovatively introduced to the cross-modal cross-level fusion problem to adaptively select complementary feature maps from each modality in each level. Extensive experiments report the effectiveness of the proposed architecture and the significant improvement over state-of-theart RGB-D salient object detection methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Squeeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667
A model of saliency-based visual attention for rapid scene analysis
Itti, L., Koch, C., & Niebur, E. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.730558 · Cited by 11,271
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
RefineNet: Multi-path Refinement Networks for High-Resolution Semantic Segmentation
Lin, G., Milan, A., Shen, C., & Reid, I. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.549 · Cited by 3,287
Recurrent Models of Visual Attention
Mnih, V., Heess, N., Graves, A., & Kavukcuoglu, K. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1406.6247 · Cited by 2,568
Structure-Measure: A New Way to Evaluate Foreground Maps
Fan, D.-P., Cheng, M.-M., Liu, Y., Li, T., & Borji, A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.487 · Cited by 2,092
SCA-CNN: Spatial and Channel-Wise Attention in Convolutional Networks for Image Captioning
Chen, L., Zhang, H., Xiao, J., Nie, L., Shao, J., Liu, W., & Chua, T.-S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.667 · Cited by 1,992
Learning Rich Features from RGB-D Images for Object Detection and Segmentation
Gupta, S., Girshick, R., Arbeláez, P., & Malik, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10584-0_23 · Cited by 1,528
Salient Object Detection: A Benchmark
Borji, A., Cheng, M.-M., Jiang, H., & Li, J. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2487833 · Cited by 1,364
Deeply Supervised Salient Object Detection with Short Connections
Hou, Q., Cheng, M.-M., Hu, X., Borji, A., Tu, Z., & Torr, P. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.563 · Cited by 1,143
DHSNet: Deep Hierarchical Saliency Network for Salient Object Detection
Liu, N., & Han, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.80 · Cited by 833
RGBD Salient Object Detection: A Benchmark and Algorithms
Peng, H., Li, B., Xiong, W., Hu, W., & Ji, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10578-9_7 · Cited by 668
Depth saliency based on anisotropic center-surround difference
Ju, R., Ge, L., Geng, W., Ren, T., & Wu, G. (2014) · 2014 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2014.7025222 · Cited by 523
Leveraging stereopsis for saliency analysis
Niu, Y., Geng, Y., Li, X., & Liu, F. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247708 · Cited by 479
CNNs-Based RGB-D Saliency Detection via Cross-View Transfer and Multiview Fusion
Han, J., Chen, H., Liu, N., Yan, C., & Li, X. (2018) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2017.2761775 · Cited by 423
Self-citationChen, H., Li, Y., & Su, D. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2018.08.007 · Cited by 368
Self-citationRGBD Salient Object Detection via Deep Fusion
Qu, L., He, S., Zhang, J., Tian, J., Tang, Y., & Yang, Q. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2682981 · Cited by 360
Depth Enhanced Saliency Detection Method
Cheng, Y., Fu, H., Wei, X., Xiao, J., & Cao, X. (2014) · Proceedings of International Conference on Internet Multimedia Computing and Service · doi:10.1145/2632856.2632866 · Cited by 350
Salient Objects in Clutter: Bringing Salient Object Detection to the Foreground
Fan, D.-P., Cheng, M.-M., Liu, J.-J., Gao, S.-H., Hou, Q., & Borji, A. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01267-0_12 · Cited by 347
Progressively Complementarity-Aware Fusion Network for RGB-D Salient Object Detection
Chen, H., & Li, Y. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00322 · Cited by 336
Self-citationRDFNet: RGB-D Multi-level Residual Feature Fusion for Indoor Semantic Segmentation
Lee, S., Park, S.-J., & Hong, K.-S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.533 · Cited by 285
Depth Matters: Influence of Depth Cues on Visual Saliency
Lang, C., Nguyen, T. V., Katti, H., Yadati, K., Kankanhalli, M., & Yan, S. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33709-3_8 · Cited by 264
Saliency Tree: A Novel Saliency Detection Framework
Liu, Z., Zou, W., & Le Meur, O. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2307434 · Cited by 250
Song, H., Liu, Z., Du, H., Sun, G., Le Meur, O., & Ren, T. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2711277 · Cited by 244
Cong, R., Lei, J., Zhang, C., Huang, Q., Cao, X., & Hou, C. (2016) · IEEE Signal Processing Letters · doi:10.1109/lsp.2016.2557347 · Cited by 235
Locality-Sensitive Deconvolution Networks with Gated Fusion for RGB-D Indoor Semantic Segmentation
Cheng, Y., Cai, R., Li, Z., Zhao, X., & Huang, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.161 · Cited by 229
Exploiting global priors for RGB-D saliency detection
Ren, J., Gong, X., Yu, L., Zhou, W., & Yang, M. Y. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2015.7301391 · Cited by 217
Local Background Enclosure for RGB-D Salient Object Detection
Feng, D., Barnes, N., You, S., & McCarthy, C. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.257 · Cited by 216
RGBD salient object detection via deep fusion
Qu, L., He, S., Zhang, J., Tian, J., Tang, Y., & Yang, Q. (2017) · Singapore Management University Institutional Knowledge (InK) (Singapore Management University) · Cited by 195
Saliency Detection for Stereoscopic Images
Fang, Y., Wang, J., Narwaria, M., Callet, P. L., & Lin, W. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2305100 · Cited by 171
Depth really Matters: Improving Visual Salient Region Detection with Depth
Desingh, K., K, M. K., Rajan, D., & Jawahar, C. (2013) · Procedings of the British Machine Vision Conference 2013 · doi:10.5244/c.27.98 · Cited by 171
Cascaded Feature Network for Semantic Segmentation of RGB-D Images
Lin, D., Chen, G., Cohen‐Or, D., Heng, P., & Huang, H. F. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.147 · Cited by 168
An Innovative Salient Object Detection Using Center-Dark Channel Prior
Zhu, C., Li, G., Wang, W., & Wang, R. (2017) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2017.178 · Cited by 163
Salient object detection for RGB-D image via saliency evolution
Guo, J., Ren, T., & Bei, J. (2016) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2016.7552907 · Cited by 157
Cong, R., Lei, J., Fu, H., Huang, Q., Cao, X., & Hou, C. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2763819 · Cited by 137
Ciptadi, A., Hermans, T., & Rehg, J. M. (2013) · British Machine Vision Conference (BMVC) · doi:10.5244/c.27.112 · Cited by 124
An Iterative Co-Saliency Framework for RGBD Images
Cong, R., Lei, J., Fu, H., Lin, W., Huang, Q., Cao, X., & Hou, C. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2017.2771488 · Cited by 123
Discriminative Multi-modal Feature Fusion for RGBD Indoor Scene Recognition
Zhu, H., Weibel, J.-B., & Lu, S. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.324 · Cited by 117
Object-based RGBD image co-segmentation with mutex constraint
Fu, H., Xu, D., Lin, S., & Liu, J. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7299072 · Cited by 103
MMSS: Multi-modal Sharable and Specific Feature Learning for RGB-D Object Recognition
Wang, A., Cai, J., Lu, J., & Cham, T. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.134 · Cited by 98
Salient Object Segmentation via Effective Integration of Saliency and Objectness
Ye, L., Liu, Z., Li, L., Shen, L., Bai, C., & Wang, Y. (2017) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2017.2693022 · Cited by 92
Salient region detection for stereoscopic images
Fan, X., Liu, Z., & Sun, G. (2014) · doi:10.1109/icdsp.2014.6900706 · Cited by 82
Object-Based Multiple Foreground Segmentation in RGBD Video
Fu, H., Xu, D., & Lin, S. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2651369 · Cited by 58
RGBD Co-saliency Detection via Bagging-Based Clustering
Song, H., Liu, Z., Xie, Y., et al. (2016) · IEEE Signal Processing Letters · doi:10.1109/lsp.2016.2615293 · Cited by 51
Attention-Aware Cross-Modal Cross-Level Fusion Network for RGB-D Salient Object Detection
Chen, H., Li, Y., & Su, D. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8594373 · Cited by 36
Self-citationAudio Visual Attribute Discovery for Fine-Grained Object Recognition
Zhang, H., Cao, X., & Wang, R. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12295 · Cited by 29
Salient object segmentation based on depth-aware image layering
Du, H., Liu, Z., & Shi, R. (2018) · Multimedia Tools and Applications · doi:10.1007/s11042-018-6736-4 · Cited by 9
Cited by
Rethinking RGB-D Salient Object Detection: Models, Data Sets, and Large-Scale Benchmarks
Fan, D.-P., Lin, Z., Zhang, Z., Zhu, M., & Cheng, M.-M. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2996406 · Cited by 702
Liu, N., Zhang, N., Wan, K., Shao, L., & Han, J. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00468 · Cited by 549
UC-Net: Uncertainty Inspired RGB-D Saliency Detection via Conditional Variational Autoencoders
Zhang, J., Fan, D.-P., Dai, Y., Anwar, S., Saleh, F. S., Zhang, T., & Barnes, N. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00861 · Cited by 423
JL-DCF: Joint Learning and Densely-Cooperative Fusion Framework for RGB-D Salient Object Detection
Fu, K., Fan, D.-P., Ji, G.-P., & Zhao, Q. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00312 · Cited by 365
BBS-Net: RGB-D Salient Object Detection with a Bifurcated Backbone Strategy Network
Fan, D.-P., Zhai, Y., Borji, A., Yang, J., & Shao, L. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58610-2_17 · Cited by 342
Metadata
- Authors
- Chen, H., & Li, Y.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2019-06
- Volume
- 28
- Issue
- 6
- Pages
- 2825-2835
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W2909381593
- Cited by
- 324
- References
- 49
- FWCI
- 24.36
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.