The DOI matches its Crossref record; 65 of the 65 references it cites were found in a registry or an index.
ECFFNet: Effective and Consistent Feature Fusion Network for RGB-T Salient Object Detection
Abstract
Under ideal environmental conditions, RGB-based deep convolutional neural networks can achieve high performance for salient object detection (SOD). In scenes with cluttered backgrounds and many objects, depth maps have been combined with RGB images to better distinguish spatial positions and structures during SOD, achieving high accuracy. However, under low-light and uneven lighting conditions, RGB and depth information may be insufficient for detection. Thermal images are insensitive to lighting and weather conditions, being able to capture important objects even during nighttime. By combining thermal images and RGB images, we propose an effective and consistent feature fusion network (ECFFNet) for RGB-T SOD. In ECFFNet, an effective cross-modality fusion module fully fuses features of corresponding sizes from the RGB and thermal modalities. Then, a bilateral reversal fusion module performs bilateral fusion of foreground and background information, enabling the full extraction of salient object boundaries. Finally, a multilevel consistent fusion module combines features across different levels to obtain complementary information. Comprehensive experiments on three RGB-T SOD datasets show that the proposed ECFFNet outperforms 12 state-of-the-art methods under different evaluation indicators.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Rethinking Atrous Convolution for Semantic Image Segmentation
Chen, L.-C., Papandreou, G., Schroff, F., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1706.05587 · Cited by 7,517
Dual Attention Network for Scene Segmentation
Fu, J., Liu, J., Tian, H., Li, Y., Bao, Y., Fang, Z., & Lu, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00326 · Cited by 7,351
Frequency-tuned salient region detection
Achanta, R., Hemami, S., Estrada, F., & Susstrunk, S. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206596 · Cited by 4,167
Global contrast based salient region detection
Cheng, M.-M., Zhang, G.-X., Mitra, N. J., Huang, X., & Hu, S.-M. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995344 · Cited by 2,976
Structure-Measure: A New Way to Evaluate Foreground Maps
Fan, D.-P., Cheng, M.-M., Liu, Y., Li, T., & Borji, A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.487 · Cited by 2,092
Enhanced-alignment Measure for Binary Foreground Map Evaluation
Fan, D.-P., Gong, C., Cao, Y., Ren, B., Cheng, M.-M., & Borji, A. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/97 · Cited by 1,607
BASNet: Boundary-Aware Salient Object Detection
Qin, X., Zhang, Z., Huang, C., Gao, C., Dehghan, M., & Jagersand, M. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00766 · Cited by 1,565
Cascaded Partial Decoder for Fast and Accurate Salient Object Detection
Wu, Z., Su, L., & Huang, Q. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00403 · Cited by 1,136
Guo, C., & Zhang, L. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2009.2030969 · Cited by 934
PiCANet: Learning Pixel-Wise Contextual Attention for Saliency Detection
Liu, N., Han, J., & Yang, M.-H. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00326 · Cited by 863
Multi-Scale Interactive Network for Salient Object Detection
Pang, Y., Zhao, X., Zhang, L., & Lu, H. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00943 · Cited by 844
Rethinking RGB-D Salient Object Detection: Models, Data Sets, and Large-Scale Benchmarks
Fan, D.-P., Lin, Z., Zhang, Z., Zhu, M., & Cheng, M.-M. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2996406 · Cited by 702
MFNet: Towards real-time semantic segmentation for autonomous vehicles with multi-spectral scenes
Ha, Q., Watanabe, K., Karasawa, T., Ushiku, Y., & Harada, T. (2017) · 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8206396 · Cited by 693
Reverse Attention for Salient Object Detection
Chen, S., Tan, X., Wang, B., & Hu, X. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01240-3_15 · Cited by 684
Suppress and Balance: A Simple Gated Network for Salient Object Detection
Zhao, X., Pang, Y., Zhang, L., Lu, H., & Zhang, L. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58536-5_3 · Cited by 497
R³Net: Recurrent Residual Refinement Network for Saliency Detection
Deng, Z., Hu, X., Zhu, L., Xu, X., Qin, J., Han, G., & Heng, P.-A. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/95 · Cited by 495
Global Context-Aware Progressive Aggregation Network for Salient Object Detection
Chen, Z., Xu, Q., Cong, R., & Huang, Q. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6633 · Cited by 477
UC-Net: Uncertainty Inspired RGB-D Saliency Detection via Conditional Variational Autoencoders
Zhang, J., Fan, D.-P., Dai, Y., Anwar, S., Saleh, F. S., Zhang, T., & Barnes, N. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00861 · Cited by 423
Salient Object Detection via Structured Matrix Decomposition
Peng, H., Li, B., Ling, H., Hu, W., Xiong, W., & Maybank, S. J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2562626 · Cited by 378
Label Decoupling Framework for Salient Object Detection
Wei, J., Wang, S., Wu, Z., Su, C., Huang, Q., & Tian, Q. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01304 · Cited by 374
Chen, H., Li, Y., & Su, D. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2018.08.007 · Cited by 368
JL-DCF: Joint Learning and Densely-Cooperative Fusion Framework for RGB-D Salient Object Detection
Fu, K., Fan, D.-P., Ji, G.-P., & Zhao, Q. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00312 · Cited by 365
BBS-Net: RGB-D Salient Object Detection with a Bifurcated Backbone Strategy Network
Fan, D.-P., Zhai, Y., Borji, A., Yang, J., & Shao, L. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58610-2_17 · Cited by 342
Learning Selective Self-Mutual Attention for RGB-D Saliency Detection
Liu, N., Zhang, N., & Han, J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01377 · Cited by 335
Three-Stream Attention-Aware Network for RGB-D Salient Object Detection
Chen, H., & Li, Y. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2891104 · Cited by 324
Training Deeper Convolutional Networks with Deep SupervisionPreprint
Wang, L., Lee, C., Tu, Z., & Lazebnik, S. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1505.02496 · Cited by 294
RGB-T Image Saliency Detection via Collaborative Graph Learning
Tu, Z., Xia, T., Li, C., Wang, X., Ma, Y., & Tang, J. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2924578 · Cited by 273
A2dele: Adaptive and Attentive Depth Distiller for Efficient RGB-D Salient Object Detection
Piao, Y., Rong, Z., Zhang, M., Ren, W., & Lu, H. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00908 · Cited by 263
RGBT Salient Object Detection: A Large-Scale Dataset and Benchmark
Tu, Z., Ma, Y., Li, Z., Li, C., Xu, J., & Liu, Y. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3171688 · Cited by 260
A Single Stream Network for Robust and Real-Time RGB-D Salient Object Detection
Zhao, X., Zhang, L., Pang, Y., Lu, H., & Zhang, L. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58542-6_39 · Cited by 259
Adaptive Fusion for RGB-D Salient Object Detection
Wang, N., & Gong, X. (2019) · IEEE Access · doi:10.1109/access.2019.2913107 · Cited by 258
ICNet: Information Conversion Network for RGB-D Based Salient Object Detection
Li, G., Liu, Z., & Ling, H. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2976689 · Cited by 257
RGB-T Salient Object Detection via Fusing Multi-Level CNN Features
Zhang, Q., Huang, N., Yao, L., Zhang, D., Shan, C., & Han, J. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2959253 · Cited by 247
Hierarchical Dynamic Filtering Network for RGB-D Salient Object Detection
Pang, Y., Zhang, L., Zhao, X., & Lu, H. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58595-2_15 · Cited by 230
Zhou, W., Zhu, Y., Lei, J., Wan, J., & Yu, L. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3077767 · Cited by 228
Self-citationSelect, Supplement and Focus for RGB-D Saliency Detection
Zhang, M., Ren, W., Piao, Y., Rong, Z., & Lu, H. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00353 · Cited by 224
RGB-T Saliency Detection Benchmark: Dataset, Baselines, Analysis and a Novel Approach
Wang, G., Li, C., Ma, Y., Zheng, A., Tang, J., & Luo, B. (2018) · Communications in Computer and Information Science · doi:10.1007/978-981-13-1702-6_36 · Cited by 179
RGB-D Salient Object Detection with Cross-Modality Modulation and Selection
Li, C., Cong, R., Piao, Y., Xu, Q., & Loy, C. C. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58598-3_14 · Cited by 175
Progressively Guided Alternate Refinement Network for RGB-D Salient Object Detection
Chen, S., & Fu, Y. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58598-3_31 · Cited by 175
Zhao, W., Wang, D., & Lu, H. (2018) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2018.2821177 · Cited by 168
Cross-Modal Weighting Network for RGB-D Salient Object Detection
Li, G., Liu, Z., Ye, L., Wang, Y., & Ling, H. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58520-4_39 · Cited by 165
PDNet: Prior-Model Guided Depth-Enhanced Network for Salient Object Detection
Zhu, C., Cai, X., Huang, K., Li, T. H., & Li, G. (2019) · 2019 IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2019.00042 · Cited by 164
Revisiting Feature Fusion for RGB-T Salient Object Detection
Zhang, Q., Xiao, T., Huang, N., Zhang, D., & Han, J. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.3014663 · Cited by 164
Ultrasound Image Segmentation: A Deeply Supervised Network With Attention to Boundaries
Mishra, D., Chaudhury, S., Sarkar, M., & Soin, A. S. (2019) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2018.2877577 · Cited by 162
Dynamic Feature Integration for Simultaneous Detection of Salient Object, Edge, and Skeleton
Liu, J.-J., Hou, Q., & Cheng, M.-M. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3017352 · Cited by 160
TSNet: Three-Stream Self-Attention Network for RGB-D Indoor Semantic Segmentation
Zhou, W., Yuan, J., Lei, J., & Luo, T. (2020) · IEEE Intelligent Systems · doi:10.1109/mis.2020.2999462 · Cited by 153
Self-citationGlobal and Local-Contrast Guides Content-Aware Fusion for RGB-D Saliency Prediction
Zhou, W., Lv, Y., Lei, J., & Yu, L. (2019) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2019.2957386 · Cited by 143
Self-citationSalient Object Detection via Multiple Instance Learning
Huang, F. L., Qi, J., Lu, H., Zhang, L., & Ruan, X. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2669878 · Cited by 142
CAGNet: Content-Aware Guidance for Salient Object Detection
Mohammadi, S., Noori, M., Bahri, A., Majelan, S. G., & Havaei, M. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107303 · Cited by 141
Biologically Inspired Object Tracking Using Center-Surround Saliency Mechanisms
Mahadevan, V., & Vasconcelos, N. M. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.98 · Cited by 137
Asymmetric Two-Stream Architecture for Accurate RGB-D Saliency Detection
Zhang, M., Fei, S. X., Liu, J., Xu, S., Piao, Y., & Lu, H. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58604-1_23 · Cited by 131
Progressive Feature Polishing Network for Salient Object Detection
Wang, B., Chen, Q., Zhou, M. Q., Zhang, Z., Jin, X., & Gai, K. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6892 · Cited by 128
RGBD Salient Object Detection via Disentangled Cross-Modal Fusion
Chen, H., Deng, Y., Li, Y., Hung, T.-Y., & Lin, G. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3014734 · Cited by 111
Chen, C., Wei, J.-P., Peng, C., Zhang, W.-Z., & Qin, H. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2968250 · Cited by 95
M3S-NIR: Multi-modal Multi-scale Noise-Insensitive Ranking for RGB-T Saliency Detection
Tu, Z.-Z., Xia, T., Li, C., Lu, Y.-J., & Tang, J. (2019) · Conference on Multimedia Information Processing and Retrieval · doi:10.1109/mipr.2019.00032 · Cited by 91
SAC-Net: Spatial Attenuation Context for Salient Object Detection
Hu, X., Fu, C., Zhu, L., Wang, T., & Heng, P. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.2995220 · Cited by 87
Salient Object Detection in Stereoscopic 3D Images Using a Deep Convolutional Residual Autoencoder
Zhou, W., Wu, J., Lei, J., Hwang, J., & Yu, L. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.3025166 · Cited by 78
Self-citationMultiscale multilevel context and multimodal fusion for RGB-D salient object detection
Wu, J., Zhou, W., Luo, T., Yu, L., & Lei, J. (2020) · Signal Processing · doi:10.1016/j.sigpro.2020.107766 · Cited by 68
Self-citationBlind Binocular Visual Quality Predictor Using Deep Fusion Network
Zhou, W., Lei, J., Jiang, Q., Yu, L., & Luo, T. (2020) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2020.2993640 · Cited by 44
Self-citationDeep Binocular Fixation Prediction Using a Hierarchical Multimodal Fusion Network
Zhou, W., Liu, W., Lei, J., Luo, T., & Yu, L. (2021) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2021.3051010 · Cited by 36
Self-citationLearning Multiscale Deep Features and SVM Regressors for Adaptive RGB-T Saliency Detection
Ma, Y., Sun, D., Meng, Q., Ding, Z., & Li, C. (2017) · International Symposium on Computational Intelligence and Design · doi:10.1109/iscid.2017.92 · Cited by 29
Asymmetric Deeply Fused Network for Detecting Salient Objects in RGB-D Images
Liu, C., Zhou, W., Chen, Y., & Lei, J. (2020) · IEEE Signal Processing Letters · doi:10.1109/lsp.2020.3023349 · Cited by 19
Self-citationMulti-interactive Siamese Decoder for RGBT Salient Object DetectionPreprint
Tu, Z., Li, Z., Li, C., et al. (2020) · arXiv (Cornell University) · Cited by 5
Cited by
DATFuse: Infrared and Visible Image Fusion via Dual Attention Transformer
Tang, W., He, F., Liu, Y., Duan, Y., & Si, T. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3234340 · Cited by 571
SwinNet: Swin Transformer Drives Edge-Aware RGB-D and RGB-T Salient Object Detection
Liu, Z., Tan, Y., He, Q., & Xiao, Y. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3127149 · Cited by 384
GMNet: Graded-Feature Multilabel-Learning Network for RGB-Thermal Urban Scene Semantic Segmentation
Zhou, W., Liu, J., Lei, J., Yu, L., & Hwang, J.-N. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3109518 · Cited by 344
LSNet: Lightweight Spatial Boosting Network for Detecting Salient Objects in RGB-Thermal Images
Zhou, W., Zhu, Y., Lei, J., Yang, R., & Yu, L. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3242775 · Cited by 298
Self-citation
Metadata
- Authors
- Zhou, W., Guo, Q., Lei, J., Yu, L., & Hwang, J.-N.
- Venue
- IEEE Transactions on Circuits and Systems for Video Technology
- Published
- 2022-03
- Volume
- 32
- Issue
- 3
- Pages
- 1224-1235
- ISSN
- 1051-8215 (ISSN-L)
- 1558-2205
- OpenAlex
- W3159018159
- Cited by
- 340
- References
- 65
- FWCI
- 16.93
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.