The DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index.
LSNet: Lightweight Spatial Boosting Network for Detecting Salient Objects in RGB-Thermal Images
Abstract
Most recent methods for RGB (red-green-blue)-thermal salient object detection (SOD) involve several floating-point operations and have numerous parameters, resulting in slow inference, especially on common processors, and impeding their deployment on mobile devices for practical applications. To address these problems, we propose a lightweight spatial boosting network (LSNet) for efficient RGB-thermal SOD with a lightweight MobileNetV2 backbone to replace a conventional backbone (e.g., VGG, ResNet). To improve feature extraction using a lightweight backbone, we propose a boundary boosting algorithm that optimizes the predicted saliency maps and reduces information collapse in low-dimensional features. The algorithm generates boundary maps based on predicted saliency maps without incurring additional calculations or complexity. As multimodality processing is essential for high-performance SOD, we adopt attentive feature distillation and selection and propose semantic and geometric transfer learning to enhance the backbone without increasing the complexity during testing. Experimental results demonstrate that the proposed LSNet achieves state-of-the-art performance compared with 14 RGB-thermal SOD methods on three datasets while improving the numbers of floating-point operations (1.025G) and parameters (5.39M), model size (22.1 MB), and inference speed (9.95 fps for PyTorch, batch size of 1, and Intel i5-7500 processor; 93.53 fps for PyTorch, batch size of 1, and NVIDIA TITAN V graphics processor; 936.68 fps for PyTorch, batch size of 20, and graphics processor; 538.01 fps for TensorRT and batch size of 1; and 903.01 fps for TensorRT/FP16 and batch size of 1). The code and results can be found from the link of https://github.com/zyrant/LSNet.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
MobileNetV2: Inverted Residuals and Linear Bottlenecks
Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., & Chen, L.-C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00474 · Cited by 28,755
ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design
Ma, N., Zhang, X., Zheng, H.-T., & Sun, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01264-9_8 · Cited by 7,356 · cited 1×
“To further verify the feasibility of the encoder used in LSNet, we compared the performance using ShuffleNetV2 [63] and MobileNetV2 backbones, as reported in Table III.”
MethodWilliams, S., Waterman, A., & Patterson, D. A. (2009) · Communications of the ACM · doi:10.1145/1498765.1498785 · Cited by 2,798
Structure-Measure: A New Way to Evaluate Foreground Maps
Fan, D.-P., Cheng, M.-M., Liu, Y., Li, T., & Borji, A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.487 · Cited by 2,092
Enhanced-alignment Measure for Binary Foreground Map Evaluation
Fan, D.-P., Gong, C., Cao, Y., Ren, B., Cheng, M.-M., & Borji, A. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/97 · Cited by 1,607
EGNet: Edge Guidance Network for Salient Object Detection
Zhao, J., Liu, J.-J., Fan, D.-P., Cao, Y., Yang, J., & Cheng, M.-M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00887 · Cited by 1,202
Cascaded Partial Decoder for Fast and Accurate Salient Object Detection
Wu, Z., Su, L., & Huang, Q. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00403 · Cited by 1,136
A Simple Pooling-Based Design for Real-Time Salient Object Detection
Liu, J.-J., Hou, Q., Cheng, M.-M., Feng, J., & Jiang, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00404 · Cited by 1,100
F³Net: Fusion, Feedback and Focus for Salient Object Detection
Wei, J., Wang, S., & Huang, Q. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6916 · Cited by 1,050
Guo, C., & Zhang, L. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2009.2030969 · Cited by 934
Multi-Scale Interactive Network for Salient Object Detection
Pang, Y., Zhao, X., Zhang, L., & Lu, H. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00943 · Cited by 844
Automatic Foveation for Video Compression Using a Neurobiological Model of Visual Attention
Itti, L. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2004.834657 · Cited by 759
Rethinking RGB-D Salient Object Detection: Models, Data Sets, and Large-Scale Benchmarks
Fan, D.-P., Lin, Z., Zhang, Z., Zhu, M., & Cheng, M.-M. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2996406 · Cited by 702
RGBD Salient Object Detection: A Benchmark and Algorithms
Peng, H., Li, B., Xiong, W., Hu, W., & Ji, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10578-9_7 · Cited by 668
Salient Object Detection With Pyramid Attention and Salient Edges
Wang, W., Zhao, S., Shen, J., Hoi, S. C. H., & Borji, A. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00154 · Cited by 535
Depth saliency based on anisotropic center-surround difference
Ju, R., Ge, L., Geng, W., Ren, T., & Wu, G. (2014) · 2014 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2014.7025222 · Cited by 523
Shifting More Attention to Video Salient Object Detection
Fan, D.-P., Wang, W., Cheng, M.-M., & Shen, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00875 · Cited by 510
Attentive Feedback Network for Boundary-Aware Salient Object Detection
Feng, M., Lu, H., & Ding, E. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00172 · Cited by 497
R³Net: Recurrent Residual Refinement Network for Saliency Detection
Deng, Z., Hu, X., Zhu, L., Xu, X., Qin, J., Han, G., & Heng, P.-A. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/95 · Cited by 495
Saliency Detection on Light Field
Li, N., Ye, J., Ji, Y., Ling, H., & Yu, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.359 · Cited by 470
Label Decoupling Framework for Salient Object Detection
Wei, J., Wang, S., Wu, Z., Su, C., Huang, Q., & Tian, Q. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01304 · Cited by 374
Chen, H., Li, Y., & Su, D. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2018.08.007 · Cited by 368
Depth Enhanced Saliency Detection Method
Cheng, Y., Fu, H., Wei, X., Xiao, J., & Cao, X. (2014) · Proceedings of International Conference on Internet Multimedia Computing and Service · doi:10.1145/2632856.2632866 · Cited by 350
GMNet: Graded-Feature Multilabel-Learning Network for RGB-Thermal Urban Scene Semantic Segmentation
Zhou, W., Liu, J., Lei, J., Yu, L., & Hwang, J.-N. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3109518 · Cited by 344 · cited 1×
“SOD is used in several applications, such as video detection [1], [2], object segmentation and recognition [3], [4], content-related image and video compression [5], [6], as well as tracking [7].”
MethodBBS-Net: RGB-D Salient Object Detection with a Bifurcated Backbone Strategy Network
Fan, D.-P., Zhai, Y., Borji, A., Yang, J., & Shao, L. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58610-2_17 · Cited by 342
Hierarchical Alternate Interaction Network for RGB-D Salient Object Detection
Li, G., Liu, Z., Chen, M., Bai, Z., Lin, W., & Ling, H. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3062689 · Cited by 341
ECFFNet: Effective and Consistent Feature Fusion Network for RGB-T Salient Object Detection
Zhou, W., Guo, Q., Lei, J., Yu, L., & Hwang, J.-N. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3077058 · Cited by 340
Self-citationLearning Selective Self-Mutual Attention for RGB-D Saliency Detection
Liu, N., Zhang, N., & Han, J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01377 · Cited by 335
Three-Stream Attention-Aware Network for RGB-D Salient Object Detection
Chen, H., & Li, Y. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2891104 · Cited by 324
Cross-modality deep feature learning for brain tumor segmentation
Zhang, D., Huang, G., Zhang, Q., Han, J., Han, J., & Yu, Y. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2020.107562 · Cited by 292
RGB-T Image Saliency Detection via Collaborative Graph Learning
Tu, Z., Xia, T., Li, C., Wang, X., Ma, Y., & Tang, J. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2924578 · Cited by 273
SAMNet: Stereoscopically Attentive Multi-Scale Network for Lightweight Salient Object Detection
Liu, Y., Zhang, X.-Y., Bian, J.-W., Zhang, L., & Cheng, M.-M. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3065239 · Cited by 271
A2dele: Adaptive and Attentive Depth Distiller for Efficient RGB-D Salient Object Detection
Piao, Y., Rong, Z., Zhang, M., Ren, W., & Lu, H. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00908 · Cited by 263
RGBT Salient Object Detection: A Large-Scale Dataset and Benchmark
Tu, Z., Ma, Y., Li, Z., Li, C., Xu, J., & Liu, Y. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3171688 · Cited by 260
Adaptive Fusion for RGB-D Salient Object Detection
Wang, N., & Gong, X. (2019) · IEEE Access · doi:10.1109/access.2019.2913107 · Cited by 258
ICNet: Information Conversion Network for RGB-D Based Salient Object Detection
Li, G., Liu, Z., & Ling, H. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2976689 · Cited by 257
RGB-T Salient Object Detection via Fusing Multi-Level CNN Features
Zhang, Q., Huang, N., Yao, L., Zhang, D., Shan, C., & Han, J. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2959253 · Cited by 247
Multi-Interactive Dual-Decoder for RGB-Thermal Salient Object Detection
Tu, Z., Li, Z., Li, C., Lang, Y., & Tang, J. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3087412 · Cited by 241
Siamese Network for RGB-D Salient Object Detection and Beyond
Fu, K., Fan, D.-P., Ji, G.-P., Zhao, Q., Shen, J., & Zhu, C. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3073689 · Cited by 240
Zhou, W., Zhu, Y., Lei, J., Wan, J., & Yu, L. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3077767 · Cited by 228
Self-citationDPANet: Depth Potentiality-Aware Gated Attention Network for RGB-D Salient Object Detection
Chen, Z., Cong, R., Xu, Q., & Huang, Q. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3028289 · Cited by 225
Select, Supplement and Focus for RGB-D Saliency Detection
Zhang, M., Ren, W., Piao, Y., Rong, Z., & Lu, H. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00353 · Cited by 224
Motion Guided Attention for Video Salient Object Detection
Li, H., Chen, G., Li, G., & Yu, Y. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00737 · Cited by 216
Exploring Task Structure for Brain Tumor Segmentation From Multi-Modality MR Images
Zhang, D., Huang, G., Zhang, Q., Han, J., Han, J., Wang, Y., & Yu, Y. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3023609 · Cited by 188
RGB-T Saliency Detection Benchmark: Dataset, Baselines, Analysis and a Novel Approach
Wang, G., Li, C., Ma, Y., Zheng, A., Tang, J., & Luo, B. (2018) · Communications in Computer and Information Science · doi:10.1007/978-981-13-1702-6_36 · Cited by 179
Zhou, W., Guo, Q., Lei, J., Yu, L., & Hwang, J. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3105484 · Cited by 177
Self-citationRGB-D Salient Object Detection with Cross-Modality Modulation and Selection
Li, C., Cong, R., Piao, Y., Xu, Q., & Loy, C. C. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58598-3_14 · Cited by 175
CDNet: Complementary Depth Network for RGB-D Salient Object Detection
Jin, W.-D., Xu, J., Han, Q., Zhang, Y., & Cheng, M.-M. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3060167 · Cited by 170
Cross-Modal Weighting Network for RGB-D Salient Object Detection
Li, G., Liu, Z., Ye, L., Wang, Y., & Ling, H. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58520-4_39 · Cited by 165
Zhou, W., Yu, L., Zhou, Y., Qiu, W., Wu, M.-W., & Luo, T. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2794207 · Cited by 159
Self-citationLearning Selective Mutual Attention and Contrast for RGB-D Saliency Detection
Liu, N., Zhang, N., Shao, L., & Han, J. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3122139 · Cited by 148
A weighted sparse coding framework for saliency detection
Li, N., Sun, B., & Jingyi Yu, A. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7299158 · Cited by 143
FRNet: Feature Reconstruction Network for RGB-D Indoor Scene Parsing
Zhou, W., Yang, E., Lei, J., & Yu, L. (2022) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2022.3174338 · Cited by 133
Self-citationDEFNet: Dual-Branch Enhanced Feature Fusion Network for RGB-T Crowd Counting
Zhou, W., Pan, Y. H., Lei, J., Ye, L., & Yu, L. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3203385 · Cited by 106
Self-citationZhou, W., Jianhui, J., Lei, J., & Yu, L. (2022) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2022.3159032 · Cited by 99
Self-citationChen, C., Wei, J.-P., Peng, C., Zhang, W.-Z., & Qin, H. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2968250 · Cited by 95
M3S-NIR: Multi-modal Multi-scale Noise-Insensitive Ranking for RGB-T Saliency Detection
Tu, Z.-Z., Xia, T., Li, C., Lu, Y.-J., & Tang, J. (2019) · Conference on Multimedia Information Processing and Retrieval · doi:10.1109/mipr.2019.00032 · Cited by 91
Edge Detection Guide Network for Semantic Segmentation of Remote-Sensing Images
Jianhui, J., Zhou, W., Yang, R., Ye, L., & Yu, L. (2023) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2023.3234257 · Cited by 89
Self-citationBCINet: Bilateral cross-modal interaction network for indoor scene understanding in RGB-D images
Zhou, W., Yue, Y., Fang, M., Qian, X., Yang, R., & Yu, L. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.01.016 · Cited by 80
Self-citationEmbedded Control Gate Fusion and Attention Residual Learning for RGB–Thermal Urban Scene Parsing
Zhou, W., Lv, Y. H., Lei, J., & Yu, L. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3242651 · Cited by 75
Self-citationZhou, W., Liu, C., Lei, J., Yu, L., & Luo, T. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.11.100 · Cited by 65
Self-citationDHFNet: dual-decoding hierarchical fusion network for RGB-thermal semantic segmentation
Cai, Y., Zhou, W., Zhang, L., Yu, L., & Luo, T. (2023) · The Visual Computer · doi:10.1007/s00371-023-02773-6 · Cited by 54
Self-citationLearning Implicit Class Knowledge for RGB-D Co-Salient Object Detection With Transformers
Zhang, N., Han, J., & Liu, N. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3185550 · Cited by 53
DeepACG: Co-Saliency Detection via Semantic-aware Contrast Gromov-Wasserstein Distance
Zhang, K., Dong, M., Лю, Б., Yuan, X., & Liu, Q. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01349 · Cited by 49
RLLNet: a lightweight remaking learning network for saliency redetection on RGB-D images
Zhou, W., Liu, C., Lei, J., & Yu, L. (2022) · Science China Information Sciences · doi:10.1007/s11432-020-3337-9 · Cited by 43
Self-citationHierarchical and Interactive Refinement Network for Edge-Preserving Salient Object Detection
Zhou, S., Wang, J., Wang, L., Zhang, J., Wang, F., Huang, D., & Zheng, N. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3027992 · Cited by 38
Wu, J., Zhou, W., Qian, X., Lei, J., Yu, L., & Luo, T. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.01.024 · Cited by 38
Self-citationBCNet: Bidirectional collaboration network for edge-guided salient object detection
Dong, B., Zhou, Y., Hu, C., Fu, K., & Chen, G. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.01.034 · Cited by 32
MFENet: Multitype fusion and enhancement network for detecting salient objects in RGB-T images
Wu, J.-Y., Zhou, W.-J., Qian, X., Lei, J.-S., Yu, L., & Luo, T. (2022) · Digit. Signal Process. · doi:10.1016/j.dsp.2022.103827 · Cited by 27
Self-citationAdjacent Bi-Hierarchical Network for Scene Parsing of Remote Sensing Images
Ma, J., Zhou, W., Lei, J., & Yu, L. (2023) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2023.3241648 · Cited by 21
Self-citationZhou, W., Xiaomin, F., Yu, L., & Lei, J. (2023) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2023.3243247 · Cited by 15
Self-citation
Metadata
- Authors
- Zhou, W., Zhu, Y., Lei, J., Yang, R., & Yu, L.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2023
- Volume
- 32
- Pages
- 1329-1340
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W4319879007
- Cited by
- 298
- References
- 71
- FWCI
- 27.09
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.