Attentional Feature Fusion
Open accessAbstract
Feature fusion, the combination of features from different layers or branches, is an omnipresent part of modern network architectures. It is often implemented via simple operations, such as summation or concatenation, but this might not be the best choice. In this work, we propose a uniform and general scheme, namely attentional feature fusion, which is applicable for most common scenarios, including feature fusion induced by short and long skip connections as well as within Inception layers. To better fuse features of inconsistent semantics and scales, we propose a multiscale channel attention module, which addresses issues that arise when fusing features given at different scales. We also demonstrate that the initial integration of feature maps can become a bottleneck and that this issue can be alleviated by adding another level of attention, which we refer to as iterative attentional feature fusion. With fewer layers or parameters, our models outperform state-of-the-art networks on both CIFAR-100 and ImageNet datasets, which suggests that more sophisticated attention mechanisms for feature fusion hold great potential to consistently yield better results compared to their direct counterparts. Our codes and trained models are available online1.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · see citing works
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404 · see citing works
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404 · see citing works
Jakubův, J., Chvalovský, K., Goertzel, Z., et al. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,648 · see citing works
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566 · see citing works
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562 · see citing works
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460 · see citing works
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380 · see citing works
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834 · see citing works
Squeeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667 · see citing works
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138 · see citing works
Feature Pyramid Networks for Object Detection
Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.106 · Cited by 30,939 · see citing works
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818 · see citing works
CBAM: Convolutional Block Attention Module
Woo, S., Park, J., Lee, J.-Y., & Kweon, I. S. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_1 · Cited by 25,853 · see citing works
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,890 · see citing works
(2010) · International Conference on Machine Learning · Cited by 13,995 · see citing works
Aggregated Residual Transformations for Deep Neural Networks
Xie, S., Girshick, R., Dollar, P., Tu, Z., & He, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.634 · Cited by 12,465 · see citing works
Squeeze-and-Excitation Networks
Hu, J., Shen, L., Albanie, S., Sun, G., & Wu, E. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2913372 · Cited by 12,157 · see citing works
Wang, X., Girshick, R., Gupta, A., & He, K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00813 · Cited by 11,596 · cited 1× · see citing works
“For example, the matrix multiplication in self-attention draws global dependencies of each word in a sentence [42] or each pixel in an image [7, 45, 1].”
BackgroundIdentity mappings in deep residual networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_38 · Cited by 10,741 · see citing works
ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks
Wang, Q., Wu, B., Zhu, P., Li, P., Zuo, W., & Hu, Q. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01155 · Cited by 9,641 · cited 1× · see citing works
“5 M Efficient-Channel-Attention-Net-101 [42] 21.”
Dual Attention Network for Scene Segmentation
Fu, J., Liu, J., Tian, H., Li, Y., Bao, Y., Fang, Z., & Lu, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00326 · Cited by 7,351 · see citing works
Zagoruyko, S., & Komodakis, N. (2016) · Procedings of the British Machine Vision Conference 2016 · doi:10.5244/c.30.87 · Cited by 7,244 · see citing works
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01228-7 · Cited by 6,909 · see citing works
Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning
Szegedy, C., Ioffe, S., Vanhoucke, V., & Alemi, A. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11231 · Cited by 4,636 · see citing works
Li, X., Wang, W., Hu, X., & Yang, J. J. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00060 · Cited by 3,416 · see citing works
ResNeSt: Split-Attention Networks
Zhang, H., Wu, C., Zhang, Z., Zhu, Y., Lin, H., Zhang, Z., Sun, Y., He, T., Mueller, J. W., Manmatha, R., et al. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00309 · Cited by 1,965 · see citing works
ResNeSt: Split-Attention Networks
Zhang, H., Wu, C., Zhang, Z., Zhu, Y., Lin, H., Zhang, Z., Sun, Y., He, T., Mueller, J., Manmatha, R., et al. (2020) · arXiv · doi:10.48550/arxiv.2004.08955 · Cited by 1,809 · see citing works
Hypercolumns for object segmentation and fine-grained localization
Hariharan, B., Arbelaez, P., Girshick, R., & Malik, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298642 · Cited by 1,511 · see citing works
Attention to Scale: Scale-Aware Semantic Image Segmentation
Chen, L.-C., Yang, Y., Wang, J., Xu, W., & Yuille, A. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.396 · Cited by 1,462 · see citing works
Training Very Deep NetworksPreprint
Srivastava, R. K., Greff, K., & Schmidhuber, J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1507.06228 · Cited by 1,453 · see citing works
Attention Augmented Convolutional Networks
Bello, I., Zoph, B., Le, Q. V., Vaswani, A., & Shlens, J. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00338 · Cited by 1,320 · see citing works
Scale-Aware Trident Networks for Object Detection
Li, Y., Chen, Y., Wang, N., & Zhang, Z. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00615 · Cited by 1,225 · see citing works
ParseNet: Looking Wider to See BetterPreprint
Liu, W., Rabinovich, A., & Berg, A. C. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.04579 · Cited by 1,056 · see citing works
BAM: Bottleneck Attention ModulePreprint
Park, J., Woo, S., Lee, J., & Kweon, I. S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.06514 · Cited by 951 · see citing works
Pyramid Attention Network for Semantic SegmentationPreprint
Li, H., Xiong, P., An, J., & Wang, L. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.10180 · Cited by 949 · see citing works
An Analysis of Scale Invariance in Object Detection - SNIP
Singh, B., & Davis, L. S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00377 · Cited by 913 · see citing works
Multi-context Attention for Human Pose Estimation
Chu, X., Yang, W. P., Ouyang, W., Ma, C., Yuille, A., & Wang, X. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.601 · Cited by 752 · see citing works
S^3FD: Single Shot Scale-Invariant Face Detector
Zhang, S., Zhu, X., Lei, Z., Shi, H., Wang, X., & Li, S. Z. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.30 · Cited by 662 · see citing works
Multi-Scale Self-Guided Attention for Medical Image Segmentation
Sinha, A., & Dolz, J. (2020) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.2986926 · Cited by 583 · see citing works
Gather-Excite: Exploiting Feature Context in Convolutional Neural NetworksPreprint
Hu, J., Shen, L., Albanie, S., Sun, G., & Vedaldi, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.12348 · Cited by 574 · see citing works
Salient Object Detection With Pyramid Attention and Salient Edges
Wang, W., Shuyang, Z., Shen, J., Hoi, S. C. H., & Borji, A. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00154 · Cited by 563 · see citing works
Shifting More Attention to Video Salient Object Detection
Fan, D.-P., Wang, W., Cheng, M., & Shen, J. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00875 · Cited by 528 · see citing works
Hierarchical Multi-Scale Attention for Semantic SegmentationPreprint
Tao, A., Sapra, K., & Catanzaro, B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.10821 · Cited by 469 · see citing works
Object Detection Networks on Convolutional Feature Maps
Ren, S., He, K., Girshick, R., Zhang, X., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2601099 · Cited by 454 · see citing works
SNIPER: Efficient Multi-Scale Training
Singh, B., Najibi, M., & Davis, L. S. (2018) · arXiv · doi:10.48550/arxiv.1805.09300 · Cited by 438 · see citing works
JL-DCF: Joint Learning and Densely-Cooperative Fusion Framework for RGB-D Salient Object Detection
Fu, K., Fan, D.-P., Ji, G.-P., & Zhao, Q. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00312 · Cited by 383 · see citing works
Deep Attentive Features for Prostate Segmentation in 3D Transrectal Ultrasound
Wang, Y., Ni, D., Dou, H., Hu, X., Zhu, L., Yang, X., Xu, M., Qin, J., Heng, P.-A., & Wang, T. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2913184 · Cited by 184 · see citing works
LIP: Local Importance-Based Pooling
Gao, Z., Wang, L., & Wu, G. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00345 · Cited by 138 · see citing works
Deepside: A general deep framework for salient object detection
Fu, K., Zhao, Q., Gu, I. Y., & Yang, J. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.04.062 · Cited by 106 · see citing works
A Skip Attention Mechanism for Monaural Singing Voice Separation
Yuan, W., Wang, S., Li, X., Unoki, M., & Wang, W. (2019) · IEEE Signal Processing Letters · doi:10.1109/lsp.2019.2935867 · Cited by 28 · see citing works
A Benchmark Dataset and Multi-Scale Attention Network for Semantic Traffic Light Detection
Feng, Y., Kong, D., Wei, P., Sun, H., & Zheng, N. (2019) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc45078.2019.9086430 · Cited by 6 · see citing works
Flagged first, then by citations
1 of the 53 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Wu, Y., Chen, K., Zhang, T., Hui, Y., Berg-Kirkpatrick, T., & Dubnov, S. (2023) · ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp49357.2023.10095969 · Cited by 459 · see citing works
“Where α = fAFF (X global, X a local) is a factor obtained by attention feature fusion (AFF) [21], a two-branch CNN model for learning the fusion factor of two inputs.”
MethodSelf-citationContext-aware Cross-level Fusion Network for Camouflaged Object Detection
Sun, Y., Chen, G., Zhou, T., Zhang, Y., & Liu, N. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/142 · Cited by 356 · see citing works
Changer: Feature Interaction is What You Need for Change Detection
Fang, S. E., Li, K., & Li, Z. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2023.3277496 · Cited by 312 · see citing works
Camouflaged Object Detection via Context-Aware Cross-Level Fusion
Chen, G., Liu, S.-J., Sun, Y.-J., Ji, G.-P., Wu, Y., & Zhou, T. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3178173 · Cited by 271 · see citing works
Self-citationI Can Find You! Boundary-Guided Separated Attention Network for Camouflaged Object Detection
Zhu, H., Li, P., Xie, H., Yan, X., Liang, D., Chen, D., Wei, M., & Qin, J. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i3.20273 · Cited by 268 · see citing works
Lightweight Underwater Object Detection Based on YOLO v4 and Multi-Scale Attentional Feature Fusion
Zhang, M., Xu, S., Song, W., He, Q., & Wei, Q. (2021) · Remote Sensing · doi:10.3390/rs13224706 · Cited by 237 · see citing works
Pixels, Regions, and Objects: Multiple Enhancement for Salient Object Detection
Wang, Y., Wang, R., Fan, X., Wang, T., & He, X. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00967 · Cited by 148 · see citing works
NAS-YOLOX: a SAR ship detection using neural architecture search and multi-scale attention
Wang, H., Han, D., Cui, M., & Chen, C. (2023) · Connection Science · doi:10.1080/09540091.2023.2257399 · Cited by 145 · see citing works
Detection-Friendly Dehazing: Object Detection in Real-World Hazy Scenes
Li, C., Zhou, H., Liu, Y., Yang, C., Xie, Y., Li, Z., & Zhu, L. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3234976 · Cited by 126 · see citing works
A review of small object detection based on deep learning
Wei, W., Cheng, Y., He, J., & Zhu, X. (2024) · Neural Computing and Applications · doi:10.1007/s00521-024-09422-6 · Cited by 127 · see citing works
BiCnet-TKS: Learning Efficient Spatial-Temporal Representation for Video Person Re-Identification
Hou, R., Chang, H., Ma, B., Huang, R., & Shan, S. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00205 · Cited by 122 · see citing works
Ding, W., Wang, H., Huang, J., Ju, H., Geng, Y., Lin, C., & Pedrycz, W. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101880 · Cited by 121 · see citing works
Chen, Z., Zhou, Y., Wang, B., Xu, X., He, N., Jin, S., & Jin, S. (2022) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2022.07.016 · Cited by 113 · see citing works
Wu, H., Zhao, Z., & Wang, Z. (2023) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2023.3292373 · Cited by 112 · see citing works
MS-TCT: Multi-Scale Temporal ConvTransformer for Action Detection
Dai, R., Das, S., Kahatapitiya, K., Ryoo, M. S., & Brémond, F. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01941 · Cited by 113 · see citing works
CoLa-Diff: Conditional Latent Diffusion Model for Multi-modal MRI Synthesis
Jiang, L., Mao, Y., Wang, X., Chen, X., & Li, C. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-43999-5_38 · Cited by 108 · see citing works
Yan, X., Jiang, D. L., Xiang, L., Xu, Y., & Wang, Y. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102554 · Cited by 105 · see citing works
A Dataset and Benchmark for Multimodal Biometric Recognition Based on Fingerprint and Finger Vein
Ren, H., Sun, L., Guo, J. W., & Han, C. (2022) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3175599 · Cited by 104 · see citing works
StoHisNet: A hybrid multi-classification model with CNN and Transformer for gastric pathology images
Fu, B., Zhang, M., He, J., Cao, Y., Guo, Y., & Wang, R. (2022) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2022.106924 · Cited by 100 · see citing works
Modality-Induced Transfer-Fusion Network for RGB-D and RGB-T Salient Object Detection
Chen, G., Shao, F., Chai, X., Chen, H., Jiang, Q., Meng, X., & Ho, Y. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3215979 · Cited by 99 · see citing works
Co-Attention Fusion Network for Multimodal Skin Cancer Diagnosis
He, X., Wang, Y., Zhao, S., & Chen, X. (2022) · Pattern Recognition · doi:10.1016/j.patcog.2022.108990 · Cited by 97 · see citing works
IRSTFormer: A Hierarchical Vision Transformer for Infrared Small Target Detection
Gao, C., Wang, W., & Tan, S. (2022) · Remote Sensing · doi:10.3390/rs14143258 · Cited by 89 · see citing works
Ensemble Multifeatured Deep Learning Models and Applications: A Survey
Abimannan, S., El-Alfy, E.-S. M., Chang, Y., Hussain, S., Shukla, S., & Satheesh, D. (2023) · IEEE Access · doi:10.1109/access.2023.3320042 · Cited by 101 · see citing works
Context and Spatial Feature Calibration for Real-Time Semantic Segmentation
Li, K., Geng, Q., Wan, M., Cao, X., & Zhou, Z. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3318967 · Cited by 87 · see citing works
Liu, S., Chen, Z., Yuan, L., Xu, Z., Jin, L., & Zhang, C. (2023) · Journal of Energy Storage · doi:10.1016/j.est.2023.109658 · Cited by 84 · see citing works
DSNet: A Novel Way to Use Atrous Convolutions in Semantic Segmentation
Guo, Z., Bian, L., Wei, H., Li, J., Ni, H., & Huang, X. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3509504 · Cited by 89 · see citing works
Tang, J., Ma, Z., Gan, K., Zhang, J., & Yin, Z. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.102129 · Cited by 82 · see citing works
Ning, E., Wang, Y., Wang, Y., Zhang, H., & Ning, X. (2023) · Neural Networks · doi:10.1016/j.neunet.2023.11.003 · Cited by 81 · see citing works
Zhao, S., Tang, H., Liu, S., Zhang, Y., Wang, H., Xu, T., Chen, E., & Guan, C. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.06.024 · Cited by 82 · see citing works
Multi-modal Depression Estimation Based on Sub-attentional Fusion
Wei, P.-C., Peng, K., Roitberg, A., Yang, K., Zhang, J., & Stiefelhagen, R. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-25075-0_42 · Cited by 77 · see citing works
Neural Image Compression via Attentional Multi-scale Back Projection and Frequency Decomposition
Gao, G., You, P., Pan, R., Han, S., Zhang, Y., Dai, Y., & Lee, H.-J. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01441 · Cited by 76 · see citing works
Self-citationTransformer-Based Multi-Scale Feature Integration Network for Video Saliency Prediction
Zhou, X., Wu, S., Shi, R., Zheng, B., Wang, S., Yin, H., Zhang, J., & Yan, C. C. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3278410 · Cited by 76 · see citing works
CRS-Diff: Controllable Remote Sensing Image Generation With Diffusion Model
Tang, D., Cao, X., Hou, X., Jiang, Z., Liu, J., & Meng, D. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3453414 · Cited by 81 · see citing works
Small Object Detection in Traffic Scenes Based on Attention Feature Fusion
Lian, J., Yin, Y., Li, L., Wang, Z., & Zhou, Y. (2021) · Sensors · doi:10.3390/s21093031 · Cited by 76 · see citing works
Uncertainty-Aware Hierarchical Aggregation Network for Medical Image Segmentation
Zhou, T., Zhou, Y., Li, G., Chen, G., & Shen, J. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3370685 · Cited by 74 · see citing works
Zhang, Y., Zhang, Q., Zhao, H., Lin, Y., Gui, G., & Sari, H. (2024) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2024.3353594 · Cited by 72 · see citing works
Attention-guided hierarchical fusion U-Net for uncertainty-driven medical image segmentation
Munia, A. A., Abdar, M., Hasan, M., Jalali, M. S., Banerjee, B., Khosravi, A., Hossain, I., Fu, H., & Frangi, A. F. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102719 · Cited by 72 · see citing works
Visual fire detection using deep learning: A survey
Cheng, G., Chen, X., Wang, C., Li, X., Xian, B., & Yu, H. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.127975 · Cited by 73 · see citing works
Hou, J., Luo, C., Qin, F., Shao, Y., & Chen, X. (2023) · Advanced Engineering Informatics · doi:10.1016/j.aei.2023.102008 · Cited by 69 · see citing works
A dual-branch network for ultrasound image segmentation
Zhu, Z., Zhang, Z., Qi, G., Li, Y., Li, Y., & Mu, L. (2025) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2024.107368 · Cited by 71 · see citing works
Xue, Z., Yu, X., Tan, X., Liu, B., Yu, A., & Wei, X. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3106025 · Cited by 68 · see citing works
FFEDN: Feature Fusion Encoder Decoder Network for Crack Detection
Liu, C., Zhu, C., Xia, X., Zhao, J., & Long, H. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3141827 · Cited by 68 · see citing works
SDRNet: Camouflaged object detection with independent reconstruction of structure and detail
Guan, J., Fang, X., Zhu, T., & Qian, W. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112051 · Cited by 67 · see citing works
Edge-Aware Mirror Network for Camouflaged Object Detection
Sun, D., Jiang, S., & Qi, L. (2023) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme55011.2023.00420 · Cited by 66 · see citing works
DA-DETR: Domain Adaptive Detection Transformer with Information Fusion
Zhang, J., Huang, J., Luo, Z., Zhang, G., Zhang, X., & Lu, S. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02278 · Cited by 70 · see citing works
Adaptive feature fusion for time series classification
Wang, T., Liu, Z., Zhang, T., Hussain, S. F., Waqas, M. M., & Li, Y. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.108459 · Cited by 59 · see citing works
Yuan, Z., Gong, J., Guo, B., Wang, C., Liao, N., Jiawei, S., & Wu, Q. (2024) · Remote Sensing · doi:10.3390/rs16224265 · Cited by 61 · see citing works
A novel extended multimodal AI framework towards vulnerability detection in smart contracts
Jie, W., Chen, Q., Wang, J., Koe, A. S. V., Li, J., Huang, P., Wu, Y., & Wang, Y. (2023) · Information Sciences · doi:10.1016/j.ins.2023.03.132 · Cited by 59 · see citing works
Self-citationYOLO-ReT: Towards High Accuracy Real-time Object Detection on Edge GPUs
Ganesh, P., Chen, Y., Yang, Y., Chen, D., & Winslett, M. (2022) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv51458.2022.00138 · Cited by 58 · see citing works
Fan Fault Diagnosis Based on Lightweight Multiscale Multiattention Feature Fusion Network
Fan, Z., Xu, X., Wang, R., & Wang, H. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3121294 · Cited by 57 · see citing works
Qu, J., Tang, Z., Zhang, L., Zhang, Y., & Zhang, Z. (2023) · Remote Sensing · doi:10.3390/rs15112728 · Cited by 57 · see citing works
Deng, H., & Zhang, Y. (2023) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2023.3336445 · Cited by 57 · see citing works
BTS-E: Audio Deepfake Detection Using Breathing-Talking-Silence Encoder
Doan, T.-P., Nguyen-Vu, L., Jung, S., & Hong, K. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095927 · Cited by 57 · see citing works
Muzammul, M., & Li, X. (2025) · Knowledge and Information Systems · doi:10.1007/s10115-025-02375-9 · Cited by 59 · see citing works
Bidirectional Collaborative Mentoring Network for Marine Organism Detection and Beyond
Cheng, J., Wu, Z., Wang, S., Demonceaux, C., & Jiang, Q. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3264442 · Cited by 54 · see citing works
Liang, X., Xu, L., Zhang, W., Zhang, Y., Liu, J., & Liu, Z. (2022) · The Visual Computer · doi:10.1007/s00371-022-02413-5 · Cited by 52 · see citing works
Zhao, L. F., & Tao, W. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3218076 · Cited by 53 · see citing works
MAD-YOLO: A quantitative detection algorithm for dense small-scale marine benthos
Xu, X., Liu, Y., Lyu, L., Yan, P., & Zhang, J. (2023) · Ecological Informatics · doi:10.1016/j.ecoinf.2023.102022 · Cited by 52 · see citing works
FVFSNet: Frequency-Spatial Coupling Network for Finger Vein Authentication
Huang, J., Zheng, A., Shakeel, M. S., Yang, W., & Kang, W. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3238546 · Cited by 51 · see citing works
Targeted Adversarial Attack Against Deep Cross-Modal Hashing Retrieval
Wang, T., Zhu, L., Zhang, Z., Zhang, H., & Han, J. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3263054 · Cited by 52 · see citing works
Hao, S., Zhang, L., Jiang, Y., Wang, J., Ji, Z., Zhao, L. Y., & Ганчев, И. (2023) · IEEE Access · doi:10.1109/access.2023.3324042 · Cited by 51 · see citing works
Dai, Y., Pan, P., Qian, Y., Li, Y., Li, X., Yang, J., & Wang, H. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3458896 · Cited by 80 · see citing works
Self-citationCCST: crowd counting with swin transformer
Li, B., Zhang, Y., Xu, H., & Yin, B. (2022) · The Visual Computer · doi:10.1007/s00371-022-02485-3 · Cited by 50 · see citing works
MVSI-Net: Multi-view attention and multi-scale feature interaction for brain tumor segmentation
Sun, J.-D., Hu, M., Wu, X.-S., Tang, C.-S., Lahza, H., Wang, S.-H., & Zhang, Y.-D. (2024) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2024.106484 · Cited by 45 · see citing works
Adaptive enhanced swin transformer with U-net for remote sensing image segmentation
Gu, X., Li, S., Ren, S., Zheng, H., Fan, C., & Xu, H. (2022) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2022.108223 · Cited by 48 · see citing works
Multi-scale feature pyramid fusion network for medical image segmentation
Zhang, B., Wang, Y., Ding, C., Deng, Z., Li, L., Qin, Z., Ding, Z., Bian, L., & Yang, C. (2022) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-022-02738-5 · Cited by 48 · see citing works
Enhanced semantic feature pyramid network for small object detection
Chen, Y., Zhu, X., Li, Y., Wei, Y., & Ye, L. (2023) · Signal Processing Image Communication · doi:10.1016/j.image.2023.116919 · Cited by 49 · see citing works
FasterSal: Robust and Real-Time Single-Stream Architecture for RGB-D Salient Object Detection
Zhang, J., Zhang, R., Xu, L., Lu, X., Yu, Y., Xu, M. G., & Zhao, H. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3521699 · Cited by 48 · see citing works
Real-time traffic sign detection based on multiscale attention and spatial information aggregator
Zhang, J., Ye, Z., Jin, X., Zhang, J., & Zhang, J. (2022) · Journal of Real-Time Image Processing · doi:10.1007/s11554-022-01252-w · Cited by 47 · see citing works
Pyramid Architecture for Multi-Scale Processing in Point Cloud Segmentation
Nie, D., Lan, R., Wang, L., & Ren, X. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01677 · Cited by 47 · see citing works
A Generative-Based Image Fusion Strategy for Visible-Infrared Person Re-Identification
Qi, J., Liang, T., Liu, W., Li, Y., & Jin, Y. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3287300 · Cited by 47 · see citing works
A Novel Neural Network Model for Traffic Sign Detection and Recognition under Extreme Conditions
Wan, H., Gao, L., Su, M., You, Q., Qu, H. Y., & Sun, Q. (2021) · Journal of Sensors · doi:10.1155/2021/9984787 · Cited by 47 · see citing works
Tiny object detection model based on competitive multi-layer neural network (TOD-CMLNN)
Chirgaiya, S., & Rajavat, A. (2023) · Intelligent Systems with Applications · doi:10.1016/j.iswa.2023.200217 · Cited by 46 · see citing works
Citrus pose estimation from an RGB image for automated harvesting
Sun, Q., Zhong, M., Chai, X., Zeng, Z., Yin, H., Zhou, G., & Sun, T. (2023) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2023.108022 · Cited by 46 · see citing works
AFFU-Net: Attention feature fusion U-Net with hybrid loss for winter jujube crack detection
Zheng, Z., Hu, Y., Yang, H., Qiao, Y., He, Y., Zhang, Y., & Huang, Y. (2022) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2022.107049 · Cited by 45 · see citing works
A Novel PPG-FMG-ACC Wristband for Hand Gesture Recognition
Wang, H., Kang, P., Gao, Q., Jiang, S., & Shull, P. B. (2022) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2022.3194017 · Cited by 45 · see citing works
Precision detection of crop diseases based on improved YOLOv5 model
Zhao, Y., Yang, Y., Xu, X., & Sun, C. (2023) · Frontiers in Plant Science · doi:10.3389/fpls.2022.1066835 · Cited by 45 · see citing works
Few-shot semantic segmentation: a review on recent approaches
Chang, Z., Lu, Y., Ran, X., Gao, X., & Wang, X. (2023) · Neural Computing and Applications · doi:10.1007/s00521-023-08758-9 · Cited by 45 · see citing works
Fusing Bone-Conduction and Air-Conduction Sensors for Complex-Domain Speech Enhancement
Wang, H., Zhang, X., & Wang, D. (2022) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2022.3209943 · Cited by 44 · see citing works
WAID: A Large-Scale Dataset for Wildlife Detection with Drones
Mou, C., Liu, T., Zhu, C., & Cui, X. (2023) · Applied Sciences · doi:10.3390/app131810397 · Cited by 44 · see citing works
BSSNet: A Real-Time Semantic Segmentation Network for Road Scenes Inspired From AutoEncoder
Shi, X., Yin, Z., Han, G., Liu, W., Qin, L., Bi, Y., & Li, S. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3325360 · Cited by 44 · see citing works
Locate, Refine and Restore: A Progressive Enhancement Network for Camouflaged Object Detection
Li, X., Yang, J., Li, S., Lei, J. W., Zhang, J., & Chen, D. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/124 · Cited by 43 · see citing works
BGRD-TransUNet: A Novel TransUNet-Based Model for Ultrasound Breast Lesion Segmentation
Ji, Z., Sun, H., Yuan, N., Zhang, H., Sheng, J., Zhang, X., & Ганчев, И. (2024) · IEEE Access · doi:10.1109/access.2024.3368170 · Cited by 45 · see citing works
Ma, Q., Li, X., Li, B., Zhu, Z., Wu, J., Huang, F., & Hu, H. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103182 · Cited by 43 · see citing works
NTIRE 2023 Image Shadow Removal Challenge Report
Vasluianu, F.-A., Seizinger, T., Timofte, R., Cui, S., Huang, J., Tian, S., Fan, M., Zhang, J., Zhu, L., Wei, X., et al. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00179 · Cited by 42 · see citing works
Self-citationQiao, X., Yan, Q., & Huang, W. (2025) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2025.3574129 · Cited by 42 · see citing works
HDINet: Hierarchical Dual-Sensor Interaction Network for RGBT Tracking
Mei, J., Zhou, D., Cao, J., Nie, R., & Guo, Y. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2021.3078455 · Cited by 42 · see citing works
D-Net: Dynamic large kernel with dynamic feature fusion for volumetric medical image segmentation
Yang, J., Qiu, P., Zhang, Y., Marcus, D. S., & Sotiras, A. (2025) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2025.108837 · Cited by 40 · see citing works
Hashing-Based Deep Metric Learning for the Classification of Hyperspectral and LiDAR Data
Song, W., Dai, Y., Gao, Z. Y., Fang, L., & Zhang, Y. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2023.3321057 · Cited by 39 · see citing works
Self-citationA Cross-Lesion Attention Network for Accurate Diabetic Retinopathy Grading With Fundus Images
Liu, X., & Chi, W. (2023) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2023.3322497 · Cited by 39 · see citing works
Lu, W. B., Hu, Y., Shao, W., Wang, H., Zhang, Z., & Wang, M. (2024) · International Journal of Digital Earth · doi:10.1080/17538947.2023.2300731 · Cited by 39 · see citing works
Bai, L., Islam, M., Seenivasan, L., & Ren, H. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10160403 · Cited by 40 · see citing works
Occluded Insulator Detection System Based on YOLOX of Multi-Scale Feature Fusion
Luo, B., Xiao, J., Zhu, G., Fang, X., & Wang, J. (2024) · IEEE Transactions on Power Delivery · doi:10.1109/tpwrd.2024.3350162 · Cited by 38 · see citing works
Gu, Y., Zhou, T., Zhang, Y., Zhou, Y. X., He, K., Gong, C., & Fu, H. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.110962 · Cited by 38 · see citing works
Zhang, J., Yang, K., Wang, Y., Wang, H., Sun, P., & Song, L. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01195 · Cited by 38 · see citing works
Edge-aware Feature Aggregation Network for Polyp Segmentation
Zhou, T., Zhang, Y., Chen, G., Zhou, Y., Wu, Y., & Fan, D.-P. (2023) · Machine Intelligence Research · doi:10.1007/s11633-023-1479-8 · Cited by 39 · see citing works
Self-citationAn Improved U-Net Model for Infrared Image Segmentation of Wind Turbine Blade
Yu, J., He, Y., Liu, H., Zhang, F., Li, J., Sun, G., Zhang, X., Yang, R., Wang, P., & Wang, H. (2022) · IEEE Sensors Journal · doi:10.1109/jsen.2022.3224837 · Cited by 37 · see citing works
Multimodal Finger Recognition Based on Asymmetric Networks With Fused Similarity
Huang, Y., Ma, H., & Wang, M. (2023) · IEEE Access · doi:10.1109/access.2023.3242984 · Cited by 37 · see citing works
Cheng, W., Feng, Y., Song, L., & Wang, X. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112159 · Cited by 36 · see citing works
Zhang, R., Yin, Z., Wu, Z., & Zhou, S. (2021) · Applied Sciences · doi:10.3390/app11031327 · Cited by 36 · see citing works
- Authors
- Dai, Y., Gieseke, F., Oehmcke, S., Wu, Y., & Barnard, K.
- Affiliations
- Nanjing University of Aeronautics and Astronautics (CN)
- University of Copenhagen (DK)
- University of Arizona (US)
- Venue
- 2021 IEEE Winter Conference on Applications of Computer Vision (WACV)
- Publisher
- IEEE
- Published
- 2021-01
- Pages
- 3559-3568
- ISSN
- 2472-6737 (ISSN-L)
- OpenAlex
- W3094897602
- Semantic Scholar
- 33667aea67898e114ca100ee3e2b2a613b8a943a
- Cited by
- 1,274
- References
- 53
- Citations by year
- 2026: 142 · 2025: 358 · 2024: 386 · 2023: 231 · 2022: 120 · 2021: 37
- FWCI
- 63.17
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Winter Conference on Applications of Computer Vision (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Research at the University of Copenhagen (University of Copenhagen) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Natural Science Foundation of China
- National Laboratory of Pattern Recognition
- Nanjing University of Aeronautics and Astronautics
- China Association for Science and Technology
- China Scholarship Council
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Visual Attention and Saliency Detection
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- attentional feature fusion, skip connections, attention mechanism, feature fusion
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review