The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
MetaFusion: Infrared and Visible Image Fusion via Meta-Feature Embedding from Object Detection
Abstract
Fusing infrared and visible images can provide more texture details for subsequent object detection task. Conversely, detection task furnishes object semantic information to improve the infrared and visible image fusion. Thus, a joint fusion and detection learning to use their mutual promotion is attracting more attention. However, the feature gap between these two different-level tasks hinders the progress. Addressing this issue, this paper proposes an infrared and visible image fusion via meta-feature embedding from object detection. The core idea is that meta-feature embedding model is designed to generate object semantic features according to fusion network ability, and thus the semantic features are naturally compatible with fusion features. It is optimized by simulating a meta learning. Moreover, we further implement a mutual promotion learning between fusion and detection tasks to improve their performances. Comprehensive experiments on three public datasets demonstrate the effectiveness of our method. Code and model are available at: https://github.com/wdzhao123/MetaFusion.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.322 · Cited by 29,137
End-to-End Object Detection with Transformers
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58452-8_13 · Cited by 18,285
End-to-End Object Detection with Transformers
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020) · arXiv · doi:10.48550/arxiv.2005.12872 · Cited by 18,253
Focal Loss for Dense Object Detection
Lin, T.-Y., Goyal, P., Girshick, R., He, K., & Dollar, P. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2858826 · Cited by 9,556
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
Finn, C., Abbeel, P., & Levine, S. (2017) · arXiv · doi:10.48550/arxiv.1703.03400 · Cited by 8,512
Cascade R-CNN: Delving Into High Quality Object Detection
Cai, Z., & Vasconcelos, N. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00644 · Cited by 7,370
Generalized Intersection Over Union: A Metric and a Loss for Bounding Box Regression
Rezatofighi, H., Tsoi, N., Gwak, J., Sadeghian, A., Reid, I., & Savarese, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00075 · Cited by 6,612
FusionGAN: A generative adversarial network for infrared and visible image fusion
Ma, J., Yu, W., Liang, P., Li, C., & Jiang, J. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.09.004 · Cited by 2,267
U2Fusion: A Unified Unsupervised Image Fusion Network
Xu, H., Ma, J., Jiang, J., Guo, X., & Ling, H. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3012548 · Cited by 2,127
DenseFuse: A Fusion Approach to Infrared and Visible Images
Li, H., & Wu, X.-J. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2887342 · Cited by 2,032
SwinFusion: Cross-domain Long-range Learning for General Image Fusion via Swin Transformer
Ma, J., Tang, L., Fan, F., Huang, J., Mei, X., & Ma, Y. (2022) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2022.105686 · Cited by 1,526
A general framework for image fusion based on multi-scale transform and sparse representation
Liu, Y., Liu, S., & Wang, Z. (2015) · Information Fusion · doi:10.1016/j.inffus.2014.09.004 · Cited by 1,431
Information measure for performance of image fusion
Qu, G., Zhang, D., & Yan, P. (2002) · Electronics Letters · doi:10.1049/el:20020212 · Cited by 1,427
Ma, J., Xu, H., Jiang, J., Mei, X., & Zhang, X.-P. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2977573 · Cited by 1,343
Liu, J., Fan, X., Huang, Z., Wu, G., Liu, R., Zhong, W., & Luo, Z. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00571 · Cited by 1,336
RFN-Nest: An end-to-end residual fusion network for infrared and visible images
Li, H., Wu, X.-J., & Kittler, J. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.02.023 · Cited by 1,173
PIAFusion: A progressive infrared and visible image fusion network based on illumination aware
Tang, L., Yuan, J., Zhang, H., Jiang, X., & Ma, J. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.03.007 · Cited by 1,161
A new image fusion performance metric based on visual information fidelity
Han, Y., Cai, Y., Cao, Y., & Xu, X. (2013) · Information Fusion · doi:10.1016/j.inffus.2011.08.002 · Cited by 1,071
Assessment of image fusion procedures using entropy, image quality, and multispectral classification
Van Aardt, J. (2008) · Journal of Applied Remote Sensing · doi:10.1117/1.2945910 · Cited by 747
MDLatLRR: A Novel Decomposition Method for Infrared and Visible Image Fusion
Li, H., Wu, X.-J., & Kittler, J. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2975984 · Cited by 627
Ma, J., Zhang, H., Shao, Z., Liang, P., & Xu, H. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2020.3038013 · Cited by 618
YDTR: Infrared and Visible Image Fusion via Y-Shape Dynamic Transformer
Tang, W., He, F., & Liu, Y. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3192661 · Cited by 485
The TNO Multiband Image Data Collection
Toet, A. (2017) · Data in Brief · doi:10.1016/j.dib.2017.09.038 · Cited by 476
Learning a Deep Multi-Scale Feature Ensemble and an Edge-Attention Guidance for Image Fusion
Liu, J., Fan, X., Jiang, J., Liu, R., & Luo, Z. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3056725 · Cited by 431
VIF-Net: An Unsupervised Framework for Infrared and Visible Image Fusion
Hou, R., Zhou, D., Nie, R., Liu, D., Xiong, L., Guo, Y., & Yu, C. (2020) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2020.2965304 · Cited by 257
Meta Faster R-CNN: Towards Accurate Few-Shot Object Detection with Attentive Feature Alignment
Han, G., Huang, S., Ma, J., He, Y., & Chang, S.-F. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i1.19959 · Cited by 211
Self-citationDRF: Disentangled Representation for Visible and Infrared Image Fusion
Xu, H., Wang, X., & Ma, J. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3056645 · Cited by 187
Multispectral Object Detection for Autonomous Vehicles
Takumi, K., Watanabe, K., Ha, Q., Tejero-De-Pablos, A., Ushiku, Y., & Harada, T. (2017) · Proceedings of the on Thematic Workshops of ACM Multimedia 2017 · doi:10.1145/3126686.3126727 · Cited by 186
Li, H., Cen, Y., Liu, Y., Chen, X., & Yu, Z. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3069339 · Cited by 186
Learning Dynamic Alignment via Meta-filter for Few-shot Learning
Xu, C., Fu, Y., Liu, C., Wang, C., Li, J., Huang, F., Zhang, L., & Xue, X. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00514 · Cited by 175
MetaSAug: Meta Semantic Augmentation for Long-Tailed Visual Recognition
Li, S., Gong, K., Liu, C. H., Wang, Y., Qiao, F., & Cheng, X. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00517 · Cited by 173
CGTF: Convolution-Guided Transformer for Infrared and Visible Image Fusion
Li, J., Zhu, J., Li, C., Chen, X., & Yang, B. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3175055 · Cited by 171
Zhao, W., Wang, D., & Lu, H. (2018) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2018.2821177 · Cited by 168
Self-citationMetaFSCIL: A Meta-Learning Approach for Few-Shot Class Incremental Learning
Chi, Z., Gu, L., Liu, H., Wang, Y., Yu, Y., & Tang, J. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01377 · Cited by 164
Meta-Learning with Task-Adaptive Loss Function for Few-Shot Learning
Baik, S., Choi, J., Kim, H., Cho, D., Min, J., & Lee, K. M. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00933 · Cited by 163
Xu, H., Gong, M., Tian, X. S., Huang, J., & Ma, J. (2022) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2022.103407 · Cited by 151
Multisensor Image Fusion and Enhancement in Spectral Total Variation Domain
Zhao, W., Lu, H., & Wang, D. (2017) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2017.2760100 · Cited by 148
Self-citationSelf-supervised feature adaption for infrared and visible image fusion
Zhao, F., Zhao, W., Yao, L., & Liu, Y. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.06.002 · Cited by 101
Self-citationDESTR: Object Detection with Split Transformer
He, L., & Todorović, S. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00916 · Cited by 100
Wang, Z., Wu, Y., Wang, J., Xu, J., & Shao, W. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3139654 · Cited by 85
Group R-CNN for Weakly Semi-supervised Object Detection with Points
Zhang, S., Yu, Z., Liu, L., Wang, X., Zhou, A., & Chen, K. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00920 · Cited by 76
Attribute filter based infrared and visible image fusion
Mo, Y., Kang, X., Duan, P., Sun, B., & Shutao Li, A. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.04.005 · Cited by 69
Enhancing Diversity of Defocus Blur Detectors via Cross-Ensemble Network
Zhao, W., Zheng, B., Lin, Q., & Lu, H. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00911 · Cited by 67
Self-citationInfrared and visible image fusion via parallel scene and texture learning
Xu, M., Tang, L., Zhang, H., & Ma, J. (2022) · Pattern Recognition · doi:10.1016/j.patcog.2022.108929 · Cited by 59
Background Activation Suppression for Weakly Supervised Object Localization
Wu, P., Zhai, W., & Cao, Y. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01385 · Cited by 54
CLF-Net: Contrastive Learning for Infrared and Visible Image Fusion Network
Zhu, Z., Yang, X., Lu, R., Shen, T., Xie, X., & Zhang, T. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3203000 · Cited by 49
CREAM: Weakly Supervised Object Localization via Class RE-Activation Mapping
Xu, J., Hou, J., Zhang, Y., Feng, R., Zhao, R.-W., Zhang, T., Lu, X., & Gao, S. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00922 · Cited by 49
Defocus Blur Detection via Boosting Diversity of Deep Ensemble Networks
Zhao, W., Hou, X., He, Y., & Lu, H. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3084101 · Cited by 43
Self-citationLearning Specific and General Realm Feature Representations for Image Fusion
Zhao, F., & Zhao, W. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.3016123 · Cited by 40
Self-citationMetaDistiller: Network Self-Boosting via Meta-Learned Top-Down Distillation
Liu, B., Rao, Y., Lu, J., Zhou, J., & Hsieh, C. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58568-6_41 · Cited by 37
Interactive Feature Embedding for Infrared and Visible Image Fusion
Zhao, F., Zhao, W., & Lu, H. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3264911 · Cited by 24
Self-citationRevisiting AP Loss for Dense Object Detection: Adaptive Ranking Pair Selection
Xu, D., Deng, J., & Li, W. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01379 · Cited by 13
A Lazy Approach to Long-Horizon Gradient-Based Meta-Learning
Jamal, M. A., Wang, L., & Gong, B. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00651 · Cited by 9
Metadata
- Authors
- Zhao, W., Xie, S., Zhao, F., He, Y., & Lu, H.
- Venue
- 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2023-06
- Pages
- 13955-13965
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W4386083029
- Cited by
- 259
- References
- 56
- FWCI
- 107.00
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.