The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Rethinking the Image Fusion: A Fast Unified Image Fusion Network based on Proportional Maintenance of Gradient and Intensity
Open accessAbstract
In this paper, we propose a fast unified image fusion network based on proportional maintenance of gradient and intensity (PMGI), which can end-to-end realize a variety of image fusion tasks, including infrared and visible image fusion, multi-exposure image fusion, medical image fusion, multi-focus image fusion and pan-sharpening. We unify the image fusion problem into the texture and intensity proportional maintenance problem of the source images. On the one hand, the network is divided into gradient path and intensity path for information extraction. We perform feature reuse in the same path to avoid loss of information due to convolution. At the same time, we introduce the pathwise transfer block to exchange information between different paths, which can not only pre-fuse the gradient information and intensity information, but also enhance the information to be processed later. On the other hand, we define a uniform form of loss function based on these two kinds of information, which can adapt to different fusion tasks. Experiments on publicly available datasets demonstrate the superiority of our PMGI over the state-of-the-art in terms of both visual effect and quantitative metric in a variety of fusion tasks. In addition, our method is faster compared with the state-of-the-art.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
FusionGAN: A generative adversarial network for infrared and visible image fusion
Ma, J., Yu, W., Liang, P., Li, C., & Jiang, J. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.09.004 · Cited by 2,267
Self-citationInfrared and visible image fusion methods and applications: A survey
Ma, J., Ma, Y., & Li, C. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.02.004 · Cited by 1,732
Self-citationMulti-focus image fusion with a deep convolutional neural network
Liu, Y., Chen, X., Peng, H., & Wang, Z. (2017) · Information Fusion · doi:10.1016/j.inffus.2016.12.001 · Cited by 1,327
Learning a Deep Single Image Contrast Enhancer from Multi-Exposure Images
Cai, J., Gu, S., & Zhang, L. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2794218 · Cited by 1,234
Perceptual Quality Assessment for Multi-Exposure Image Fusion
Ma, K., Zeng, K., & Wang, Z. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2442920 · Cited by 1,190
Infrared and visible image fusion via gradient transfer and total variation minimization
Ma, J., Chen, C., Li, C., & Huang, J. (2016) · Information Fusion · doi:10.1016/j.inffus.2016.02.001 · Cited by 1,128
Self-citationDeepFuse: A Deep Unsupervised Approach for Exposure Fusion with Extreme Exposure Image Pairs
Prabhakar, K. R., Srikar, V. S., & Babu, R. V. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.505 · Cited by 726
Image fusion by a ratio of low-pass pyramid
Toet, A. (1989) · Pattern Recognition Letters · doi:10.1016/0167-8655(89)90003-2 · Cited by 690
A Fast Intensity–Hue–Saturation Fusion Technique With Spectral Adjustment for IKONOS Imagery
Tu, T.-M., Huang, P. S., Hung, C.-L., & Chang, C.-P. (2004) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2004.834804 · Cited by 602
Yin, M., Liu, X., Liu, Y., & Chen, X. (2019) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2018.2838778 · Cited by 594
Multi-focus image fusion using dictionary-based sparse representation
Nejati, M., Samavi, S., & Shirani, S. (2015) · Information Fusion · doi:10.1016/j.inffus.2014.10.004 · Cited by 544
Color enhancement of highly correlated images. I. Decorrelation and HSI contrast stretches
Gillespie, A. R., Kahle, A. B., & Walker, R. E. (1986) · Remote Sensing of Environment · doi:10.1016/0034-4257(86)90044-1 · Cited by 517
A new image quality metric for image fusion: The sum of the correlations of differences
Aslantas, V., & Bendes, E. (2015) · AEU - International Journal of Electronics and Communications · doi:10.1016/j.aeue.2015.09.004 · Cited by 507
An Adaptive IHS Pan-Sharpening Method
Rahmani, S., Strait, M., Merkurjev, D., Moeller, M., & Wittman, T. (2010) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2010.2046715 · Cited by 452
Pixel-level Image Fusion using Wavelets and Principal Component Analysis
Naidu, V., & Raol, J. (2008) · Defence Science Journal · doi:10.14429/dsj.58.1653 · Cited by 423
Robust Multi-Exposure Image Fusion: A Structural Patch Decomposition Approach
Ma, K., Li, H., Yong, H., Wang, Z., Meng, D., & Zhang, L. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2671921 · Cited by 355
Simultaneous image fusion and denoising with adaptive sparse representation
Liu, Y., & Wang, Z. (2015) · IET Image Processing · doi:10.1049/iet-ipr.2014.0311 · Cited by 351
Shreyamsha Kumar, B. K. (2013) · Signal, Image and Video Processing · doi:10.1007/s11760-012-0361-x · Cited by 345
Quadtree-based multi-focus image fusion using a weighted focus-measure
Bai, X., Zhang, Y., Zhou, F., & Xue, B. (2015) · Information Fusion · doi:10.1016/j.inffus.2014.05.003 · Cited by 277
SESF-Fuse: an unsupervised deep model for multi-focus image fusion
Ma, B., Zhu, Y., Yin, X., Ban, X., Huang, H., & Mukeshimana, M. (2021) · Neural Computing and Applications · doi:10.1007/s00521-020-05358-9 · Cited by 266
Multi-focus image fusion for visual sensor networks in DCT domain
Haghighat, M. B. A., Aghagolzadeh, A., & Seyedarabi, H. (2011) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2011.04.016 · Cited by 245
Multi-Exposure and Multi-Focus Image Fusion in Gradient Domain
Paul, S., Sevcenco, I. S., & Agathoklis, P. (2016) · Journal of Circuits, Systems and Computers · doi:10.1142/s0218126616501231 · Cited by 211
Lee, S., Park, J. S., & Cho, N. I. (2018) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2018.8451153 · Cited by 114
Xu, H., Liang, P., Yu, W., Jiang, J., & Ma, J. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/549 · Cited by 112
Self-citationGhost-free multi exposure image fusion technique using dense SIFT descriptor and guided filter
Hayat, N., & Imran, M. (2019) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2019.06.002 · Cited by 111
Information Fusion of Passive Sensors for Detection of Moving Targets in Dynamic Environments
Li, Y., Jha, D. K., Ray, A., & Wettergren, T. A. (2016) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2015.2508024 · Cited by 54
A multi-scale contrast-based image quality assessment model for multi-exposure image fusion
Lu, X., Cai, L., Zeng, H., Chen, J., Zhu, J., & Hou, J. (2017) · Signal Processing · doi:10.1016/j.sigpro.2017.12.013 · Cited by 38
Cited by
SwinFusion: Cross-domain Long-range Learning for General Image Fusion via Swin Transformer
Ma, J., Tang, L., Fan, F., Huang, J., Mei, X., & Ma, Y. (2022) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2022.105686 · Cited by 1,526
Self-citationRFN-Nest: An end-to-end residual fusion network for infrared and visible images
Li, H., Wu, X.-J., & Kittler, J. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.02.023 · Cited by 1,173
PIAFusion: A progressive infrared and visible image fusion network based on illumination aware
Tang, L., Yuan, J., Zhang, H., Jiang, X., & Ma, J. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.03.007 · Cited by 1,161
Self-citationTang, L., Yuan, J., & Ma, J. (2022) · Information Fusion · doi:10.1016/j.inffus.2021.12.004 · Cited by 1,136
Self-citationInfrared and Visible Image Fusion via Decoupling Network
Wang, X., Guan, Z., Yu, S., Cao, J., & Li, Y. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3216413 · Cited by 969
Metadata
- Authors
- Zhang, H., Xu, H., Xiao, Y., Guo, X., & Ma, J.
- Venue
- Proceedings of the AAAI Conference on Artificial Intelligence
- Published
- 2020-04-03
- Volume
- 34
- Issue
- 07
- Pages
- 12797-12804
- ISSN
- 2159-5399 (ISSN-L)
- 2374-3468
- OpenAlex
- W2998012573
- Cited by
- 589
- References
- 28
- FWCI
- 138.27
- Type
- conference paper
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.