The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
MEF-GAN: Multi-Exposure Image Fusion via Generative Adversarial Networks
Abstract
In this paper, we present an end-to-end architecture for multi-exposure image fusion based on generative adversarial networks, termed as MEF-GAN. In our architecture, a generator network and a discriminator network are trained simultaneously to form an adversarial relationship. The generator is trained to generate a real-like fused image based on the given source images which is expected to fool the discriminator. Correspondingly, the discriminator is trained to distinguish the generated fused images from the ground truth. The adversarial relationship makes the fused image not limited to the restriction of the content loss. Therefore, the fused images are closer to the ground truth in terms of probability distribution, which can compensate for the insufficiency of single content loss. Moreover, aiming at the problem that the luminance of multi-exposure images varies greatly with spatial location, the self-attention mechanism is employed in our architecture to allow for attention-driven and long-range dependency. Thus, local distortion, confusing results, or inappropriate representation can be corrected in the fused image. Qualitative and quantitative experiments are performed on publicly available datasets, where the results demonstrate that MEF-GAN outperforms the state-of-the-art, in terms of both visual effect and objective evaluation metrics. Our code is publicly available at https://github.com/jiayi-ma/MEF-GAN.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
Labaca-Castro, R. (2023) · Machine Learning under Malware Attack · doi:10.1007/978-3-658-40442-0_9 · Cited by 19,272
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 14,214
(2010) · International Conference on Machine Learning · Cited by 13,995
Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network
Ledig, C., Theis, L., Huszar, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A., Tejani, A., Totz, J., Wang, Z., et al. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.19 · Cited by 12,696
Wang, X., Girshick, R., Gupta, A., & He, K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00813 · Cited by 11,596
Conditional Generative Adversarial Nets
Mirza, M., & Osindero, S. (2014) · arXiv · doi:10.48550/arxiv.1411.1784 · Cited by 8,863
GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
Heusel, M., Ramsauer, H., Unterthiner, T., Nessler, B., & Hochreiter, S. (2017) · arXiv · doi:10.48550/arxiv.1706.08500 · Cited by 8,365
(2017) · International Conference on Machine Learning · Cited by 6,382
“Least squares generative adversarial networks,”
Mao, X., Li, Q., Xie, H., Lau, R. Y. K., Wang, Z., & Smolley, S. P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.304 · Cited by 5,437
Large Scale GAN Training for High Fidelity Natural Image Synthesis
Brock, A., Donahue, J., & Simonyan, K. (2018) · arXiv · doi:10.48550/arxiv.1809.11096 · Cited by 3,717
Spectral Normalization for Generative Adversarial Networks
Miyato, T., Kataoka, T., Koyama, M., & Yoshida, Y. (2018) · arXiv · doi:10.48550/arxiv.1802.05957 · Cited by 3,438
Self-Attention Generative Adversarial Networks
Zhang, H., Goodfellow, I., Metaxas, D., & Odena, A. (2018) · arXiv · doi:10.48550/arxiv.1805.08318 · Cited by 3,353
FusionGAN: A generative adversarial network for infrared and visible image fusion
Ma, J., Yu, W., Liang, P., Li, C., & Jiang, J. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.09.004 · Cited by 2,267
Self-citationImage Fusion With Guided Filtering
Li, S., Kang, X., & Hu, J. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2244222 · Cited by 1,781
A Structured Self-attentive Sentence Embedding
Lin, Z., Feng, M., Santos, C. N. D., Yu, M., Xiang, B., Zhou, B., & Bengio, Y. (2017) · arXiv · doi:10.48550/arxiv.1703.03130 · Cited by 1,743
Infrared and visible image fusion methods and applications: A survey
Ma, J., Ma, Y., & Li, C. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.02.004 · Cited by 1,732
Self-citationYang, Q., Yan, P., Zhang, Y., Yu, H., Shi, Y., Mou, X., Kalra, M. K., Zhang, Y., Sun, L., & Wang, G. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2827462 · Cited by 1,630
Ma, J., Xu, H., Jiang, J., Mei, X., & Zhang, X.-P. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2977573 · Cited by 1,343
Self-citationA Decomposable Attention Model for Natural Language Inference
Parikh, A., Täckström, O., Das, D., & Uszkoreit, J. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1244 · Cited by 1,296
Pixel-level image fusion: A survey of the state of the art
Li, S., Kang, X., Fang, L., Hu, J., & Yin, H. (2017) · Information Fusion · doi:10.1016/j.inffus.2016.05.004 · Cited by 1,276
Learning a Deep Single Image Contrast Enhancer from Multi-Exposure Images
Cai, J., Gu, S., & Zhang, L. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2794218 · Cited by 1,234
NIPS 2016 Tutorial: Generative Adversarial Networks
Goodfellow, I. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.00160 · Cited by 1,229
Perceptual Quality Assessment for Multi-Exposure Image Fusion
Ma, K., Zeng, K., & Wang, Z. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2442920 · Cited by 1,190
Pixel- and region-based image fusion with complex wavelets
Lewis, J. J., O’Callaghan, R. J., Nikolov, S. G., Bull, D. R., & Canagarajah, N. (2007) · Information Fusion · doi:10.1016/j.inffus.2005.09.006 · Cited by 834
DeepFuse: A Deep Unsupervised Approach for Exposure Fusion with Extreme Exposure Image Pairs
Prabhakar, K. R., Srikar, V. S., & Babu, R. V. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.505 · Cited by 726
Ma, J., Zhao, J., Jiang, J., Zhou, H., & Guo, X. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-018-1117-z · Cited by 601
Self-citationReconstruction of three-dimensional porous media using generative adversarial neural networks
Mosser, L., Dubrule, O., & Blunt, M. J. (2017) · Physical Review E · doi:10.1103/physreve.96.043309 · Cited by 569
Single Image Dehazing via Conditional Generative Adversarial Network
Li, R., Pan, J., Li, Z., & Tang, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00856 · Cited by 427
Robust Multi-Exposure Image Fusion: A Structural Patch Decomposition Approach
Ma, K., Li, H., Yong, H., Wang, Z., Meng, D., & Zhang, L. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2671921 · Cited by 355
Image Inpainting via Generative Multi-column Convolutional Neural Networks
Wang, Y., Tao, X., Qi, X., Shen, X., & Jia, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.08771 · Cited by 228
Multi-Exposure and Multi-Focus Image Fusion in Gradient Domain
Paul, S., Sevcenco, I. S., & Agathoklis, P. (2016) · Journal of Circuits, Systems and Computers · doi:10.1142/s0218126616501231 · Cited by 211
Exposure Fusion Using Boosting Laplacian Pyramid
Shen, J., Zhao, Y., Yan, S., & Li, X. (2014) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2013.2290435 · Cited by 175
Dense SIFT for ghost-free multi-exposure fusion
Liu, Y., & Wang, Z. (2015) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2015.06.021 · Cited by 166
Learning to Generate Time-Lapse Videos Using Multi-stage Dynamic Generative Adversarial Networks
Xiong, W., Luo, W., Ma, L., Liu, W., & Luo, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00251 · Cited by 162
Nonrigid Point Set Registration With Robust Transformation Learning Under Manifold Regularization
Ma, J., Wu, J. X., Zhao, J. Y., Jiang, J., Zhou, H., & Sheng, Q. Z. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2872528 · Cited by 150
Self-citationXu, H., Liang, P., Yu, W., Jiang, J., & Ma, J. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/549 · Cited by 112
Self-citationSelectively Detail-Enhanced Fusion of Differently Exposed Images With Moving Objects
Li, Z. G., Zheng, J., Zhu, Z., & Wu, S. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2349432 · Cited by 106
Is Generator Conditioning Causally Related to GAN Performance?Preprint
Odena, A., Buckman, J., Olsson, C., Brown, T. B., Olah, C., Raffel, C., & Goodfellow, I. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.08768 · Cited by 91
Multi-Scale Fusion of Two Large-Exposure-Ratio Images
Yang, Y., Cao, W., Wu, S., & Li, Z. G. (2018) · IEEE Signal Processing Letters · doi:10.1109/lsp.2018.2877893 · Cited by 82
Exposure fusion based on sparse representation using approximate K-SVD
Wang, J., Liu, H., & He, N. (2014) · Neurocomputing · doi:10.1016/j.neucom.2013.12.042 · Cited by 43
A multi-scale contrast-based image quality assessment model for multi-exposure image fusion
Lu, X., Cai, L., Zeng, H., Chen, J., Zhu, J., & Hou, J. (2017) · Signal Processing · doi:10.1016/j.sigpro.2017.12.013 · Cited by 38
Cited by
SwinFusion: Cross-domain Long-range Learning for General Image Fusion via Swin Transformer
Ma, J., Tang, L., Fan, F., Huang, J., Mei, X., & Ma, Y. (2022) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2022.105686 · Cited by 1,526
Self-citationImage fusion meets deep learning: A survey and perspective
Zhang, H., Xu, H., Tian, X., Jiang, J., & Ma, J. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.06.008 · Cited by 834
Self-citationSDNet: A Versatile Squeeze-and-Decomposition Network for Real-Time Image Fusion
Zhang, H., & Ma, J. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-021-01501-8 · Cited by 747
Self-citationMa, J., Zhang, H., Shao, Z., Liang, P., & Xu, H. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2020.3038013 · Cited by 618
Self-citationVisible and Infrared Image Fusion Using Deep Learning
Zhang, X., & Demiris, Y. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3261282 · Cited by 392
Self-citation
Metadata
- Authors
- Xu, H., Ma, J., & Zhang, X.-P.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2020
- Volume
- 29
- Pages
- 7203-7216
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W3035441328
- Cited by
- 282
- References
- 44
- FWCI
- 16.86
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.