The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
SESF-Fuse: an unsupervised deep model for multi-focus image fusion
Open accessAbstract
Muti-focus image fusion is the extraction of focused regions from different images to create one all-in-focus fused image. The key point is that only objects within the depth-of-field have a sharp appearance in the photograph, while other objects are likely to be blurred. We propose an unsupervised deep learning model for multi-focus image fusion. We train an encoder–decoder network in an unsupervised manner to acquire deep features of input images. Then, we utilize spatial frequency, a gradient-based method to measure sharp variation from these deep features, to reflect activity levels. We apply some consistency verification methods to adjust the decision map and draw out the fused result. Our method analyzes sharp appearances in deep features instead of original images, which can be seen as another success story of unsupervised learning in image processing. Experimental results demonstrate that the proposed method achieves state-of-the-art fusion performance compared to 16 fusion methods in objective and subjective assessments, especially in gradient-based fusion metrics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Squeeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667
Squeeze-and-Excitation Networks
Hu, J., Shen, L., Albanie, S., Sun, G., & Wu, E. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2913372 · Cited by 12,157
The Laplacian pyramid as a compact image code
Burt, P., & Adelson, E. (1983) · IEEE Transactions on Communications · doi:10.1109/tcom.1983.1095851 · Cited by 6,077
He, K., Sun, J., & Tang, X. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.213 · Cited by 5,546
DenseFuse: A Fusion Approach to Infrared and Visible Images
Li, H., & Wu, X.-J. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2887342 · Cited by 2,032
Objective image fusion performance measure
Xydeas, C. S., & Petrović, V. (2000) · Electronics Letters · doi:10.1049/el:20000267 · Cited by 1,996
Image Fusion With Guided Filtering
Li, S., Kang, X., & Hu, J. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2244222 · Cited by 1,781
Multisensor Image Fusion Using the Wavelet Transform
Li, H., Manjunath, B. S., & Mitra, S. K. (1995) · Graphical Models and Image Processing · doi:10.1006/gmip.1995.1022 · Cited by 1,574
IFCNN: A general image fusion framework based on convolutional neural network
Zhang, Y., Liu, Y., Sun, P., Yan, H., Zhao, X., & Zhang, L. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.07.011 · Cited by 1,550
Multi-sensor image fusion using the wavelet transform
Li, H., Manjunath, B. S., & Mitra, S. K. (2002) · Proceedings of 1st International Conference on Image Processing · doi:10.1109/icip.1994.413273 · Cited by 1,513
Multi-focus image fusion with a deep convolutional neural network
Liu, Y., Chen, X., Peng, H., & Wang, Z. (2017) · Information Fusion · doi:10.1016/j.inffus.2016.12.001 · Cited by 1,327
Pixel-level image fusion: A survey of the state of the art
Li, S., Kang, X., Fang, L., Hu, J., & Yin, H. (2017) · Information Fusion · doi:10.1016/j.inffus.2016.05.004 · Cited by 1,276
Concurrent Spatial and Channel ‘Squeeze & Excitation’ in Fully Convolutional Networks
Roy, A. G., Navab, N., & Wachinger, C. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-00928-1_48 · Cited by 869
Pixel- and region-based image fusion with complex wavelets
Lewis, J. J., O’Callaghan, R. J., Nikolov, S. G., Bull, D. R., & Canagarajah, N. (2007) · Information Fusion · doi:10.1016/j.inffus.2005.09.006 · Cited by 834
Remote sensing image fusion using the curvelet transform
Nencini, F., Garzelli, A., Baronti, S., & Alparone, L. (2007) · Information Fusion · doi:10.1016/j.inffus.2006.02.001 · Cited by 788
Multifocus Image Fusion and Restoration With Sparse Representation
Yang, B., & Li, S. (2010) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2009.2026612 · Cited by 749
DeepFuse: A Deep Unsupervised Approach for Exposure Fusion with Extreme Exposure Image Pairs
Prabhakar, K. R., Srikar, V. S., & Babu, R. V. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.505 · Cited by 726
Liu, Z., Blasch, E., Xue, Z., Zhao, J., Laganiere, R., & Wu, W. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.109 · Cited by 717
Image fusion by a ratio of low-pass pyramid
Toet, A. (1989) · Pattern Recognition Letters · doi:10.1016/0167-8655(89)90003-2 · Cited by 690
Multifocus image fusion using the nonsubsampled contourlet transform
Zhang, Q., & Guo, B.-L. (2009) · Signal Processing · doi:10.1016/j.sigpro.2009.01.012 · Cited by 683
Multi-focus image fusion using dictionary-based sparse representation
Nejati, M., Samavi, S., & Shirani, S. (2015) · Information Fusion · doi:10.1016/j.inffus.2014.10.004 · Cited by 544
A new automated quality assessment algorithm for image fusion
Chen, Y., & Blum, R. S. (2009) · Image and Vision Computing · doi:10.1016/j.imavis.2007.12.002 · Cited by 516
Multi-focus image fusion with dense SIFT
Liu, Y., Liu, S., & Wang, Z. (2015) · Information Fusion · doi:10.1016/j.inffus.2014.05.004 · Cited by 493
Visual Perception of Stochastic Resonance
Simonotto, E., Riani, M., Seife, C., Roberts, M., Twitty, J., & Moss, F. (1997) · Physical Review Letters · doi:10.1103/physrevlett.78.1186 · Cited by 482
Combination of images with diverse focuses using the spatial frequency
Li, S., Kwok, J. T., & Wang, Y. (2001) · Information Fusion · doi:10.1016/s1566-2535(01)00038-0 · Cited by 461
Image Fusion. Algorithms and Applications
(2009) · Sensor Review · doi:10.1108/sr.2009.08729cae.001 · Cited by 417
Multi-scale weighted gradient-based fusion for multi-focus images
Zhou, Z., Li, S., & Wang, B. (2014) · Information Fusion · doi:10.1016/j.inffus.2013.11.005 · Cited by 392
Image matting for fusion of multi-focus images in dynamic scenes
Li, S., Kang, X., Hu, J., & Yang, B. (2013) · Information Fusion · doi:10.1016/j.inffus.2011.07.001 · Cited by 313
Pixel convolutional neural network for multi-focus image fusion
Tang, H., Xiao, B., Li, W., & Wang, G. (2018) · Information Sciences · doi:10.1016/j.ins.2017.12.043 · Cited by 298
Multi-focus image fusion for visual sensor networks in DCT domain
Haghighat, M. B. A., Aghagolzadeh, A., & Seyedarabi, H. (2011) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2011.04.016 · Cited by 245
Smith, C. M., Jerkovic, A., Truong, T. T., Foote, S. J., McCarthy, J. S., & McMorran, B. J. (2017) · Scientific Reports · doi:10.1038/srep41975 · Cited by 219
Fusion of multi-focus images using differential evolution algorithm
Aslantas, V., & Kurban, R. (2010) · Expert Systems with Applications · doi:10.1016/j.eswa.2010.06.011 · Cited by 218
Multi-Exposure and Multi-Focus Image Fusion in Gradient Domain
Paul, S., Sevcenco, I. S., & Agathoklis, P. (2016) · Journal of Circuits, Systems and Computers · doi:10.1142/s0218126616501231 · Cited by 211
Unsupervised Deep Image Fusion With Structure Tensor Representations
Jung, H., Kim, Y., Jang, H., Ha, N., & Sohn, K. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2966075 · Cited by 186
Noise-induced effects in nonlinear relaxation of condensed matter systems
Spagnolo, B., Valenti, D., Guarcello, C., Carollo, A. C. M., Adorno, D. P., Spezia, S., Pizzolato, N., & Paola, B. D. (2015) · Chaos Solitons & Fractals · doi:10.1016/j.chaos.2015.07.023 · Cited by 133
Stochastic resonance in the perceptual interpretation of ambiguous figures: A neural network model
Riani, M., & Simonotto, E. (1994) · Physical Review Letters · doi:10.1103/physrevlett.72.3120 · Cited by 121
Enhancing effective depth-of-field by image fusion using mathematical morphology
De, I., Chanda, B., & Chattopadhyay, B. (2006) · Image and Vision Computing · doi:10.1016/j.imavis.2006.04.005 · Cited by 120
Stabilization of quantum metastable states by dissipation
Valenti, D., Magazzù, L., Caldara, P., & Spagnolo, B. (2015) · Physical Review B · doi:10.1103/physrevb.91.235412 · Cited by 114
Nonlinear Relaxation Phenomena in Metastable Condensed Matter Systems
Spagnolo, B., Guarcello, C., Magazzù, L., Carollo, A. C. M., Adorno, D. P., & Valenti, D. (2016) · Entropy · doi:10.3390/e19010020 · Cited by 103
A novel image fusion metric based on multi-scale analysis
Wang, P.-W., & Liu, B. (2008) · International Conference on Signal Processing · doi:10.1109/icosp.2008.4697288 · Cited by 95
An α-Matte Boundary Defocus Model-Based Cascaded Network for Multi-Focus Image Fusion
Ma, H., Liao, Q., Zhang, J., Liu, S., & Xue, J. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3018261 · Cited by 80
Stochastic resonance improves vision in the severely impaired
Itzcovich, E., Riani, M., & Sannita, W. G. (2017) · Scientific Reports · doi:10.1038/s41598-017-12906-2 · Cited by 53
Cited by
U2Fusion: A Unified Unsupervised Image Fusion Network
Xu, H., Ma, J., Jiang, J., Guo, X., & Ling, H. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3012548 · Cited by 2,127
Image fusion meets deep learning: A survey and perspective
Zhang, H., Xu, H., Tian, X., Jiang, J., & Ma, J. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.06.008 · Cited by 834
SDNet: A Versatile Squeeze-and-Decomposition Network for Real-Time Image Fusion
Zhang, H., & Ma, J. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-021-01501-8 · Cited by 747
Ma, J., Zhang, H., Shao, Z., Liang, P., & Xu, H. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2020.3038013 · Cited by 618
Zhang, H., Xu, H., Xiao, Y., Guo, X., & Ma, J. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6975 · Cited by 589
Metadata
- Authors
- Ma, B., Zhu, Y., Yin, X., Ban, X., Huang, H., & Mukeshimana, M.
- Venue
- Neural Computing and Applications
- Published
- 2020-09-21
- Volume
- 33
- Issue
- 11
- Pages
- 5793-5804
- ISSN
- 0941-0643 (ISSN-L)
- 1433-3058
- OpenAlex
- W3088623196
- Cited by
- 266
- References
- 46
- FWCI
- 17.24
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.