The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Robust Multi-Exposure Image Fusion: A Structural Patch Decomposition Approach
Abstract
We propose a simple yet effective structural patch decomposition approach for multi-exposure image fusion (MEF) that is robust to ghosting effect. We decompose an image patch into three conceptually independent components: signal strength, signal structure, and mean intensity. Upon fusing these three components separately, we reconstruct a desired patch and place it back into the fused image. This novel patch decomposition approach benefits MEF in many aspects. First, as opposed to most pixel-wise MEF methods, the proposed algorithm does not require post-processing steps to improve visual quality or to reduce spatial artifacts. Second, it handles RGB color channels jointly, and thus produces fused images with more vivid color appearance. Third and most importantly, the direction of the signal structure component in the patch vector space provides ideal information for ghost removal. It allows us to reliably and efficiently reject inconsistent object motions with respect to a chosen reference image without performing computationally expensive motion estimation. We compare the proposed algorithm with 12 MEF methods on 21 static scenes and 12 deghosting schemes on 19 dynamic scenes (with camera and object motion). Extensive experimental results demonstrate that the proposed algorithm not only outperforms previous MEF algorithms on static scenes but also consistently produces high quality fused images with little ghosting artifacts for dynamic scenes. Moreover, it maintains a lower computational cost compared with the state-of-the-art deghosting schemes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Self-citationDistinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Bilateral Filtering for Gray and Color Images
Tomasi, C., & Manduchi, R. (2002) · Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271) · doi:10.1109/iccv.1998.710815 · Cited by 8,177 · cited 1×
“H. Yong is with the Department of Computing, The Hong Kong Polytechnic University, Hong Kong, and also with the Institute for Information and System Sciences and Ministry of Education Key Laboratory of Intelligent Networks and Network Security, Xi’an Jiaotong University, Xi’an 710049, China…”
BackgroundImage registration methods: a survey
Zitová, B., & Flusser, J. (2003) · Image and Vision Computing · doi:10.1016/s0262-8856(03)00137-9 · Cited by 6,423
The Laplacian pyramid as a compact image code
Burt, P., & Adelson, E. (1983) · IEEE Transactions on Communications · doi:10.1109/tcom.1983.1095851 · Cited by 6,077
He, K., Sun, J., & Tang, X. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.213 · Cited by 5,546
A survey of image registration techniques
Brown, L. G. (1992) · ACM Computing Surveys · doi:10.1145/146370.146374 · Cited by 4,057
Region Filling and Object Removal by Exemplar-Based Image Inpainting
Criminisi, A., Perez, P., & Toyama, K. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2004.833105 · Cited by 3,258 · cited 1×
“For Hu13 [20], motion estimation using generalized PatchMatch contributes to the main computation compared with updating the latent image and refining the IMF, which has a complexity of O(Ii N2(M log M)K ).”
MethodRecovering high dynamic range radiance maps from photographs
Debevec, P. E., & Malik, J. (2008) · ACM SIGGRAPH 2008 classes · doi:10.1145/1401132.1401174 · Cited by 2,399
Image Fusion With Guided Filtering
Li, S., Kang, X., & Hu, J. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2244222 · Cited by 1,781
Recovering high dynamic range radiance maps from photographs
Debevec, P. E., & Malik, J. (1997) · Proceedings of the 24th annual conference on Computer graphics and interactive techniques - SIGGRAPH '97 · doi:10.1145/258734.258884 · Cited by 1,775
High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting
Reinhard, E., Ward, G., Pattanaik, S., Debevec, P. E., Heidrich, W., & Myszkowski, K. (2010) · Cited by 1,359
Perceptual Quality Assessment for Multi-Exposure Image Fusion
Ma, K., Zeng, K., & Wang, Z. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2442920 · Cited by 1,190
Self-citationShape google: Geometric words and expressions for invariant shape retrieval
Bronstein, A. M., Bronstein, M. M., Guibas, L. J., & Ovsjanikov, M. (2011) · ACM Transactions on Graphics · doi:10.1145/1899404.1899405 · Cited by 810
Exposure Fusion: A Simple and Practical Alternative to High Dynamic Range Photography
Mertens, T., Kautz, J., & Van Reeth, F. (2009) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2008.01171.x · Cited by 692
Domain transform for edge-aware image and video processing
Gastal, E. S. L., & Oliveira, M. M. (2011) · ACM Transactions on Graphics · doi:10.1145/2010324.1964964 · Cited by 620
Summarizing visual data using bidirectional similarity
Simakov, D., Caspi, Y., Shechtman, E., & Irani, M. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587842 · Cited by 613
Domain transform for edge-aware image and video processing
Gastal, E. S. L., & Oliveira, M. M. (2011) · ACM SIGGRAPH 2011 papers · doi:10.1145/1964921.1964964 · Cited by 591
Weighted Guided Image Filtering
Li, Z., Zheng, J., Zhu, Z., Yao, W., & Wu, S. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2371234 · Cited by 564
The Generalized PatchMatch Correspondence Algorithm
Barnes, C., Shechtman, E., Goldman, D. B., & Finkelstein, A. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15558-1_3 · Cited by 530
A Patch-Structure Representation Method for Quality Assessment of Contrast Changed Images
Wang, S., Ma, K., Yeganeh, H., Wang, Z., & Lin, W. (2015) · IEEE Signal Processing Letters · doi:10.1109/lsp.2015.2487369 · Cited by 444
Self-citationRobust patch-based hdr reconstruction of dynamic scenes
Sen, P., Kalantari, N. K., Yaesoubi, M., Darabi, S., Goldman, D. B., & Shechtman, E. (2012) · ACM Transactions on Graphics · doi:10.1145/2366145.2366222 · Cited by 433
Kang, S. B., Uyttendaele, M., Winder, S., & Szeliski, R. (2003) · ACM SIGGRAPH 2003 Papers · doi:10.1145/1201775.882270 · Cited by 395
Kang, S. B., Uyttendaele, M., Winder, S., & Szeliski, R. (2003) · ACM Transactions on Graphics · doi:10.1145/882262.882270 · Cited by 387
The Pyramid as a Structure for Efficient Computation
Burt, P. J. (1984) · Springer Series in Information Sciences · doi:10.1007/978-3-642-51590-3_2 · Cited by 372
Reinhard, E., Ward, G., Pattanaik, S. N., & Debevec, P. E. (2005) · Cited by 372
Interactive local adjustment of tonal values
Lischinski, D., Farbman, Z., Uyttendaele, M., & Szeliski, R. (2006) · ACM Transactions on Graphics · doi:10.1145/1141911.1141936 · Cited by 366
HDR Deghosting: How to Deal with Saturation?
Hu, J., Gallo, O., Pulli, K., & Sun, X. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.154 · Cited by 296
Non-rigid dense correspondence with applications for image enhancement
HaCohen, Y., Shechtman, E., Goldman, D. B., & Lischinski, D. (2011) · ACM SIGGRAPH 2011 papers · doi:10.1145/1964921.1964965 · Cited by 287
Fast multi-exposure image fusion with median filter and recursive filter
Li, S., & Kang, X. (2012) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2012.6227469 · Cited by 247
Non-rigid dense correspondence with applications for image enhancement
HaCohen, Y., Shechtman, E., Goldman, D. B., & Lischinski, D. (2011) · ACM Transactions on Graphics · doi:10.1145/2010324.1964965 · Cited by 247
Generalized Random Walks for Fusion of Multi-Exposure Images
Shen, R., Cheng, I., Shi, J., & Basu, A. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2150235 · Cited by 235
Ghost Removal in High Dynamic Range Images
Khan, E. A., Akyüz, A. O., & Reinhard, E. (2006) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2006.312892 · Cited by 222
Robust High Dynamic Range Imaging by Rank Minimization
Oh, T.-H., Lee, J.-Y., Tai, Y.-W., & Kweon, I. S. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2361338 · Cited by 206
Freehand HDR Imaging of Moving Scenes with Simultaneous Resolution Enhancement
Zimmer, H., Bruhn, A., & Weickert, J. (2011) · Computer graphics forum (Print) · doi:10.1111/j.1467-8659.2011.01870.x · Cited by 179
Exposure Fusion Using Boosting Laplacian Pyramid
Shen, J., Zhao, Y., Yan, S., & Li, X. (2014) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2013.2290435 · Cited by 175
Seamless Image Stitching of Scenes with Large Motions and Exposure Differences
Eden, A., Uyttendaele, M., & Szeliski, R. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.268 · Cited by 161
Bilateral Filter Based Compositing for Variable Exposure Photography
Raman, S., & Chaudhuri, S. (2009) · doi:10.2312/egs.20091034 · Cited by 151
Detail-Enhanced Exposure Fusion
Li, Z. G., Zheng, J. H., & Rahardja, S. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2207396 · Cited by 149
High Dynamic Range Image Compression by Optimizing Tone Mapped Image Quality Index
Ma, K., Yeganeh, H., Zeng, K., & Wang, Z. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2436340 · Cited by 140
Self-citationMulti-exposure image fusion: A patch-wise approach
Ma, K., & Wang, Z. (2015) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2015.7351094 · Cited by 125
Self-citationGhost-Free High Dynamic Range Imaging via Rank Minimization
Lee, C., Li, Y., & Monga, V. (2014) · IEEE Signal Processing Letters · doi:10.1109/lsp.2014.2323404 · Cited by 123
Selectively Detail-Enhanced Fusion of Differently Exposed Images With Moving Objects
Li, Z. G., Zheng, J., Zhu, Z., & Wu, S. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2349432 · Cited by 106
Objective Quality Assessment for Color-to-Gray Image Conversion
Ma, K., Zhao, T., Zeng, K., & Wang, Z. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2460015 · Cited by 84
Self-citationHybrid Patching for a Sequence of Differently Exposed Images With Moving Objects
Zheng, J., Li, Z. G., Zhu, Z., et al. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2283401 · Cited by 83
ExpoBlend: Information preserving exposure blending based on normalized log-domain entropy
Bruce, N. D. B. (2013) · Computers & Graphics · doi:10.1016/j.cag.2013.10.001 · Cited by 61
Perceptual evaluation of multi-exposure image fusion algorithms
Zeng, K., Ma, K., Hassen, R., et al. (2014) · International Workshop on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex.2014.6982278 · Cited by 43
Self-citationPerceptual Depth Quality in Distorted Stereoscopic Images
Wang, J., Wang, S., Ma, K., & Wang, Z. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2642791 · Cited by 34
Self-citation
Cited by
SwinFusion: Cross-domain Long-range Learning for General Image Fusion via Swin Transformer
Ma, J., Tang, L., Fan, F., Huang, J., Mei, X., & Ma, Y. (2022) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2022.105686 · Cited by 1,526
Learning a Deep Single Image Contrast Enhancer from Multi-Exposure Images
Cai, J., Gu, S., & Zhang, L. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2794218 · Cited by 1,234
Self-citationSDNet: A Versatile Squeeze-and-Decomposition Network for Real-Time Image Fusion
Zhang, H., & Ma, J. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-021-01501-8 · Cited by 747
Zhang, H., Xu, H., Xiao, Y., Guo, X., & Ma, J. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6975 · Cited by 589
Low-Light Image Enhancement With Semi-Decoupled Decomposition
Hao, S., Han, X., Guo, Y., Xu, X., & Wang, M. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.2969790 · Cited by 381
Metadata
- Authors
- Ma, K., Li, H., Yong, H., Wang, Z., Meng, D., & Zhang, L.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2017-05
- Volume
- 26
- Issue
- 5
- Pages
- 2519-2532
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W2590560192
- Cited by
- 355
- References
- 48
- FWCI
- 25.59
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.