Robust patch-based hdr reconstruction of dynamic scenes
The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Abstract
High dynamic range (HDR) imaging from a set of sequential exposures is an easy way to capture high-quality images of static scenes, but suffers from artifacts for scenes with significant motion. In this paper, we propose a new approach to HDR reconstruction that draws information from all the exposures but is more robust to camera/scene motion than previous techniques. Our algorithm is based on a novel patch-based energy-minimization formulation that integrates alignment and reconstruction in a joint optimization through an equation we call the HDR image synthesis equation. This allows us to produce an HDR result that is aligned to one of the exposures yet contains information from all of them. We present results that show considerable improvement over previous approaches.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1981) · Cited by 11,963
Image registration methods: a survey
Zitová, B., & Flusser, J. (2003) · Image and Vision Computing · doi:10.1016/s0262-8856(03)00137-9 · Cited by 6,423
A survey of image registration techniques
Brown, L. G. (1992) · ACM Computing Surveys · doi:10.1145/146370.146374 · Cited by 4,057
PatchMatch: a randomized correspondence algorithm for structural image editing
Barnes, C., Shechtman, E., Finkelstein, A., & Goldman, D. B. (2009) · ACM Transactions on Graphics · doi:10.1145/1531326.1531330 · Cited by 2,880
Self-citationHigh Accuracy Optical Flow Estimation Based on a Theory for Warping
Brox, T., Bruhn, A., Papenberg, N., & Weickert, J. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24673-2_3 · Cited by 2,570
Recovering high dynamic range radiance maps from photographs
Debevec, P. E., & Malik, J. (2008) · ACM SIGGRAPH 2008 classes · doi:10.1145/1401132.1401174 · Cited by 2,399
A Database and Evaluation Methodology for Optical Flow
Baker, S., Scharstein, D., Lewis, J. P., Roth, S., Black, M. J., & Szeliski, R. (2011) · International Journal of Computer Vision · doi:10.1007/s11263-010-0390-2 · Cited by 2,205
Recovering high dynamic range radiance maps from photographs
Debevec, P. E., & Malik, J. (1997) · Proceedings of the 24th annual conference on Computer graphics and interactive techniques - SIGGRAPH '97 · doi:10.1145/258734.258884 · Cited by 1,775
High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting
Reinhard, E., Ward, G., Pattanaik, S., Debevec, P. E., Heidrich, W., & Myszkowski, K. (2010) · Cited by 1,359
Large Displacement Optical Flow: Descriptor Matching in Variational Motion Estimation
Brox, T., & Malik, J. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.143 · Cited by 1,295
Lucas/Kanade meets Horn/Schunck : combining local and global optic flow methods
Weickert, J., Bruhn, A., & Schnörr, C. (2003) · doi:10.22028/d291-26234 · Cited by 963
Beyond pixels: exploring new representations and applications for motion analysis
Freeman, W. T., Adelson, E. H., & Liu, C. (2009) · Cited by 805
Mitsunaga, T., & Nayar, S. K. (2003) · Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149) · doi:10.1109/cvpr.1999.786966 · Cited by 716
Space-Time Completion of Video
Wexler, Y., Shechtman, E., & Irani, M. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.60 · Cited by 682
Self-citationSummarizing visual data using bidirectional similarity
Simakov, D., Caspi, Y., Shechtman, E., & Irani, M. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587842 · Cited by 613
Self-citationHigh dynamic range imaging: spatially varying pixel exposures
Nayar, S. K., & Mitsunaga, T. (2002) · Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662) · doi:10.1109/cvpr.2000.855857 · Cited by 542
The Generalized PatchMatch Correspondence Algorithm
Barnes, C., Shechtman, E., Goldman, D. B., & Finkelstein, A. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15558-1_3 · Cited by 530
Self-citationMotion Detail Preserving Optical Flow Estimation
Xu, L., Jia, J., & Matsushita, Y. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.236 · Cited by 493
Kang, S. B., Uyttendaele, M., Winder, S., & Szeliski, R. (2003) · ACM SIGGRAPH 2003 Papers · doi:10.1145/1201775.882270 · Cited by 395
Kang, S. B., Uyttendaele, M., Winder, S., & Szeliski, R. (2003) · ACM Transactions on Graphics · doi:10.1145/882262.882270 · Cited by 387
Non-rigid dense correspondence with applications for image enhancement
HaCohen, Y., Shechtman, E., Goldman, D. B., & Lischinski, D. (2011) · ACM SIGGRAPH 2011 papers · doi:10.1145/1964921.1964965 · Cited by 287
Self-citationNon-rigid dense correspondence with applications for image enhancement
HaCohen, Y., Shechtman, E., Goldman, D. B., & Lischinski, D. (2011) · ACM Transactions on Graphics · doi:10.1145/2010324.1964965 · Cited by 247
Self-citationGhost Removal in High Dynamic Range Images
Khan, E. A., Akyüz, A. O., & Reinhard, E. (2006) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2006.312892 · Cited by 222
A versatile HDR video production system
Tocci, M. D., Kiser, C., Tocci, N., & Sen, P. (2011) · ACM Transactions on Graphics · doi:10.1145/2010324.1964936 · Cited by 202
Self-citationFreehand HDR Imaging of Moving Scenes with Simultaneous Resolution Enhancement
Zimmer, H., Bruhn, A., & Weickert, J. (2011) · Computer graphics forum (Print) · doi:10.1111/j.1467-8659.2011.01870.x · Cited by 179
A versatile HDR video production system
Tocci, M. D., Kiser, C., Tocci, N., & Sen, P. (2011) · ACM SIGGRAPH 2011 papers · doi:10.1145/1964921.1964936 · Cited by 174
Self-citationSeamless Image Stitching of Scenes with Large Motions and Exposure Differences
Eden, A., Uyttendaele, M., & Szeliski, R. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.268 · Cited by 161
Extending dynamic range of monochrome and color images through fusion
Bogoni, L. (2002) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2000.903475 · Cited by 132
Ghost-Free High Dynamic Range Imaging
Heo, Y. S., Lee, K. M., Lee, S. U., Moon, Y.-S., & Cha, J.-H. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-19282-1_39 · Cited by 110
Image Registration for Multi-exposure High Dynamic Range Image Acquisition
Tomaszewska, A., & Mantiuk, R. (2007) · Digital Library (University of West Bohemia) · Cited by 107
Shechtman, E., Rav-Acha, A., Irani, M., & Seitz, S. M. (2010) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2010.5540159 · Cited by 76
Self-citationReconstruction of high contrast images for dynamic scenes
Raman, S., & Chaudhuri, S. (2011) · The Visual Computer · doi:10.1007/s00371-011-0653-0 · Cited by 68
High dynamic range video with ghost removal
Mangiat, S., & Gibson, J. D. (2010) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.862492 · Cited by 54
High dynamic range imaging for stereoscopic scene representation
Lin, H., & Chang, W.-Z. (2009) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2009.5413665 · Cited by 41
Cited by
LIME: Low-Light Image Enhancement via Illumination Map Estimation
Guo, X., Li, Y., & Ling, H. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2639450 · Cited by 2,998
Learning a Deep Single Image Contrast Enhancer from Multi-Exposure Images
Cai, J., Gu, S., & Zhang, L. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2794218 · Cited by 1,234
Deep high dynamic range imaging of dynamic scenes
Kalantari, N. K., & Ramamoorthi, R. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073609 · Cited by 596
Self-citationRobust Multi-Exposure Image Fusion: A Structural Patch Decomposition Approach
Ma, K., Li, H., Yong, H., Wang, Z., Meng, D., & Zhang, L. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2671921 · Cited by 355
Attention-Guided Network for Ghost-Free High Dynamic Range Imaging
Yan, Q., Gong, D., Shi, Q., van den Hengel, A., Shen, C., Reid, I., & Zhang, Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00185 · Cited by 313
Metadata
- Authors
- Sen, P., Kalantari, N. K., Yaesoubi, M., Darabi, S., Goldman, D. B., & Shechtman, E.
- Venue
- ACM Transactions on Graphics
- Published
- 2012-11
- Volume
- 31
- Issue
- 6
- Pages
- 1-11
- ISSN
- 0730-0301 (ISSN-L)
- 1557-7368
- OpenAlex
- W1995813543
- Cited by
- 433
- References
- 34
- FWCI
- 17.38
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.