The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Deep high dynamic range imaging of dynamic scenes
Open accessAbstract
Producing a high dynamic range (HDR) image from a set of images with different exposures is a challenging process for dynamic scenes. A category of existing techniques first register the input images to a reference image and then merge the aligned images into an HDR image. However, the artifacts of the registration usually appear as ghosting and tearing in the final HDR images. In this paper, we propose a learning-based approach to address this problem for dynamic scenes. We use a convolutional neural network (CNN) as our learning model and present and compare three different system architectures to model the HDR merge process. Furthermore, we create a large dataset of input LDR images and their corresponding ground truth HDR images to train our system. We demonstrate the performance of our system by producing high-quality HDR images from a set of three LDR images. Experimental results show that our method consistently produces better results than several state-of-the-art approaches on challenging scenes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
(2010) · Cited by 14,134
(1981) · Cited by 11,963
Flownet: Learning optical flow with convolutional networks
Dosovitskiy, A., Fischer, P., Ilg, E., Hausser, P., Hazirbas, C., Golkov, V., Smagt, P. V. D., Cremers, D., & Brox, T. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.316 · Cited by 4,313
FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networks
Ilg, E., Mayer, N., Saikia, T., Keuper, M., Dosovitskiy, A., & Brox, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.179 · Cited by 3,152
MatConvNet: Convolutional Neural Networks for MATLAB
Vedaldi, A., & Lenc, K. (2015) · Proceedings of the 23rd ACM international conference on Multimedia · doi:10.1145/2733373.2807412 · Cited by 2,444
Recovering high dynamic range radiance maps from photographs
Debevec, P. E., & Malik, J. (2008) · ACM SIGGRAPH 2008 classes · doi:10.1145/1401132.1401174 · Cited by 2,399
Iizuka, S., Simo-Serra, E., & Ishikawa, H. (2016) · ACM Transactions on Graphics · doi:10.1145/2897824.2925974 · Cited by 814
Beyond pixels: exploring new representations and applications for motion analysis
Freeman, W. T., Adelson, E. H., & Liu, C. (2009) · Cited by 805
Learning-based view synthesis for light field cameras
Kalantari, N. K., Wang, T.-C., & Ramamoorthi, R. (2016) · ACM Transactions on Graphics · doi:10.1145/2980179.2980251 · Cited by 726
Self-citationMantiuk, R., Kim, K. J., Rempel, A. G., & Heidrich, W. (2011) · ACM Transactions on Graphics · doi:10.1145/2010324.1964935 · Cited by 685
Deep Stereo: Learning to Predict New Views from the World's Imagery
Flynn, J., Neulander, I., Philbin, J., & Snavely, N. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.595 · Cited by 574
FlowNet: Learning Optical Flow with Convolutional Networks
Fischer, P., Dosovitskiy, A., Ilg, E., Haeusser, P., Hazırbaş, C., Golkov, V., van der Smagt, P., Cremers, D., & Brox, T. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.06852 · Cited by 562
Cheng, Z., Yang, Q., & Sheng, B. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.55 · Cited by 557
Burst photography for high dynamic range and low-light imaging on mobile cameras
Hasinoff, S. W., Sharlet, D., Geiss, R., Adams, A., Barron, J. T., Kainz, F., Chen, J., & Levoy, M. (2016) · ACM Transactions on Graphics · doi:10.1145/2980179.2980254 · Cited by 483
Mantiuk, R., Kim, K. J., Rempel, A. G., & Heidrich, W. (2011) · ACM SIGGRAPH 2011 papers · doi:10.1145/1964921.1964935 · Cited by 467
Robust patch-based hdr reconstruction of dynamic scenes
Sen, P., Kalantari, N. K., Yaesoubi, M., Darabi, S., Goldman, D. B., & Shechtman, E. (2012) · ACM Transactions on Graphics · doi:10.1145/2366145.2366222 · Cited by 433
Self-citationKang, S. B., Uyttendaele, M., Winder, S., & Szeliski, R. (2003) · ACM SIGGRAPH 2003 Papers · doi:10.1145/1201775.882270 · Cited by 395
Kang, S. B., Uyttendaele, M., Winder, S., & Szeliski, R. (2003) · ACM Transactions on Graphics · doi:10.1145/882262.882270 · Cited by 387
FlexISP: a flexible camera image processing framework
Heide, F., Steinberger, M., Tsai, Y.-T., Rouf, M., Pająk, D., Reddy, D., Gallo, O., Liu, J., Heidrich, W., Egiazarian, K., et al. (2014) · ACM Transactions on Graphics · doi:10.1145/2661229.2661260 · Cited by 298
HDR Deghosting: How to Deal with Saturation?
Hu, J., Gallo, O., Pulli, K., & Sun, X. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.154 · Cited by 296
Non-rigid dense correspondence with applications for image enhancement
HaCohen, Y., Shechtman, E., Goldman, D. B., & Lischinski, D. (2011) · ACM SIGGRAPH 2011 papers · doi:10.1145/1964921.1964965 · Cited by 287
Ghost Removal in High Dynamic Range Images
Khan, E. A., Akyüz, A. O., & Reinhard, E. (2006) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2006.312892 · Cited by 222
Robust High Dynamic Range Imaging by Rank Minimization
Oh, T.-H., Lee, J.-Y., Tai, Y.-W., & Kweon, I. S. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2361338 · Cited by 206
Freehand HDR Imaging of Moving Scenes with Simultaneous Resolution Enhancement
Zimmer, H., Bruhn, A., & Weickert, J. (2011) · Computer graphics forum (Print) · doi:10.1111/j.1467-8659.2011.01870.x · Cited by 179
Optimal HDR reconstruction with linear digital cameras
Granados, M., Ajdin, B., Wand, M., Theobalt, C., Seidel, H.-P., & Lensch, H. P. A. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540208 · Cited by 176
Large Displacement Optical Flow from Nearest Neighbor Fields
Chen, Z., Jin, H., Lin, Z., Cohen, S. D., & Wu, Y. N. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.316 · Cited by 176
A versatile HDR video production system
Tocci, M. D., Kiser, C., Tocci, N., & Sen, P. (2011) · ACM SIGGRAPH 2011 papers · doi:10.1145/1964921.1964936 · Cited by 174
Extending dynamic range of monochrome and color images through fusion
Bogoni, L. (2002) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2000.903475 · Cited by 132
Ghost-Free High Dynamic Range Imaging via Rank Minimization
Lee, C., Li, Y., & Monga, V. (2014) · IEEE Signal Processing Letters · doi:10.1109/lsp.2014.2323404 · Cited by 123
The State of the Art in HDR Deghosting: A Survey and Evaluation
Tursun, O. T., Akyüz, A. O., Erdem, A., & Erdem, E. (2015) · Computer Graphics Forum · doi:10.1111/cgf.12593 · Cited by 119
Ghost-Free High Dynamic Range Imaging
Heo, Y. S., Lee, K. M., Lee, S. U., Moon, Y.-S., & Cha, J.-H. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-19282-1_39 · Cited by 110
An Objective Deghosting Quality Metric for HDR Images
Tursun, O. T., Akyüz, A. O., Erdem, A., & Erdem, E. (2016) · Computer Graphics Forum · doi:10.1111/cgf.12818 · Cited by 108
Image Registration for Multi-exposure High Dynamic Range Image Acquisition
Tomaszewska, A., & Mantiuk, R. (2007) · Digital Library (University of West Bohemia) · Cited by 107
Selectively Detail-Enhanced Fusion of Differently Exposed Images With Moving Objects
Li, Z. G., Zheng, J., Zhu, Z., & Wu, S. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2349432 · Cited by 106
Convolutional Sparse Coding for High Dynamic Range Imaging
Serrano, A., Heide, F., Gutiérrez, D., Wetzstein, G., & Masiá, B. (2016) · Computer Graphics Forum · doi:10.1111/cgf.12819 · Cited by 100
Unbounded High Dynamic Range Photography Using a Modulo Camera
Zhao, H., Shi, B., Fernandez-Cull, C., Yeung, S.-K., & Raskar, R. (2015) · IEEE International Conference on Computational Photography (ICCP) · doi:10.1109/iccphot.2015.7168378 · Cited by 88
Hybrid Patching for a Sequence of Differently Exposed Images With Moving Objects
Zheng, J., Li, Z. G., Zhu, Z., et al. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2283401 · Cited by 83
Funt, B., & Shi, L. (2011) · Summit (Simon Fraser University) · doi:10.5446/31094 · Cited by 81
Automatic noise modeling for ghost-free HDR reconstruction
Granados, M., Kim, K. I., Tompkin, J., & Theobalt, C. (2013) · ACM Transactions on Graphics · doi:10.1145/2508363.2508410 · Cited by 76
Optical Splitting Trees for High-Precision Monocular Imaging
McGuire, M., Matusik, W., Pfister, H., Chen, B. P., Hughes, J. F., & Nayar, S. K. (2007) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2007.45 · Cited by 73
Reconstruction of high contrast images for dynamic scenes
Raman, S., & Chaudhuri, S. (2011) · The Visual Computer · doi:10.1007/s00371-011-0653-0 · Cited by 68
Locally non-rigid registration for mobile HDR photography
Gallo, O., Troccoli, A. J., Hu, J. S., et al. (2015) · IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2015.7301366 · Cited by 46
Adaptive dualISO HDR reconstruction
Hajisharif, S., Kronander, J., & Unger, J. (2015) · EURASIP Journal on Image and Video Processing · doi:10.1186/s13640-015-0095-0 · Cited by 46
Robust Radiometric Calibration for Dynamic Scenes in the Wild
Badki, A., Kalantari, N. K., & Sen, P. (2015) · IEEE International Conference on Computational Photography (ICCP) · doi:10.1109/iccphot.2015.7168373 · Cited by 13
Self-citation
Cited by
EnlightenGAN: Deep Light Enhancement Without Paired Supervision
Jiang, Y., Gong, X., Liu, D., Cheng, Y., Fang, C., Shen, X., Yang, J., Zhou, P., & Wang, Z. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3051462 · Cited by 2,715
Learning a Deep Single Image Contrast Enhancer from Multi-Exposure Images
Cai, J., Gu, S., & Zhang, L. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2794218 · Cited by 1,234
Deep learning for pixel-level image fusion: Recent advances and future prospects
Liu, Y., Chen, X., Wang, Z., Wang, Z. J., Ward, R. K., & Wang, X. (2018) · Information Fusion · doi:10.1016/j.inffus.2017.10.007 · Cited by 736
Deep blending for free-viewpoint image-based rendering
Hedman, P., Philip, J., Price, T., Frahm, J.-M., Drettakis, G., & Brostow, G. (2018) · ACM Transactions on Graphics · doi:10.1145/3272127.3275084 · Cited by 617
HDR image reconstruction from a single exposure using deep CNNs
Eilertsen, G., Kronander, J., Denes, G., Mantiuk, R. K., & Unger, J. (2017) · ACM Transactions on Graphics · doi:10.1145/3130800.3130816 · Cited by 598
Metadata
- Authors
- Kalantari, N. K., & Ramamoorthi, R.
- Venue
- ACM Transactions on Graphics
- Published
- 2017-07-20
- Volume
- 36
- Issue
- 4
- Pages
- 1-12
- ISSN
- 0730-0301 (ISSN-L)
- 1557-7368
- OpenAlex
- W2736611505
- Cited by
- 596
- References
- 45
- FWCI
- 12.02
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.