The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
HDR image reconstruction from a single exposure using deep CNNs
Open accessAbstract
Camera sensors can only capture a limited range of luminance simultaneously, and in order to create high dynamic range (HDR) images a set of different exposures are typically combined. In this paper we address the problem of predicting information that have been lost in saturated image areas, in order to enable HDR reconstruction from a single exposure. We show that this problem is well-suited for deep learning algorithms, and propose a deep convolutional neural network (CNN) that is specifically designed taking into account the challenges in predicting HDR values. To train the CNN we gather a large dataset of HDR images, which we augment by simulating sensor saturation for a range of cameras. To further boost robustness, we pre-train the CNN on a simulated HDR dataset created from a subset of the MIT Places database. We demonstrate that our approach can reconstruct high-resolution visually convincing HDR results in a wide range of situations, and that it generalizes well to reconstruction of images captured with arbitrary and low-end cameras that use unknown camera response functions and post-processing. Furthermore, we compare to existing methods for HDR expansion, and show high quality results also for image based lighting. Finally, we evaluate the results in a subjective experiment performed on an HDR display. This shows that the reconstructed HDR images are visually convincing, with large improvements as compared to existing methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
Labaca-Castro, R. (2023) · Machine Learning under Malware Attack · doi:10.1007/978-3-658-40442-0_9 · Cited by 19,272
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 14,214
(2010) · Cited by 14,134
Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network
Ledig, C., Theis, L., Huszar, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A., Tejani, A., Totz, J., Wang, Z., et al. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.19 · Cited by 12,696
Unsupervised representation learning with deep convolutional generative adversarial networks
Radford, A., Metz, L., & Chintala, S. (2015) · arXiv · doi:10.48550/arxiv.1511.06434 · Cited by 12,235
Extracting and composing robust features with denoising autoencoders
Vincent, P., Larochelle, H., Bengio, Y., & Manzagol, P.-A. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390294 · Cited by 7,436
Context Encoders: Feature Learning by Inpainting
Pathak, D., Krahenbuhl, P., Donahue, J., Darrell, T., & Efros, A. A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.278 · Cited by 5,691
(2014) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 2,534
Fully Convolutional Networks for Semantic Segmentation
Long, J., Shelhamer, E., & Darrell, T. J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1411.4038 · Cited by 2,489
Recovering high dynamic range radiance maps from photographs
Debevec, P. E., & Malik, J. (2008) · ACM SIGGRAPH 2008 classes · doi:10.1145/1401132.1401174 · Cited by 2,399
Recovering high dynamic range radiance maps from photographs
Debevec, P. E., & Malik, J. (1997) · Proceedings of the 24th annual conference on Computer graphics and interactive techniques - SIGGRAPH '97 · doi:10.1145/258734.258884 · Cited by 1,775
Deconvolution and Checkerboard Artifacts
Odena, A., Dumoulin, V., & Olah, C. (2016) · Distill · doi:10.23915/distill.00003 · Cited by 1,640
High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting
Reinhard, E., Ward, G., Pattanaik, S., Debevec, P. E., Heidrich, W., & Myszkowski, K. (2010) · Cited by 1,359
Elements of psychophysics, 1860.
Fechner, G. T. (1948) · Readings in the history of psychology. · doi:10.1037/11304-026 · Cited by 1,307
Compression Artifacts Reduction by a Deep Convolutional Network
Dong, C., Deng, Y., Loy, C. C., & Tang, X. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.73 · Cited by 883
High-Resolution Image Inpainting Using Multi-scale Neural Patch Synthesis
Yang, C., Lu, X., Lin, Z., Shechtman, E., Wang, O., & Li, H. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.434 · Cited by 877
Iizuka, S., Simo-Serra, E., & Ishikawa, H. (2016) · ACM Transactions on Graphics · doi:10.1145/2897824.2925974 · Cited by 814
Deep high dynamic range imaging of dynamic scenes
Kalantari, N. K., & Ramamoorthi, R. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073609 · Cited by 596
Full-Resolution Residual Networks for Semantic Segmentation in Street Scenes
Pohlen, T., Hermans, A., Mathias, M., & Leibe, B. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.353 · Cited by 584
High dynamic range display systems
Seetzen, H., Heidrich, W., Stuerzlinger, W., Ward, G., Whitehead, L., Trentacoste, M., Ghosh, A., & Vorozcovs, A. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015797 · Cited by 562
High dynamic range imaging: spatially varying pixel exposures
Nayar, S. K., & Mitsunaga, T. (2002) · Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662) · doi:10.1109/cvpr.2000.855857 · Cited by 542
Reinhard, E., Ward, G., Pattanaik, S. N., & Debevec, P. E. (2005) · Cited by 372
Endo, Y., Kanamori, Y., & Mitani, J. (2017) · ACM Transactions on Graphics · doi:10.1145/3130800.3130834 · Cited by 331
A versatile HDR video production system
Tocci, M. D., Kiser, C., Tocci, N., & Sen, P. (2011) · ACM Transactions on Graphics · doi:10.1145/2010324.1964936 · Cited by 202
Ldr2Hdr: on-the-fly reverse tone mapping of legacy video and photographs
Rempel, A. G., Trentacoste, M., Seetzen, H., Young, H. D., Heidrich, W., Whitehead, L., & Ward, G. (2007) · ACM Transactions on Graphics · doi:10.1145/1276377.1276426 · Cited by 182
A versatile HDR video production system
Tocci, M. D., Kiser, C., Tocci, N., & Sen, P. (2011) · ACM SIGGRAPH 2011 papers · doi:10.1145/1964921.1964936 · Cited by 174
Ldr2Hdr: on-the-fly reverse tone mapping of legacy video and photographs
Rempel, A. G., Trentacoste, M., Seetzen, H., Young, H. D., Heidrich, W., Whitehead, L. A., & Ward, G. (2007) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1275808.1276426 · Cited by 155
Compression Artifacts Removal Using Convolutional Neural NetworksPreprint
Svoboda, P., Hradiš, M., Barina, D., & Zemčík, P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.00366 · Cited by 150
High-Quality Reverse Tone Mapping for a Wide Range of Exposures
Kovaleski, R. P., & Oliveira, M. M. (2014) · SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI) · doi:10.1109/sibgrapi.2014.29 · Cited by 146
Evaluation of reverse tone mapping through varying exposure conditions
Masiá, B., Agustin, S., Fleming, R. W., et al. (2009) · ACM Transactions on Graphics · doi:10.1145/1618452.1618506 · Cited by 115
Learning High Dynamic Range from Outdoor Panoramas
Zhang, J., & Lalonde, J. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.484 · Cited by 114
High dynamic range image hallucination
Wang, L., Wei, L., Zhou, K., Guo, B., & Shum, H. (2007) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1278780.1278867 · Cited by 101
Convolutional Sparse Coding for High Dynamic Range Imaging
Serrano, A., Heide, F., Gutiérrez, D., Wetzstein, G., & Masiá, B. (2016) · Computer Graphics Forum · doi:10.1111/cgf.12819 · Cited by 100
Sutton, C. A., & Jordan, M. I. (2010) · Cited by 100
Decontouring: prevention and removal of false contour artifacts
Daly, S. J., & Feng, X. (2004) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.526937 · Cited by 96
Enhancement of Bright Video Features for HDR Displays
Didyk, P., Mantiuk, R., Hein, M., et al. (2008) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2008.01265.x · Cited by 91
Self-citationPerception of Lightness and Illumination in a World of One Reflectance
Gilchrist, A., & Jacobsen, A. R. (1984) · Perception · doi:10.1068/p130005 · Cited by 88
High Dynamic Range Imaging and Low Dynamic Range Expansion for Generating HDR Content
Banterle, F., Debattista, K., Artusi, A., Pattanaik, S. N., Myszkowski, K., Ledda, P., & Chalmers, A. G. (2009) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2009.01541.x · Cited by 84
A unified framework for multi-sensor HDR video reconstruction
Kronander, J., Gustavson, S., Bonnet, G., et al. (2013) · Signal Processing Image Communication · doi:10.1016/j.image.2013.08.018 · Cited by 58
Self-citationHigh-quality brightness enhancement functions for real-time reverse tone mapping
Kovaleski, R. P., & Oliveira, M. M. (2009) · The Visual Computer · doi:10.1007/s00371-009-0327-3 · Cited by 57
Adaptive dualISO HDR reconstruction
Hajisharif, S., Kronander, J., & Unger, J. (2015) · EURASIP Journal on Image and Video Processing · doi:10.1186/s13640-015-0095-0 · Cited by 46
Self-citationDaly, S. J., & Feng, X. (2003) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.472016 · Cited by 43
High-dynamic-range video for photometric measurement of illumination
Unger, J., & Gustavson, S. (2007) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.703050 · Cited by 43
Self-citationGlare encoding of high dynamic range images
Rouf, M., Mantiuk, R., Heidrich, W., et al. (2011) · doi:10.1109/cvpr.2011.5995335 · Cited by 41
Self-citationAzimi, M., Banitalebi-Dehkordi, A., Dong, Y., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.04815 · Cited by 35
Evaluation of reverse tone mapping through varying exposure conditions
Masiá, B., Agustin, S., Fleming, R. W., et al. (2009) · ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia (SIGGRAPH Asia) · doi:10.1145/1661412.1618506 · Cited by 30
Cited by
Learning a Deep Single Image Contrast Enhancer from Multi-Exposure Images
Cai, J., Gu, S., & Zhang, L. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2794218 · Cited by 1,234
Sitzmann, V., Diamond, S., Peng, Y., Dun, X., Boyd, S., Heidrich, W., Heide, F., & Wetzstein, G. (2018) · ACM Transactions on Graphics · doi:10.1145/3197517.3201333 · Cited by 478
Learning to Restore Low-Light Images via Decomposition-and-Enhancement
Xu, K., Yang, X., Yin, B., & Lau, R. W. H. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00235 · Cited by 449
CycleISP: Real Image Restoration via Improved Data Synthesis
Zamir, S. W., Arora, A., Khan, S., Hayat, M., Khan, F. S., Yang, M.-H., & Shao, L. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00277 · Cited by 393
An Experiment-Based Review of Low-Light Image Enhancement Methods
Wang, W., Wu, X., Yuan, X., & Gao, Z. (2020) · IEEE Access · doi:10.1109/access.2020.2992749 · Cited by 364
Metadata
- Authors
- Eilertsen, G., Kronander, J., Denes, G., Mantiuk, R. K., & Unger, J.
- Venue
- ACM Transactions on Graphics
- Published
- 2017-11-20
- Volume
- 36
- Issue
- 6
- Pages
- 1-15
- ISSN
- 0730-0301 (ISSN-L)
- 1557-7368
- OpenAlex
- W2766497195
- Cited by
- 598
- References
- 55
- FWCI
- 19.77
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.