The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Deep reverse tone mapping
Abstract
Inferring a high dynamic range (HDR) image from a single low dynamic range (LDR) input is an ill-posed problem where we must compensate lost data caused by under-/over-exposure and color quantization. To tackle this, we propose the first deep-learning-based approach for fully automatic inference using convolutional neural networks. Because a naive way of directly inferring a 32-bit HDR image from an 8-bit LDR image is intractable due to the difficulty of training, we take an indirect approach; the key idea of our method is to synthesize LDR images taken with different exposures (i.e., bracketed images ) based on supervised learning, and then reconstruct an HDR image by merging them. By learning the relative changes of pixel values due to increased/decreased exposures using 3D deconvolutional networks, our method can reproduce not only natural tones without introducing visible noise but also the colors of saturated pixels. We demonstrate the effectiveness of our method by comparing our results not only with those of conventional methods but also with ground-truth HDR images.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
(2014) · Cited by 33,419
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
(2010) · International Conference on Machine Learning · Cited by 13,995
Unsupervised representation learning with deep convolutional generative adversarial networks
Radford, A., Metz, L., & Chintala, S. (2015) · arXiv · doi:10.48550/arxiv.1511.06434 · Cited by 12,235
Learning Spatiotemporal Features with 3D Convolutional Networks
Tran, D., Bourdev, L., Fergus, R., Torresani, L., & Paluri, M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.510 · Cited by 9,593
Large-Scale Video Classification with Convolutional Neural Networks
Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., & Fei-Fei, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.223 · Cited by 6,354
3D Convolutional Neural Networks for Human Action Recognition
Ji, S., Xu, W., Yang, M., & Yu, K. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.59 · Cited by 6,235
Context Encoders: Feature Learning by Inpainting
Pathak, D., Krahenbuhl, P., Donahue, J., Darrell, T., & Efros, A. A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.278 · Cited by 5,691
Learning to forget: Continual prediction with LSTM
Gers, F. A., Schmidhuber, J., & Cummins, F. (2000) · Neural Computation · doi:10.1162/089976600300015015 · Cited by 4,823
3D ShapeNets: A deep representation for volumetric shapes
Wu, Z., Song, S., Khosla, A., Yu, F., Zhang, L., Tang, X., & Xiao, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298801 · Cited by 4,550
VoxNet: A 3D Convolutional Neural Network for real-time object recognition
Maturana, D., & Scherer, S. (2015) · 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2015.7353481 · Cited by 3,458
Loss Functions for Image Restoration With Neural Networks
Zhao, H., Gallo, O., Frosio, I., & Kautz, J. (2017) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2016.2644865 · Cited by 2,641
(2014) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 2,534
Recovering high dynamic range radiance maps from photographs
Debevec, P. E., & Malik, J. (2008) · ACM SIGGRAPH 2008 classes · doi:10.1145/1401132.1401174 · Cited by 2,399
Unsupervised Learning of Video Representations using LSTMs
Srivastava, N., Mansimov, E., & Salakhutdinov, R. (2015) · arXiv · doi:10.48550/arxiv.1502.04681 · Cited by 1,861
Recovering high dynamic range radiance maps from photographs
Debevec, P. E., & Malik, J. (1997) · Proceedings of the 24th annual conference on Computer graphics and interactive techniques - SIGGRAPH '97 · doi:10.1145/258734.258884 · Cited by 1,775
Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networks
Denton, E., Chintala, S., Szlam, A. D., & Fergus, R. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.05751 · Cited by 1,541
Photographic tone reproduction for digital images
Reinhard, E., Stark, M., Shirley, P., & Ferwerda, J. (2002) · Proceedings of the 29th annual conference on Computer graphics and interactive techniques · doi:10.1145/566570.566575 · Cited by 1,408
Photographic tone reproduction for digital images
Reinhard, E., Stark, M., Shirley, P., & Ferwerda, J. (2002) · ACM Transactions on Graphics · doi:10.1145/566654.566575 · Cited by 1,012
Generating Videos with Scene Dynamics
Vondrick, C., Pirsiavash, H., & Torralba, A. B. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1609.02612 · Cited by 785
Wiley encyclopedia of electrical and electronics engineering
(1999) · Choice Reviews Online · doi:10.5860/choice.37-1289 · Cited by 696
Huang, R., Zhang, S., Li, T., & He, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.267 · Cited by 687
Mantiuk, R., Kim, K. J., Rempel, A. G., & Heidrich, W. (2011) · ACM Transactions on Graphics · doi:10.1145/2010324.1964935 · Cited by 685
HDR image reconstruction from a single exposure using deep CNNs
Eilertsen, G., Kronander, J., Denes, G., Mantiuk, R. K., & Unger, J. (2017) · ACM Transactions on Graphics · doi:10.1145/3130800.3130816 · Cited by 598
Deep high dynamic range imaging of dynamic scenes
Kalantari, N. K., & Ramamoorthi, R. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073609 · Cited by 596
Mantiuk, R., Kim, K. J., Rempel, A. G., & Heidrich, W. (2011) · ACM SIGGRAPH 2011 papers · doi:10.1145/1964921.1964935 · Cited by 467
Recognizing scene viewpoint using panoramic place representation
Xiao, J., Ehinger, K. A., Oliva, A., & Torralba, A. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247991 · Cited by 318
A versatile HDR video production system
Tocci, M. D., Kiser, C., Tocci, N., & Sen, P. (2011) · ACM Transactions on Graphics · doi:10.1145/2010324.1964936 · Cited by 202
Ldr2Hdr: on-the-fly reverse tone mapping of legacy video and photographs
Rempel, A. G., Trentacoste, M., Seetzen, H., Young, H. D., Heidrich, W., Whitehead, L., & Ward, G. (2007) · ACM Transactions on Graphics · doi:10.1145/1276377.1276426 · Cited by 182
A versatile HDR video production system
Tocci, M. D., Kiser, C., Tocci, N., & Sen, P. (2011) · ACM SIGGRAPH 2011 papers · doi:10.1145/1964921.1964936 · Cited by 174
Ldr2Hdr: on-the-fly reverse tone mapping of legacy video and photographs
Rempel, A. G., Trentacoste, M., Seetzen, H., Young, H. D., Heidrich, W., Whitehead, L. A., & Ward, G. (2007) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1275808.1276426 · Cited by 155
High-Quality Reverse Tone Mapping for a Wide Range of Exposures
Kovaleski, R. P., & Oliveira, M. M. (2014) · SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI) · doi:10.1109/sibgrapi.2014.29 · Cited by 146
Miller, G. L. (2004) · Science · doi:10.1126/science.304.5667.34 · Cited by 136
Unsupervised Learning of Visual Structure using Predictive Generative NetworksPreprint
Lotter, W. E., Kreiman, G., & Cox, D. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.06380 · Cited by 131
Funt, B., & Shi, L. (2011) · Summit (Simon Fraser University) · doi:10.5446/31094 · Cited by 116
Evaluation of reverse tone mapping through varying exposure conditions
Masiá, B., Agustin, S., Fleming, R. W., et al. (2009) · ACM Transactions on Graphics · doi:10.1145/1618452.1618506 · Cited by 115
Learning High Dynamic Range from Outdoor Panoramas
Zhang, J., & Lalonde, J. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.484 · Cited by 114
Convolutional Sparse Coding for High Dynamic Range Imaging
Serrano, A., Heide, F., Gutiérrez, D., Wetzstein, G., & Masiá, B. (2016) · Computer Graphics Forum · doi:10.1111/cgf.12819 · Cited by 100
Pseudo-Multiple-Exposure-Based Tone Fusion With Local Region Adjustment
Wang, T.-H., Chiu, C.-W., Wu, W.-C., Wang, J.-W., Lin, C.-Y., Chiu, C., & Liou, J.-J. (2015) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2015.2403612 · Cited by 91
Enhancement of Bright Video Features for HDR Displays
Didyk, P., Mantiuk, R., Hein, M., et al. (2008) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2008.01265.x · Cited by 91
Unbounded High Dynamic Range Photography Using a Modulo Camera
Zhao, H., Shi, B., Fernandez-Cull, C., Yeung, S.-K., & Raskar, R. (2015) · IEEE International Conference on Computational Photography (ICCP) · doi:10.1109/iccphot.2015.7168378 · Cited by 88
Mantiuk, R., Myszkowski, K., & Seidel, H. (2015) · Wiley eBooks · doi:10.1002/047134608x.w8265 · Cited by 87
Generative And Discriminative Voxel Modeling With Convolutional Neural Networks
Brock, A., Lim, T., Ritchie, J. M., & Weston, N. (2016) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.802260 · Cited by 65
Unified HDR reconstruction from raw CFA data
Kronander, J., Gustavson, S., Bonnet, G., et al. (2013) · IEEE International Conference on Computational Photography (ICCP) · doi:10.1109/iccphot.2013.6528315 · Cited by 62
High-quality brightness enhancement functions for real-time reverse tone mapping
Kovaleski, R. P., & Oliveira, M. M. (2009) · The Visual Computer · doi:10.1007/s00371-009-0327-3 · Cited by 57
Kim, M. H., & Kautz, J. (2008) · UCL Discovery (University College London) · Cited by 50
Cited by
Learning a Deep Single Image Contrast Enhancer from Multi-Exposure Images
Cai, J., Gu, S., & Zhang, L. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2794218 · Cited by 1,234
HDR image reconstruction from a single exposure using deep CNNs
Eilertsen, G., Kronander, J., Denes, G., Mantiuk, R. K., & Unger, J. (2017) · ACM Transactions on Graphics · doi:10.1145/3130800.3130816 · Cited by 598
An Experiment-Based Review of Low-Light Image Enhancement Methods
Wang, W., Wu, X., Yuan, X., & Gao, Z. (2020) · IEEE Access · doi:10.1109/access.2020.2992749 · Cited by 364
Attention-Guided Network for Ghost-Free High Dynamic Range Imaging
Yan, Q., Gong, D., Shi, Q., van den Hengel, A., Shen, C., Reid, I., & Zhang, Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00185 · Cited by 313
Single-Image HDR Reconstruction by Learning to Reverse the Camera Pipeline
Liu, Y.-L., Lai, W.-S., Chen, Y.-S., Kao, Y.-L., Yang, M.-H., Chuang, Y.-Y., & Huang, J.-B. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00172 · Cited by 287
Metadata
- Authors
- Endo, Y., Kanamori, Y., & Mitani, J.
- Venue
- ACM Transactions on Graphics
- Published
- 2017-11-20
- Volume
- 36
- Issue
- 6
- Pages
- 1-10
- ISSN
- 0730-0301 (ISSN-L)
- 1557-7368
- OpenAlex
- W2769930525
- Cited by
- 331
- References
- 50
- FWCI
- 10.67
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.