The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Single-Image HDR Reconstruction by Learning to Reverse the Camera Pipeline
Open accessAbstract
Recovering a high dynamic range (HDR) image from a single low dynamic range (LDR) input image is challenging due to missing details in under-/over-exposed regions caused by quantization and saturation of camera sensors. In contrast to existing learning-based methods, our core idea is to incorporate the domain knowledge of the LDR image formation pipeline into our model. We model the HDR-to-LDR image formation pipeline as the (1) dynamic range clipping, (2) non-linear mapping from a camera response function, and (3) quantization. We then propose to learn three specialized CNNs to reverse these steps. By decomposing the problem into specific sub-tasks, we impose effective physical constraints to facilitate the training of individual sub-networks. Finally, we jointly fine-tune the entire model end-to-end to reduce error accumulation. With extensive quantitative and qualitative experiments on diverse image datasets, we demonstrate that the proposed method performs favorably against state-of-the-art single-image HDR reconstruction algorithms.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
The Unreasonable Effectiveness of Deep Features as a Perceptual Metric
Zhang, R., Isola, P., Efros, A. A., Shechtman, E., & Wang, O. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00068 · Cited by 14,623
Perceptual Losses for Real-Time Style Transfer and Super-Resolution
Johnson, J., Alahi, A., & Fei-Fei, L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_43 · Cited by 11,283
Context Encoders: Feature Learning by Inpainting
Pathak, D., Krahenbuhl, P., Donahue, J., Darrell, T., & Efros, A. A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.278 · Cited by 5,691
PatchMatch: a randomized correspondence algorithm for structural image editing
Barnes, C., Shechtman, E., Finkelstein, A., & Goldman, D. B. (2009) · ACM Transactions on Graphics · doi:10.1145/1531326.1531330 · Cited by 2,880
Generative Image Inpainting with Contextual Attention
Yu, J., Lin, Z., Yang, J., Shen, X., Lu, X., & Huang, T. S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00577 · Cited by 2,527
Image Inpainting for Irregular Holes Using Partial Convolutions
Liu, G., Reda, F. A., Shih, K. J., Wang, T.-C., Tao, A., & Catanzaro, B. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01252-6_6 · Cited by 2,419
Recovering high dynamic range radiance maps from photographs
Debevec, P. E., & Malik, J. (2008) · ACM SIGGRAPH 2008 classes · doi:10.1145/1401132.1401174 · Cited by 2,399
Image quilting for texture synthesis and transfer
Efros, A. A., & Freeman, W. T. (2001) · Proceedings of the 28th annual conference on Computer graphics and interactive techniques · doi:10.1145/383259.383296 · Cited by 2,347
Globally and locally consistent image completion
Iizuka, S., Simo-Serra, E., & Ishikawa, H. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073659 · Cited by 2,203
Free-Form Image Inpainting With Gated Convolution
Yu, J., Lin, Z., Yang, J., Shen, X., Lu, X., & Huang, T. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00457 · Cited by 1,928
Deconvolution and Checkerboard Artifacts
Odena, A., Dumoulin, V., & Olah, C. (2016) · Distill · doi:10.23915/distill.00003 · Cited by 1,640
HDR image reconstruction from a single exposure using deep CNNs
Eilertsen, G., Kronander, J., Denes, G., Mantiuk, R. K., & Unger, J. (2017) · ACM Transactions on Graphics · doi:10.1145/3130800.3130816 · Cited by 598
Deep high dynamic range imaging of dynamic scenes
Kalantari, N. K., & Ramamoorthi, R. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073609 · Cited by 596
RAISE: a raw images dataset for digital image forensics
Dang-Nguyen, D.-T., Pasquini, C., Conotter, V., & Boato, G. (2015) · Proceedings of the 6th ACM Multimedia Systems Conference · doi:10.1145/2713168.2713194 · Cited by 508
Mantiuk, R., Kim, K. J., Rempel, A. G., & Heidrich, W. (2011) · ACM SIGGRAPH 2011 papers · doi:10.1145/1964921.1964935 · Cited by 467
A Comparative Study for Single Image Blind Deblurring
Lai, W.-S., Huang, J.-B., Hu, Z., Ahuja, N., & Yang, M.-H. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.188 · Cited by 436
Self-citationPatchMatch: a randomized correspondence algorithm for structural image editing
Barnes, C., Shechtman, E., Finkelstein, A., & Goldman, D. B. (2009) · ACM SIGGRAPH 2009 papers · doi:10.1145/1576246.1531330 · Cited by 364
A comparative study of image retargeting
Rubinstein, M., Gutiérrez, D., Sorkine‐Hornung, O., & Shamir, A. (2010) · ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia (SIGGRAPH Asia) · doi:10.1145/1866158.1866186 · Cited by 343
Endo, Y., Kanamori, Y., & Mitani, J. (2017) · ACM Transactions on Graphics · doi:10.1145/3130800.3130834 · Cited by 331
Image completion using planar structure guidance
Huang, J.-B., Kang, S. B., Ahuja, N., & Kopf, J. (2014) · ACM Transactions on Graphics · doi:10.1145/2601097.2601205 · Cited by 322
Self-citationDeep High Dynamic Range Imaging with Large Foreground Motions
Wu, S., Xu, J., Tai, Y.-W., & Tang, C.-K. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01216-8_8 · Cited by 303
Marnerides, D., Bashford‐Rogers, T., Hatchett, J., & Debattista, K. (2018) · Computer Graphics Forum · doi:10.1111/cgf.13340 · Cited by 272
Ghost Removal in High Dynamic Range Images
Khan, E. A., Akyüz, A. O., & Reinhard, E. (2006) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2006.312892 · Cited by 222
A New In-Camera Imaging Model for Color Computer Vision and Its Application
Kim, S. J., Lin, H. T., Lu, Z., Süsstrunk, S., Lin, S., & Brown, M. S. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.58 · Cited by 167
A Software Platform for Manipulating the Camera Imaging Pipeline
Karaimer, H. C., & Brown, M. S. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_26 · Cited by 166
Deep Recursive HDRI: Inverse Tone Mapping Using Generative Adversarial Networks
Lee, S., An, G. H., & Kang, S. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01216-8_37 · Cited by 161
A Hybrid l1-l0 Layer Decomposition Model for Tone Mapping
Liang, Z., Xu, J., Zhang, D. D., Cao, Z., & Zhang, L. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00500 · Cited by 158
High-Quality Reverse Tone Mapping for a Wide Range of Exposures
Kovaleski, R. P., & Oliveira, M. M. (2014) · SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI) · doi:10.1109/sibgrapi.2014.29 · Cited by 146
Image Correction via Deep Reciprocating HDR Transformation
Yang, X., Xu, K., Song, Y., Zhang, Q., Wei, X., & Lau, R. W. H. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00193 · Cited by 143
Deep Chain HDRI: Reconstructing a High Dynamic Range Image from a Single Low Dynamic Range Image
Lee, S., An, G. H., & Kang, S. (2018) · IEEE Access · doi:10.1109/access.2018.2868246 · Cited by 130
Learning High Dynamic Range from Outdoor Panoramas
Zhang, J., & Lalonde, J. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.484 · Cited by 114
Ghost detection and removal for high dynamic range images: Recent advances
Srikantha, A., & Sidibé, D. (2012) · Signal Processing Image Communication · doi:10.1016/j.image.2012.02.001 · Cited by 111
Decontouring: prevention and removal of false contour artifacts
Daly, S. J., & Feng, X. (2004) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.526937 · Cited by 96
High Dynamic Range Imaging and Low Dynamic Range Expansion for Generating HDR Content
Banterle, F., Debattista, K., Artusi, A., Pattanaik, S. N., Myszkowski, K., Ledda, P., & Chalmers, A. G. (2009) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2009.01541.x · Cited by 84
High dynamic range video with ghost removal
Mangiat, S., & Gibson, J. D. (2010) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.862492 · Cited by 54
Image Companding and Inverse Halftoning using Deep Convolutional Neural NetworksPreprint
Hou, X., & Qiu, G. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.00116 · Cited by 46
Li, H., & Peers, P. (2017) · European Conference on Visual Media Production (CVMP) · doi:10.1145/3150165.3150170 · Cited by 17
Song, Q. Y., Su, G., & Cosman, P. C. (2016) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2016.7532970 · Cited by 12
Learning-Based Dequantization For Image Restoration Against Extremely Poor IlluminationPreprint
Liu, C., Wu, X., & Shu, X. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.01532 · Cited by 9
Metadata
- Authors
- Liu, Y.-L., Lai, W.-S., Chen, Y.-S., Kao, Y.-L., Yang, M.-H., Chuang, Y.-Y., & Huang, J.-B.
- Venue
- 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2020-06
- Pages
- 1648-1657
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W3034628923
- Cited by
- 287
- References
- 41
- FWCI
- 13.63
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.