The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Deep HDR Imaging via A Non-Local Network
Abstract
One of the most challenging problems in reconstructing a high dynamic range (HDR) image from multiple low dynamic range (LDR) inputs is the ghosting artifacts caused by the object motion across different inputs. When the object motion is slight, most existing methods can well suppress the ghosting artifacts through aligning LDR inputs based on optical flow or detecting anomalies among them. However, they often fail to produce satisfactory results in practice, since the real object motion can be very large. In this study, we present a novel deep framework, termed NHDRRnet, which adopts an alternative direction and attempts to remove ghosting artifacts by exploiting the non-local correlation in inputs. In NHDRRnet, we first adopt an Unet architecture to fuse all inputs and map the fusion results into a low-dimensional deep feature space. Then, we feed the resultant features into a novel global non-local module which reconstructs each pixel by weighted averaging all the other pixels using the weights determined by their correspondences. By doing this, the proposed NHDRRnet is able to adaptively select the useful information (e.g., which are not corrupted by large motions or adverse lighting conditions) in the whole deep feature space to accurately reconstruct each pixel. In addition, we also incorporate a triple-pass residual module to capture more powerful local features, which proves to be effective in further boosting the performance. Extensive experiments on three benchmark datasets demonstrate the superiority of the proposed NDHRnet in terms of suppressing the ghosting artifacts in HDR reconstruction, especially when the objects have large motions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Wang, X., Girshick, R., Gupta, A., & He, K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00813 · Cited by 11,596
A Non-Local Algorithm for Image Denoising
Buades, A., Coll, B., & Morel, J.-M. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.38 · Cited by 7,616
Texture synthesis by non-parametric sampling
Efros, A. A., & Leung, T. K. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790383 · Cited by 3,023
PatchMatch: a randomized correspondence algorithm for structural image editing
Barnes, C., Shechtman, E., Finkelstein, A., & Goldman, D. B. (2009) · ACM Transactions on Graphics · doi:10.1145/1531326.1531330 · Cited by 2,880
Recovering high dynamic range radiance maps from photographs
Debevec, P. E., & Malik, J. (2008) · ACM SIGGRAPH 2008 classes · doi:10.1145/1401132.1401174 · Cited by 2,399
Recovering high dynamic range radiance maps from photographs
Debevec, P. E., & Malik, J. (1997) · Proceedings of the 24th annual conference on Computer graphics and interactive techniques - SIGGRAPH '97 · doi:10.1145/258734.258884 · Cited by 1,775
High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting
Reinhard, E., Ward, G., Pattanaik, S., Debevec, P. E., Heidrich, W., & Myszkowski, K. (2010) · Cited by 1,359
Beyond pixels: exploring new representations and applications for motion analysis
Freeman, W. T., Adelson, E. H., & Liu, C. (2009) · Cited by 805
DeepFuse: A Deep Unsupervised Approach for Exposure Fusion with Extreme Exposure Image Pairs
Prabhakar, K. R., Srikar, V. S., & Babu, R. V. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.505 · Cited by 726
Mitsunaga, T., & Nayar, S. K. (2003) · Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149) · doi:10.1109/cvpr.1999.786966 · Cited by 716
HDR image reconstruction from a single exposure using deep CNNs
Eilertsen, G., Kronander, J., Denes, G., Mantiuk, R. K., & Unger, J. (2017) · ACM Transactions on Graphics · doi:10.1145/3130800.3130816 · Cited by 598
Deep high dynamic range imaging of dynamic scenes
Kalantari, N. K., & Ramamoorthi, R. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073609 · Cited by 596
Mantiuk, R., Kim, K. J., Rempel, A. G., & Heidrich, W. (2011) · ACM SIGGRAPH 2011 papers · doi:10.1145/1964921.1964935 · Cited by 467
Robust patch-based hdr reconstruction of dynamic scenes
Sen, P., Kalantari, N. K., Yaesoubi, M., Darabi, S., Goldman, D. B., & Shechtman, E. (2012) · ACM Transactions on Graphics · doi:10.1145/2366145.2366222 · Cited by 433
Endo, Y., Kanamori, Y., & Mitani, J. (2017) · ACM Transactions on Graphics · doi:10.1145/3130800.3130834 · Cited by 331
Attention-Guided Network for Ghost-Free High Dynamic Range Imaging
Yan, Q., Gong, D., Shi, Q., van den Hengel, A., Shen, C., Reid, I., & Zhang, Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00185 · Cited by 313
Self-citationDeep High Dynamic Range Imaging with Large Foreground Motions
Wu, S., Xu, J., Tai, Y.-W., & Tang, C.-K. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01216-8_8 · Cited by 303
HDR Deghosting: How to Deal with Saturation?
Hu, J., Gallo, O., Pulli, K., & Sun, X. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.154 · Cited by 296
Non-Local Recurrent Network for Image Restoration
Liu, D., Wen, B., Fan, Y., Loy, C. C., & Huang, T. S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.02919 · Cited by 252
Ghost Removal in High Dynamic Range Images
Khan, E. A., Akyüz, A. O., & Reinhard, E. (2006) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2006.312892 · Cited by 222
Robust High Dynamic Range Imaging by Rank Minimization
Oh, T.-H., Lee, J.-Y., Tai, Y.-W., & Kweon, I. S. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2361338 · Cited by 206
Freehand HDR Imaging of Moving Scenes with Simultaneous Resolution Enhancement
Zimmer, H., Bruhn, A., & Weickert, J. (2011) · Computer graphics forum (Print) · doi:10.1111/j.1467-8659.2011.01870.x · Cited by 179
Extending dynamic range of monochrome and color images through fusion
Bogoni, L. (2002) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2000.903475 · Cited by 132
The State of the Art in HDR Deghosting: A Survey and Evaluation
Tursun, O. T., Akyüz, A. O., Erdem, A., & Erdem, E. (2015) · Computer Graphics Forum · doi:10.1111/cgf.12593 · Cited by 119
Ghost detection and removal for high dynamic range images: Recent advances
Srikantha, A., & Sidibé, D. (2012) · Signal Processing Image Communication · doi:10.1016/j.image.2012.02.001 · Cited by 111
Ghost-Free High Dynamic Range Imaging
Heo, Y. S., Lee, K. M., Lee, S. U., Moon, Y.-S., & Cha, J.-H. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-19282-1_39 · Cited by 110
An Objective Deghosting Quality Metric for HDR Images
Tursun, O. T., Akyüz, A. O., Erdem, A., & Erdem, E. (2016) · Computer Graphics Forum · doi:10.1111/cgf.12818 · Cited by 108
Image Registration for Multi-exposure High Dynamic Range Image Acquisition
Tomaszewska, A., & Mantiuk, R. (2007) · Digital Library (University of West Bohemia) · Cited by 107
Multi-Scale Dense Networks for Deep High Dynamic Range Imaging
Yan, Q., Gong, D., Zhang, P., Shi, Q., Sun, J., Reid, I. D., & Zhang, Y. (2019) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2019.00012 · Cited by 94
Self-citationHybrid Patching for a Sequence of Differently Exposed Images With Moving Objects
Zheng, J., Li, Z. G., Zhu, Z., et al. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2283401 · Cited by 83
Deep HDR Video from Sequences with Alternating Exposures
Kalantari, N. K., & Ramamoorthi, R. (2019) · Computer Graphics Forum · doi:10.1111/cgf.13630 · Cited by 80
Reconstruction of high contrast images for dynamic scenes
Raman, S., & Chaudhuri, S. (2011) · The Visual Computer · doi:10.1007/s00371-011-0653-0 · Cited by 68
HDR brachytherapy irradiation of the jaw – as a new experimental model of radiogenic bone damage
Niehoff, P., Springer, I. N. G., Açil, Y., Lange, A., Marget, M., Roldán, J. C., Köppe, K., Warnke, P. H., Kimmig, B. N., & Wiltfang, J. (2008) · Journal of Cranio-Maxillofacial Surgery · doi:10.1016/j.jcms.2008.01.003 · Cited by 52
Burger, H. C., Schuler, C. J., & Stefan Harmeling, B. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1211.1552 · Cited by 29
Cited by
AI-assisted CT imaging analysis for COVID-19 screening: Building and deploying a medical AI system
Wang, B., Jin, S., Yan, Q., Xu, H., Luo, C., Wei, L., Zhao, W., Hou, X., Ma, W., Xu, Z., et al. (2021) · Applied Soft Computing · doi:10.1016/j.asoc.2020.106897 · Cited by 538
Self-citationCOVID-19 Chest CT Image Segmentation -- A Deep Convolutional Neural Network Solution
Yan, Q., Wang, B., Gong, D., Luo, C., Zhao, W., Shen, J., Shi, Q., Jin, S., Zhang, L., & You, Z. (2020) · arXiv · doi:10.48550/arxiv.2004.10987 · Cited by 109
Self-citation
Metadata
- Authors
- Yan, Q., Zhang, L., Liu, Y., Zhu, Y., Sun, J., Shi, Q., & Zhang, Y.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2020
- Volume
- 29
- Pages
- 4308-4322
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W3006487162
- Cited by
- 272
- References
- 35
- FWCI
- 11.10
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.