The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
EnlightenGAN: Deep Light Enhancement Without Paired Supervision
Open accessAbstract
Deep learning-based methods have achieved remarkable success in image restoration and enhancement, but are they still competitive when there is a lack of paired training data? As one such example, this paper explores the low-light image enhancement problem, where in practice it is extremely challenging to simultaneously take a low-light and a normal-light photo of the same visual scene. We propose a highly effective unsupervised generative adversarial network, dubbed EnlightenGAN, that can be trained without low/normal-light image pairs, yet proves to generalize very well on various real-world test images. Instead of supervising the learning using ground truth data, we propose to regularize the unpaired training using the information extracted from the input itself, and benchmark a series of innovations for the low-light image enhancement problem, including a global-local discriminator structure, a self-regularized perceptual loss fusion, and the attention mechanism. Through extensive experiments, our proposed approach outperforms recent methods under a variety of metrics in terms of visual quality and subjective user study. Thanks to the great flexibility brought by unpaired training, EnlightenGAN is demonstrated to be easily adaptable to enhancing real-world images from various domains. Our codes and pre-trained models are available at: https://github.com/VITA-Group/EnlightenGAN.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
Labaca-Castro, R. (2023) · Machine Learning under Malware Attack · doi:10.1007/978-3-658-40442-0_9 · Cited by 19,272
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 14,214
Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network
Ledig, C., Theis, L., Huszar, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A., Tejani, A., Totz, J., Wang, Z., et al. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.19 · Cited by 12,696
Self-citationPerceptual Losses for Real-Time Style Transfer and Super-Resolution
Johnson, J., Alahi, A., & Fei-Fei, L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_43 · Cited by 11,283
Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising
Zhang, K., Zuo, W., Chen, Y., Meng, D., & Zhang, L. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2662206 · Cited by 8,983
Accurate Image Super-Resolution Using Very Deep Convolutional Networks
Kim, J., Lee, J. K., & Lee, K. M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.182 · Cited by 7,870
Making a “Completely Blind” Image Quality Analyzer
Mittal, A., Soundararajan, R., & Bovik, A. C. (2013) · IEEE Signal Processing Letters · doi:10.1109/lsp.2012.2227726 · Cited by 6,766
“Least squares generative adversarial networks,”
Mao, X., Li, Q., Xie, H., Lau, R. Y. K., Wang, Z., & Smolley, S. P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.304 · Cited by 5,437
Self-citationStarGAN: Unified Generative Adversarial Networks for Multi-domain Image-to-Image Translation
Choi, Y., Choi, M., Kim, M., Ha, J.-W., Kim, S., & Choo, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00916 · Cited by 4,163
Adaptive histogram equalization and its variations
Pizer, S. M., Amburn, E. P., Austin, J. D., Cromartie, R., Geselowitz, A., Greer, T., ter Haar Romeny, B., Zimmerman, J. B., & Zuiderveld, K. (1987) · Computer Vision, Graphics, and Image Processing · doi:10.1016/s0734-189x(87)80186-x · Cited by 4,012
A multiscale retinex for bridging the gap between color images and the human observation of scenes
Jobson, D. J., Rahman, Z., & Woodell, G. A. (1997) · IEEE Transactions on Image Processing · doi:10.1109/83.597272 · Cited by 3,036
LIME: Low-Light Image Enhancement via Illumination Map Estimation
Guo, X., Li, Y., & Ling, H. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2639450 · Cited by 2,998
The Retinex Theory of Color Vision
Land, E. H. (1977) · Scientific American · doi:10.1038/scientificamerican1277-108 · Cited by 2,981
CyCADA: Cycle-Consistent Adversarial Domain Adaptation
Hoffman, J., Tzeng, E., Park, T., Zhu, J.-Y., Isola, P., Saenko, K., Efros, A. A., & Darrell, T. (2017) · arXiv · doi:10.48550/arxiv.1711.03213 · Cited by 2,656 · cited 1×
“We introduce a lightweight yet effective one-path GAN named EnlightenGAN , without using cycle-consistency as prior works [11, 12, 13, 14] and therefore enjoying the merit of much shorter training time.”
MethodBDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learning
Yu, F., Chen, H., Wang, X., Xian, W., Chen, Y., Liu, F., Madhavan, V., & Darrell, T. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00271 · Cited by 2,641
Generative Image Inpainting with Contextual Attention
Yu, J., Lin, Z., Yang, J., Shen, X., Lu, X., & Huang, T. S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00577 · Cited by 2,527
Self-citationMultimodal Unsupervised Image-to-Image Translation
Huang, X., Liu, M.-Y., Belongie, S., & Kautz, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01219-9_11 · Cited by 2,451
Rank Analysis of Incomplete Block Designs: I. The Method of Paired Comparisons
Bradley, R. A., & Terry, M. E. (1952) · Biometrika · doi:10.2307/2334029 · Cited by 2,412
AOD-Net: All-in-One Dehazing Network
Li, B., Peng, X., Wang, Z., Xu, J., & Feng, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.511 · Cited by 2,342
Self-citationBenchmarking Single-Image Dehazing and Beyond
Li, B., Ren, W., Fu, D., Tao, D., Feng, D., Zeng, W., & Wang, Z. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2867951 · Cited by 2,301
Self-citationLLNet: A deep autoencoder approach to natural low-light image enhancement
Lore, K. G., Akintayo, A., & Sarkar, S. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2016.06.008 · Cited by 1,951
Naturalness Preserved Enhancement Algorithm for Non-Uniform Illumination Images
Wang, S., Zheng, J., Hu, H.-M., & Li, B. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2261309 · Cited by 1,755
DeblurGAN: Blind Motion Deblurring Using Conditional Adversarial Networks
Kupyn, O., Budzan, V., Mykhailych, M., Mishkin, D., & Matas, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00854 · Cited by 1,706
RANK ANALYSIS OF INCOMPLETE BLOCK DESIGNS: THE METHOD OF PAIRED COMPARISONS
BRADLEY, R. A., & TERRY, M. E. (1952) · Biometrika · doi:10.1093/biomet/39.3-4.324 · Cited by 1,434
Chen, C., Chen, Q., Xu, J., & Koltun, V. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00347 · Cited by 1,376
Scale-Recurrent Network for Deep Image Deblurring
Tao, X., Gao, H., Shen, X., Wang, J., & Jia, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00853 · Cited by 1,316
Self-citationStructure-Revealing Low-Light Image Enhancement Via Robust Retinex Model
Li, M., Liu, J., Yang, W., Sun, X., & Guo, Z. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2810539 · Cited by 1,245
Learning a Deep Single Image Contrast Enhancer from Multi-Exposure Images
Cai, J., Gu, S., & Zhang, L. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2794218 · Cited by 1,234
Perceptual Quality Assessment for Multi-Exposure Image Fusion
Ma, K., Zeng, K., & Wang, Z. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2442920 · Cited by 1,190
Self-citationDeblurGAN-v2: Deblurring (Orders-of-Magnitude) Faster and Better
Kupyn, O., Martyniuk, T., Wu, J., & Wang, Z. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00897 · Cited by 1,148
Self-citationA Weighted Variational Model for Simultaneous Reflectance and Illumination Estimation
Fu, X., Zeng, D., Huang, Y., Zhang, X.-P., & Ding, X. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.304 · Cited by 1,081
Getting to know low-light images with the Exclusively Dark dataset
Loh, Y. P., & Chan, C. S. (2019) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2018.10.010 · Cited by 843
Attentive Generative Adversarial Network for Raindrop Removal from A Single Image
Qian, R., Tan, R. T., Yang, W., Su, J., & Liu, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00263 · Cited by 821
Ulyanov, D., Vedaldi, A., & Lempitsky, V. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.437 · Cited by 815
Deep bilateral learning for real-time image enhancement
Gharbi, M., Chen, J., Barron, J. T., Hasinoff, S. W., & Durand, F. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073592 · Cited by 800
Deep high dynamic range imaging of dynamic scenes
Kalantari, N. K., & Ramamoorthi, R. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073609 · Cited by 596
Unsupervised Image Super-Resolution Using Cycle-in-Cycle Generative Adversarial Networks
Yuan, Y., Liu, S., Zhang, J., Zhang, Y., Dong, C., & Lin, L. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00113 · Cited by 594
The relativistic discriminator: a key element missing from standard GAN
Jolicoeur‐Martineau, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.00734 · Cited by 532
RAISE: a raw images dataset for digital image forensics
Dang-Nguyen, D.-T., Pasquini, C., Conotter, V., & Boato, G. (2015) · Proceedings of the 6th ACM Multimedia Systems Conference · doi:10.1145/2713168.2713194 · Cited by 508
Deep Photo Enhancer: Unpaired Learning for Image Enhancement from Photographs with GANs
Chen, Y.-S., Wang, Y.-C., Kao, M.-H., & Chuang, Y.-Y. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00660 · Cited by 467
Single Image Dehazing via Conditional Generative Adversarial Network
Li, R., Pan, J., Li, Z., & Tang, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00856 · Cited by 427
Single Image Deraining: A Comprehensive Benchmark Analysis
Li, S., Araujo, I. B., Ren, W., Wang, Z., Tokuda, E. K., Junior, R. H., Cesar-Junior, R., Zhang, J., Guo, X., & Cao, X. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00396 · Cited by 342
Self-citationAdvancing Image Understanding in Poor Visibility Environments: A Collective Benchmark Study
Yang, W., Yuan, Y., Ren, W., Liu, J., Scheirer, W. J., Wang, Z., Zhang, T., Zhong, Q., Xie, D., Pu, S., et al. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2981922 · Cited by 342
Self-citationZhang, Y. (2017) · De Gruyter eBooks · doi:10.1515/9783110524116 · Cited by 329
AutoGAN: Neural Architecture Search for Generative Adversarial Networks
Gong, X., Chang, S., Jiang, Y., & Wang, Z. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00332 · Cited by 305
Self-citationDeep High Dynamic Range Imaging with Large Foreground Motions
Wu, S., Xu, J., Tai, Y.-W., & Tang, C.-K. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01216-8_8 · Cited by 303
Towards Perceptual Image Dehazing by Physics-Based Disentanglement and Adversarial Training
Yang, X., Xu, Z., & Luo, J. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12317 · Cited by 261
Contrast enhancement based on layered difference representation
Lee, C., Lee, C., & Kim, C.-S. (2012) · 2012 19th IEEE International Conference on Image Processing · doi:10.1109/icip.2012.6467022 · Cited by 235
When Image Denoising Meets High-Level Vision Tasks: A Deep Learning Approach
Liu, D., Wen, B., Liu, X., Wang, Z., & Huang, T. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/117 · Cited by 231
Self-citationJoint Enhancement and Denoising Method via Sequential Decomposition
Ren, X., Li, M., Cheng, W.-H., & Liu, J. (2018) · 2018 IEEE International Symposium on Circuits and Systems (ISCAS) · doi:10.1109/iscas.2018.8351427 · Cited by 228
Deep Retinex Decomposition for Low-Light Enhancement
Wei, C., Wang, W., Yang, W., & Liu, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.04560 · Cited by 212
BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learning
Yu, F., Chen, H., Wang, X., Xian, W., Chen, Y., Liu, F., Madhavan, V., & Darrell, T. (2018) · arXiv · doi:10.48550/arxiv.1805.04687 · Cited by 204
Controllable Artistic Text Style Transfer via Shape-Matching GAN
Yang, S., Wang, Z., Wang, Z., Xu, N., Liu, J., & Guo, Z. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00454 · Cited by 113
Self-citationUnsupervised Single Image Deraining with Self-Supervised Constraints
Jin, X., Chen, Z., Lin, J., Chen, Z., & Zhou, W. (2019) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2019.8803238 · Cited by 102
PsyPhy: A Psychophysics Driven Evaluation Framework for Visual Recognition
RichardWebster, B., Anthony, S. E., & Scheirer, W. J. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2849989 · Cited by 84
Deep Plastic Surgery: Robust and Controllable Image Editing with Human-Drawn Sketches
Yang, S., Wang, Z., Liu, J., & Guo, Z. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58555-6_36 · Cited by 63
Self-citationImproved Techniques for Learning to Dehaze and Beyond: A Collective StudyPreprint
Liu, Y., Zhao, G., Gong, B., Li, Y., Raj, R., Goel, N., Kesav, S., Gottimukkala, S., Wang, Z., Ren, W., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.00202 · Cited by 50
Self-citationYuan, Y., Yang, W., Ren, W., Liu, J., Scheirer, W. J., & Wang, Z. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.04474 · Cited by 43
Self-citation
Cited by
Zero-Reference Deep Curve Estimation for Low-Light Image Enhancement
Guo, C., Li, C., Guo, J., Loy, C. C., Hou, J., Kwong, S., & Cong, R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00185 · Cited by 2,459
DeblurGAN-v2: Deblurring (Orders-of-Magnitude) Faster and Better
Kupyn, O., Martyniuk, T., Wu, J., & Wang, Z. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00897 · Cited by 1,148
Self-citationToward Fast, Flexible, and Robust Low-Light Image Enhancement
Ma, L., Ma, T., Liu, R., Fan, X., & Luo, Z. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00555 · Cited by 1,099
Liu, R., Ma, L., Zhang, J., Fan, X., & Luo, Z. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01042 · Cited by 1,057
Retinexformer: One-stage Retinex-based Transformer for Low-light Image Enhancement
Cai, Y., Bian, H., Lin, J., Wang, H., Timofte, R., & Zhang, Y. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01149 · Cited by 896
Metadata
- Authors
- Jiang, Y., Gong, X., Liu, D., Cheng, Y., Fang, C., Shen, X., Yang, J., Zhou, P., & Wang, Z.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2021
- Volume
- 30
- Pages
- 2340-2349
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W3121661546
- Cited by
- 2,715
- References
- 62
- FWCI
- 130.95
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.