HQG-Net: Unpaired Medical Image Enhancement With High-Quality Guidance
Open accessThe DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
Abstract
Unpaired medical image enhancement (UMIE) aims to transform a low-quality (LQ) medical image into a high-quality (HQ) one without relying on paired images for training. While most existing approaches are based on Pix2Pix/CycleGAN and are effective to some extent, they fail to explicitly use HQ information to guide the enhancement process, which can lead to undesired artifacts and structural distortions. In this article, we propose a novel UMIE approach that avoids the above limitation of existing methods by directly encoding HQ cues into the LQ enhancement process in a variational fashion and thus model the UMIE task under the joint distribution between the LQ and HQ domains. Specifically, we extract features from an HQ image and explicitly insert the features, which are expected to encode HQ cues, into the enhancement network to guide the LQ enhancement with the variational normalization module. We train the enhancement network adversarially with a discriminator to ensure the generated HQ image falls into the HQ domain. We further propose a content-aware loss to guide the enhancement process with wavelet-based pixel-level and multiencoder-based feature-level constraints. Additionally, as a key motivation for performing image enhancement is to make the enhanced images serve better for downstream tasks, we propose a bi-level learning scheme to optimize the UMIE task and downstream tasks cooperatively, helping generate HQ images both visually appealing and favorable for downstream tasks. Experiments on three medical datasets verify that our method outperforms existing techniques in terms of both enhancement quality and downstream task performance. The code and the newly collected datasets are publicly available at https://github.com/ChunmingHe/HQG-Net.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
A Style-Based Generator Architecture for Generative Adversarial Networks
Karras, T., Laine, S., & Aila, T. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00453 · Cited by 11,714
Making a “Completely Blind” Image Quality Analyzer
Mittal, A., Soundararajan, R., & Bovik, A. C. (2013) · IEEE Signal Processing Letters · doi:10.1109/lsp.2012.2227726 · Cited by 6,766
Arbitrary Style Transfer in Real-Time with Adaptive Instance Normalization
Huang, X., & Belongie, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.167 · Cited by 5,076
EnlightenGAN: Deep Light Enhancement Without Paired Supervision
Jiang, Y., Gong, X., Liu, D., Cheng, Y., Fang, C., Shen, X., Yang, J., Zhou, P., & Wang, Z. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3051462 · Cited by 2,715
Benchmarking Single-Image Dehazing and Beyond
Li, B., Ren, W., Fu, D., Tao, D., Feng, D., Zeng, W., & Wang, Z. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2867951 · Cited by 2,301
StarGAN v2: Diverse Image Synthesis for Multiple Domains
Choi, Y., Uh, Y., Yoo, J., & Ha, J.-W. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00821 · Cited by 1,663
Precomputed Real-Time Texture Synthesis with Markovian Generative Adversarial Networks
Li, C., & Wand, M. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46487-9_43 · Cited by 1,421
Chen, C., Chen, Q., Xu, J., & Koltun, V. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00347 · Cited by 1,376
A Dynamic Histogram Equalization for Image Contrast Enhancement
Abdullah-Al-Wadud, M., Kabir, M., Akber Dewan, M., & Chae, O. (2007) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2007.381734 · Cited by 1,346
Liu, J., Fan, X., Huang, Z., Wu, G., Liu, R., Zhong, W., & Luo, Z. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00571 · Cited by 1,336
A Feature-Enriched Completely Blind Image Quality Evaluator
Zhang, L., Zhang, L., & Bovik, A. C. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2426416 · Cited by 1,311
Infrared and visible image fusion via gradient transfer and total variation minimization
Ma, J., Chen, C., Li, C., & Huang, J. (2016) · Information Fusion · doi:10.1016/j.inffus.2016.02.001 · Cited by 1,128
Learning Texture Transformer Network for Image Super-Resolution
Yang, F., Yang, H., Fu, J., Lu, H., & Guo, B. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00583 · Cited by 966
A High-Quality Denoising Dataset for Smartphone Cameras
Abdelhamed, A., Lin, S., & Brown, M. S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00182 · Cited by 867
A Benchmark for Endoluminal Scene Segmentation of Colonoscopy Images
Vázquez, D., Bernal, J., Sánchez, F. J., Fernández-Esparrach, G., López, A. M., Romero, A., Drozdzal, M., & Courville, A. (2017) · Journal of Healthcare Engineering · doi:10.1155/2017/4037190 · Cited by 866
Photorealistic Style Transfer via Wavelet Transforms
Yoo, J., Uh, Y., Chun, S., Kang, B., & Ha, J.-W. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00913 · Cited by 388
Camouflaged Object Detection with Feature Decomposition and Edge Reconstruction
He, C., Li, K., Zhang, Y., Tang, L., Zhang, Y., Guo, Z., & Li, X. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.02111 · Cited by 382
Self-citationImage Super-Resolution by Neural Texture Transfer
Zhang, Z., Wang, Z., Lin, Z., & Qi, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00817 · Cited by 379
Luminosity and contrast normalization in retinal images
Foracchia, M., Grisan, E., & Ruggeri, A. (2005) · Medical Image Analysis · doi:10.1016/j.media.2004.07.001 · Cited by 322
Joint Distribution Matters: Deep Brownian Distance Covariance for Few-Shot Classification
Xie, J., Long, F., Lv, J., Wang, Q., & Li, P. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00781 · Cited by 302
CS-Net: Channel and Spatial Attention Network for Curvilinear Structure Segmentation
Mou, L., Zhao, Y., Chen, L., Cheng, J., Gu, Z., Hao, H., Qi, H., Zheng, Y., Frangi, A., & Liu, J. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-32239-7_80 · Cited by 274
StyleSwin: Transformer-based GAN for High-resolution Image Generation
Zhang, B., Gu, S., Zhang, B., Bao, J., Chen, D., Wen, F., Wang, Y., & Guo, B. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01102 · Cited by 247
Self-citationCrossNet: An End-to-End Reference-Based Super Resolution Network Using Cross-Scale Warping
Zheng, H., Ji, M., Wang, H., Liu, Y., & Fang, L. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01231-1_6 · Cited by 244
Color retinal image enhancement using CLAHE
Setiawan, A. W., Mengko, T. R., Santoso, O. S., & Suksmono, A. B. (2013) · International Conference on ICT for Smart Society · doi:10.1109/ictss.2013.6588092 · Cited by 235
Evaluation of Retinal Image Quality Assessment Networks in Different Color-Spaces
Fu, H., Wang, B., Shen, J., Cui, S., Xu, Y., Liu, J., & Shao, L. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-32239-7_6 · Cited by 231
Dual Adversarial Network: Toward Real-World Noise Removal and Noise Generation
Yue, Z., Zhao, Q., Zhang, L., & Meng, D. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58607-2_3 · Cited by 229
Progressively Normalized Self-Attention Network for Video Polyp Segmentation
Ji, G.-P., Chou, Y.-C., Fan, D.-P., Chen, G., Fu, H., Jha, D., & Shao, L. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87193-2_14 · Cited by 226
Structure and Illumination Constrained GAN for Medical Image Enhancement
Ma, Y., Liu, J., Liu, Y., Fu, H., Hu, Y., Cheng, J., Qi, H., Wu, Y., Zhang, J., & Zhao, Y. (2021) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2021.3101937 · Cited by 220
Modeling and Enhancing Low-Quality Retinal Fundus Images
Shen, Z., Fu, H., Shen, J., & Shao, L. (2021) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.3043495 · Cited by 219
He, C.-M., Li, K., Zhang, Y.-C., Xu, G.-X., Tang, L.-X., Zhang, Y., Guo, Z., & Li, X. (2023) · Neural Information Processing Systems · doi:10.48550/arxiv.2305.11003 · Cited by 217
Self-citationADN: Artifact Disentanglement Network for Unsupervised Metal Artifact Reduction
Liao, H., Lin, W.-A., Zhou, S. K., & Luo, J. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2933425 · Cited by 206
Perturbed Self-Distillation: Weakly Supervised Large-Scale Point Cloud Semantic Segmentation
Zhang, Y., Qu, Y., Xie, Y., Li, Z., Zheng, S., & Li, C. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01523 · Cited by 200
Self-citationRobust Reference-based Super-Resolution via C 2 -Matching
Jiang, Y., Chan, K. C. K., Wang, X., Loy, C. C., & Liu, Z. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00214 · Cited by 182
MASA-SR: Matching Acceleration and Spatial Adaptation for Reference-Based Image Super-Resolution
Lu, L., Li, W., Tao, X., Lu, J., & Jia, J. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00630 · Cited by 176
Robust Reference-Based Super-Resolution With Similarity-Aware Deformable Convolution
Shim, G., Park, J., & Kweon, I. S. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00845 · Cited by 157
IDRLP: Image Dehazing Using Region Line Prior
Ju, M., Ding, C., Guo, C. A., Ren, W., & Tao, D. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3122088 · Cited by 124
He, C., Li, K., Zhang, Y., Zhang, Y., Guo, Z., Li, X., Danelljan, M., & Yu, F. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2308.03166 · Cited by 102
Self-citationA Novel Geometric Framework on Gram Matrix Trajectories for Human Behavior Understanding
Kacem, A., Daoudi, M., Amor, B. B., Berretti, S., & Alvarez-Paiva, J. C. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2872564 · Cited by 96
Study Group Learning: Improving Retinal Vessel Segmentation Trained with Noisy Labels
Zhou, Y., Yu, H., & Shi, H. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87193-2_6 · Cited by 95
Bilevel Optimization with Nonsmooth Lower Level Problems
Ochs, P., Ranftl, R., Brox, T., & Pock, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-18461-6_52 · Cited by 94
Memorizing Structure-Texture Correspondence for Image Anomaly Detection
Zhou, K. Q., Li, J., Xiao, Y., Yang, J., Cheng, J. T., Liu, W., Luo, W., Liu, J., & Gao, S. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3101403 · Cited by 84
He, C., Li, K., Zhang, Y., Xu, G., Tang, L., Zhang, Y., Guo, Z., & Li, X. (2023) · neural information processing systems · doi:10.52202/075280-1339 · Cited by 82
Self-citationAutomatic Searching and Pruning of Deep Neural Networks for Medical Imaging Diagnostic
Fernandes, F. E., & Yen, G. G. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3027308 · Cited by 79
Xu, L., Wu, H. M., He, C., Wang, J., Zhang, C., Nie, F., & Chen, L. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102643 · Cited by 62
Self-citationHe, Y., Ge, R., Qi, X., Chen, Y., Wu, J., Coatrieux, J.-L., Yang, G., & Li, S. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3190452 · Cited by 59
DM-Fusion: Deep Model-Driven Network for Heterogeneous Image Fusion
Xu, G., He, C., Wang, H., Zhu, H., & Ding, W. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3238511 · Cited by 57
Self-citationOversampling for Imbalanced Data via Optimal Transport
Yan, Y., Tan, M., Xu, Y., Cao, J., Ng, M. K., Min, H., & Wu, Q. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33015605 · Cited by 56
Automated Tortuosity Analysis of Nerve Fibers in Corneal Confocal Microscopy
Zhao, Y., Zhang, J., Pereira, E., Zheng, Y., Su, P., Xie, J., Zhao, Y., Shi, Y., Qi, H., Liu, J., et al. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.2974499 · Cited by 50
HRENet: A Hard Region Enhancement Network for Polyp Segmentation
Shen, Y., Jia, X., & Meng, M. Q. ‐. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87193-2_53 · Cited by 48
PcGAN: A Noise Robust Conditional Generative Adversarial Network for One Shot Learning
Deng, L., He, C., Xu, G., Zhu, H., & Wang, H. H. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3199805 · Cited by 27
Self-citationUnpaired Cartoon Image Synthesis via Gated Cycle Mapping
Men, Y., Yao, Y., Cui, M., Lian, Z., Xie, X., & Hua, X. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00349 · Cited by 27
Efficient Top-K Feature Selection Using Coordinate Descent Method
Xu, L., Wang, R., Nie, F., & Li, X. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i9.26258 · Cited by 27
Self-citationA Deep Convolutional Gated Recurrent Unit for CT Image Reconstruction
Ikuta, M., & Zhang, J. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3169569 · Cited by 26
Learning All-In Collaborative Multiview Binary Representation for Clustering
Zhang, Y., Xie, Y., Li, C., Wu, Z., & Qu, Y. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3202102 · Cited by 24
Self-citationJu, M., He, C., Liu, J., Kang, B., Su, J. D., & Zhang, D. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3210693 · Cited by 24
Self-citationTask-Oriented Convex Bilevel Optimization With Latent Feasibility
Liu, R., Ma, L., Yuan, X., Zeng, S., & Zhang, J. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3140607 · Cited by 23
HealthNet: A Health Progression Network via Heterogeneous Medical Information Fusion
Yu, F., Cui, L., Chen, H., Cao, Y., Liu, N., Huang, W., Xu, Y., & Lu, H. C. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3202305 · Cited by 20
DeepGrading: Deep Learning Grading of Corneal Nerve Tortuosity
Mou, L., Qi, H., Liu, Y., Zheng, Y., Matthew, P. W., Su, P., Liu, J., Zhang, J., & Zhao, Y. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3156906 · Cited by 17
Image Threshold Segmentation Based on GLLE Histogram
He, C., Wang, X., Deng, L., & Xu, G. (2019) · IEEE International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData) · doi:10.1109/ithings/greencom/cpscom/smartdata.2019.00088 · Cited by 16
Self-citationContent-Aware Enhancement of Images With Filamentous Structures
Jeelani, H., Liang, H., Acton, S. T., & Weller, D. S. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2897289 · Cited by 7
Cited by
DDFM: Denoising Diffusion Model for Multi-Modality Image Fusion
Zhao, Z., Bai, H., Zhu, Y., Zhang, J., Xu, S., Zhang, Y., Zhang, K., Meng, D., Timofte, R., & Van Gool, L. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00742 · Cited by 431
Self-citationSynthetic data generation methods in healthcare: A review on open-source tools and methods
Pezoulas, V. C., Zaridis, D. I., Mylona, E., Androutsos, C., Apostolidis, K., Tachos, N. S., & Fotiadis, D. I. (2024) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2024.07.005 · Cited by 263
Adaptive Rotated Convolution for Rotated Object Detection
Pu, Y., Wang, Y., Xia, Z., Han, Y., Wang, Y., Gan, W., Wang, Z., Song, S., & Huang, G. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00606 · Cited by 195
Self-citationDiffusion Models in Low-Level Vision: A Survey
He, C., Shen, Y., Fang, C., Xiao, F., Tang, L., Zhang, Y., Zuo, W., Guo, Z., & Li, X. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3545047 · Cited by 208
Self-citationA degradation-aware guided fusion network for infrared and visible image
Wang, X., Guan, Z., Qian, W., Cao, J., Ma, R., & Bi, C. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.102931 · Cited by 76
Metadata
- Authors
- He, C., Li, K., Xu, G., Yan, J., Tang, L., Zhang, Y., Wang, Y., & Li, X.
- Affiliations
- Tsinghua Shenzhen International Graduate School (CN)
- Machine Learning Department, NEC Laboratories America Inc., Princeton, NJ, USA
- Norwegian University of Science and Technology (NO)
- ETH Zurich (CH)
- Peng Cheng Laboratory (CN)
- Venue
- IEEE Transactions on Neural Networks and Learning Systems
- Published
- 2024-12
- Volume
- 35
- Issue
- 12
- Pages
- 18404-18418
- ISSN
- 2162-237X (ISSN-L)
- 2162-2388
- OpenAlex
- W4387385597
- Cited by
- 54
- References
- 59
- Citations by year
- 2026: 13 · 2025: 19 · 2024: 15
- FWCI
- 4.91
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Neural Networks and Learning Systems (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Key Research and Development Program of China (2020AAA0108303)
- Shenzhen Science and Technology Project (JCYJ20200109143041798)
- Shenzhen Stable Supporting Program (WDZC20200820200655001)
- Shenzhen Key Laboratory of Next Generation Interactive Media Innovative Technology (ZDSYS 20210623092001004)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Enhancement Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image Processing Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Keywords
- adversarial training, downstream task performance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.