The DOI matches its Crossref record; 58 of the 58 references it cites were found in a registry or an index.
Twin Adversarial Contrastive Learning for Underwater Image Enhancement and Beyond
Abstract
Underwater images suffer from severe distortion, which degrades the accuracy of object detection performed in an underwater environment. Existing underwater image enhancement algorithms focus on the restoration of contrast and scene reflection. In practice, the enhanced images may not benefit the effectiveness of detection and even lead to a severe performance drop. In this paper, we propose an object-guided twin adversarial contrastive learning based underwater enhancement method to achieve both visual-friendly and task-orientated enhancement. Concretely, we first develop a bilateral constrained closed-loop adversarial enhancement module, which eases the requirement of paired data with the unsupervised manner and preserves more informative features by coupling with the twin inverse mapping. In addition, to confer the restored images with a more realistic appearance, we also adopt the contrastive cues in the training phase. To narrow the gap between visually-oriented and detection-favorable target images, a task-aware feedback module is embedded in the enhancement process, where the coherent gradient information of the detector is incorporated to guide the enhancement towards the detection-pleasing direction. To validate the performance, we allocate a series of prolific detectors into our framework. Extensive experiments demonstrate that the enhanced results of our method show remarkable amelioration in visual quality, the accuracy of different detectors conducted on our enhanced images has been promoted notably. Moreover, we also conduct a study on semantic segmentation to illustrate how object guidance improves high-level tasks. Code and models are available at https://github.com/Jzy2017/TACL.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.322 · Cited by 29,137
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
YOLO9000: Better, Faster, Stronger
Redmon, J., & Farhadi, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.690 · Cited by 19,892
A Multi-Modal Distributed Real-Time IoT System for Urban Traffic Control (Invited Paper)
Khanam, Z., Achari, V. P. S., Boukhennoufa, I., Jindal, A., & Singh, A. K. (2024) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/oasics.ng-res.2024.2 · Cited by 14,040
Perceptual Losses for Real-Time Style Transfer and Super-Resolution
Johnson, J., Alahi, A., & Fei-Fei, L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_43 · Cited by 11,283
YOLOv4: Optimal Speed and Accuracy of Object Detection
Bochkovskiy, A., Wang, C.-Y., & Liao, H.-Y. M. (2020) · arXiv · doi:10.48550/arxiv.2004.10934 · Cited by 10,307
Focal Loss for Dense Object Detection
Lin, T.-Y., Goyal, P., Girshick, R., He, K., & Dollar, P. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2858826 · Cited by 9,556
Martin, D., Fowlkes, C., Tal, D., & Malik, J. (2002) · Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001 · doi:10.1109/iccv.2001.937655 · Cited by 8,216
Single image haze removal using dark channel prior
He, K., Sun, J., & Tang, X. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.168 · Cited by 7,601
Generalized Intersection Over Union: A Metric and a Loss for Bounding Box Regression
Rezatofighi, H., Tsoi, N., Gwak, J., Sadeghian, A., Reid, I., & Savarese, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00075 · Cited by 6,612
Generative Image Inpainting with Contextual Attention
Yu, J., Lin, Z., Yang, J., Shen, X., Lu, X., & Huang, T. S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00577 · Cited by 2,527
An Underwater Image Enhancement Benchmark Dataset and Beyond
Li, C., Guo, C., Ren, W., Cong, R., Hou, J., Kwong, S., & Tao, D. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2955241 · Cited by 2,373
Human-Visual-System-Inspired Underwater Image Quality Measures
Panetta, K., Gao, C., & Agaian, S. (2016) · IEEE Journal of Oceanic Engineering · doi:10.1109/joe.2015.2469915 · Cited by 1,718
Fast Underwater Image Enhancement for Improved Visual Perception
Islam, M. J., Xia, Y., & Sattar, J. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.2974710 · Cited by 1,675
Sparse R-CNN: End-to-End Object Detection with Learnable Proposals
Sun, P., Zhang, R., Jiang, Y., Kong, T., Xu, C., Zhan, W., Tomizuka, M., Li, L., Yuan, Z., Wang, C., et al. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01422 · Cited by 1,617
An Underwater Color Image Quality Evaluation Metric
Yang, M., & Sowmya, A. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2491020 · Cited by 1,569
Contrastive Learning for Unpaired Image-to-Image Translation
Park, T., Efros, A. A., Zhang, R., & Zhu, J.-Y. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58545-7_19 · Cited by 1,442
Bottleneck Transformers for Visual Recognition
Srinivas, A., Lin, T.-Y., Parmar, N., Shlens, J., Abbeel, P., & Vaswani, A. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01625 · Cited by 1,385
Color balance and fusion for underwater image enhancement
Ancuti, C. O., Ancuti, C., De Vleeschouwer, C., & Bekaert, P. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2759252 · Cited by 1,357
Liu, J., Fan, X., Huang, Z., Wu, G., Liu, R., Zhong, W., & Luo, Z. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00571 · Cited by 1,336
Self-citationUnderwater scene prior inspired deep underwater image and video enhancement
Li, C., Anwar, S., & Porikli, F. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2019.107038 · Cited by 1,252
Underwater Image Enhancement by Wavelength Compensation and Dehazing
Chiang, J. Y., & Chen, Y.-C. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2179666 · Cited by 1,225
Enhancing underwater images and videos by fusion
Ancuti, C., Ancuti, C. O., Haber, T., & Bekaert, P. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247661 · Cited by 1,086
Underwater Image Enhancement via Medium Transmission-Guided Multi-Color Space Embedding
Li, C., Anwar, S., Hou, J., Cong, R., Guo, C., & Ren, W. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3076367 · Cited by 1,033
Data-Efficient Image Recognition with Contrastive Predictive Coding
Hénaff, O. J., Srinivas, A., De Fauw, J., Razavi, A., Doersch, C., Eslami, S. M. A., & Oord, A. V. D. (2019) · arXiv · doi:10.48550/arxiv.1905.09272 · Cited by 1,014
Automatic Red-Channel underwater image restoration
Galdran, A., Pardo, D., Picón, A., & Alvarez-Gila, A. (2015) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2014.11.006 · Cited by 995
Contrastive Learning for Compact Single Image Dehazing
Wu, H., Qu, Y., Lin, S., Zhou, J., Qiao, R., Zhang, Z., Xie, Y., & Ma, L. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01041 · Cited by 926
Li, C.-Y., Guo, J.-C., Cong, R.-M., Pang, Y.-W., & Wang, B. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2612882 · Cited by 924
Real-World Underwater Enhancement: Challenges, Benchmarks, and Solutions Under Natural Light
Liu, R., Fan, X., Zhu, M., Hou, M., & Luo, Z. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2019.2963772 · Cited by 863
Self-citationGeneralization of the Dark Channel Prior for Single Image Restoration
Peng, Y.-T., Cao, K., & Cosman, P. C. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2813092 · Cited by 845
Attentive Generative Adversarial Network for Raindrop Removal from A Single Image
Qian, R., Tan, R. T., Yang, W., Su, J., & Liu, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00263 · Cited by 821
Underwater Depth Estimation and Image Restoration Based on Single Images
Drews, P. L. J., Nascimento, E. R., Botelho, S. S. C., & Montenegro Campos, M. F. (2016) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2016.26 · Cited by 739
Dynamic R-CNN: Towards High Quality Object Detection via Dynamic Training
Zhang, H., Chang, H., Ma, B., Wang, N., & Chen, X. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58555-6_16 · Cited by 651
Underwater Single Image Color Restoration Using Haze-Lines and a New Quantitative Dataset
Berman, D., Levy, D., Avidan, S., & Treibitz, T. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2977624 · Cited by 608
Underwater Image Enhancement Using a Multiscale Dense Generative Adversarial Network
Guo, Y., Li, H., & Zhuang, P. (2020) · IEEE Journal of Oceanic Engineering · doi:10.1109/joe.2019.2911447 · Cited by 508
MaX-DeepLab: End-to-End Panoptic Segmentation with Mask Transformers
Wang, H., Zhu, Y., Adam, H., Yuille, A., & Chen, L.-C. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00542 · Cited by 497
Bayesian retinex underwater image enhancement
Zhuang, P., Li, C., & Wu, J. (2021) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2021.104171 · Cited by 434
Learning a Deep Multi-Scale Feature Ensemble and an Edge-Attention Guidance for Image Fusion
Liu, J., Fan, X., Jiang, J., Liu, R., & Luo, Z. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3056725 · Cited by 431
Self-citationSemantic Segmentation of Underwater Imagery: Dataset and Benchmark
Islam, M. J., Edge, C., Xiao, Y., Luo, P., Mehtaz, M., Morse, C., Enan, S. S., & Sattar, J. (2020) · 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9340821 · Cited by 310
AutoGAN: Neural Architecture Search for Generative Adversarial Networks
Gong, X., Chang, S., Jiang, Y., & Wang, Z. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00332 · Cited by 305
Amortised MAP Inference for Image Super-resolution
Sønderby, C. K., Caballero, J., Theis, L., Shi, W., & Huszár, F. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.04490 · Cited by 300
Target Oriented Perceptual Adversarial Fusion Network for Underwater Image Enhancement
Jiang, Z., Li, Z., Yang, S., Fan, X., & Liu, R. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3174817 · Cited by 297
Self-citationA Fusion Adversarial Underwater Image Enhancement Network with a Public Test DatasetPreprint
Li, H., Li, J., & Wang, W. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.06819 · Cited by 249
A hybrid method for underwater image correction
Li, C., Guo, J., Guo, C., Cong, R., & Gong, J. (2017) · Pattern Recognition Letters · doi:10.1016/j.patrec.2017.05.023 · Cited by 220
Single Underwater Image Restoration Using Adaptive Attenuation-Curve Prior
Wang, Y., Liu, H., & Chau, L.-P. (2018) · IEEE Transactions on Circuits and Systems I: Regular Papers · doi:10.1109/tcsi.2017.2751671 · Cited by 200
Perceptual Underwater Image Enhancement With Deep Learning and Physical Priors
Chen, L., Jiang, Z., Tong, L., Liu, Z., Zhao, A., Zhang, Q., Dong, J., & Zhou, H. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.3035108 · Cited by 191
Self-citationUnderwater Image Enhancement Using Adaptive Retinal Mechanisms
Gao, S.-B., Zhang, M., Zhao, Q., Zhang, X.-S., & Li, Y.-J. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2919947 · Cited by 165
A Bilevel Integrated Model With Data-Driven Layer Ensemble for Multi-Modality Image Fusion
Liu, R., Liu, J., Jiang, Z., Fan, X., & Luo, Z. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3043125 · Cited by 165
Self-citationSROBB: Targeted Perceptual Loss for Single Image Super-Resolution
Rad, M. S., Bozorgtabar, B., Marti, U.-V., Basler, M., Ekenel, H. K., & Thiran, J.-P. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00280 · Cited by 163
Attention-Guided Global-Local Adversarial Learning for Detail-Preserving Multi-Exposure Image Fusion
Liu, J., Shang, J., Liu, R., & Fan, X. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3144455 · Cited by 159
Self-citationGhani, A. S. A., & Isa, N. A. M. (2017) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2017.07.021 · Cited by 122
Underwater Image Enhancement based on Deep Learning and Image Formation ModelPreprint
Chen, X., Zhang, P., Quan, L., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.00991 · Cited by 50
Cited by
Underwater Image Enhancement via Weighted Wavelet Visual Perception Fusion
Zhang, W., Zhou, L., Zhuang, P., Li, G., Pan, X., Zhao, W., & Li, C. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3299314 · Cited by 406
Underwater Image Enhancement Method via Multi-Interval Subhistogram Perspective Equalization
Zhou, J., Pang, L., Zhang, D., & Zhang, W. (2023) · IEEE Journal of Oceanic Engineering · doi:10.1109/joe.2022.3223733 · Cited by 257
Metadata
- Authors
- Liu, R., Jiang, Z., Yang, S., & Fan, X.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2022
- Volume
- 31
- Pages
- 4922-4936
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W4285821234
- Cited by
- 390
- References
- 58
- FWCI
- 24.93
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.