Underwater scene prior inspired deep underwater image and video enhancement
The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Abstract
In underwater scenes, wavelength-dependent light absorption and scattering degrade the visibility of images and videos. The degraded underwater images and videos affect the accuracy of pattern recognition, visual understanding, and key feature extraction in underwater scenes. In this paper, we propose an underwater image enhancement convolutional neural network (CNN) model based on underwater scene prior, called UWCNN. Instead of estimating the parameters of underwater imaging model, the proposed UWCNN model directly reconstructs the clear latent underwater image, which benefits from the underwater scene prior which can be used to synthesize underwater image training data. Besides, based on the light-weight network structure and effective training data, our UWCNN model can be easily extended to underwater videos for frame-by-frame enhancement. Specifically, combining an underwater imaging physical model with optical properties of underwater scenes, we first synthesize underwater image degradation datasets which cover a diverse set of water types and degradation levels. Then, a light-weight CNN model is designed for enhancing each underwater scene type, which is trained by the corresponding training data. At last, this UWCNN model is directly extended to underwater video enhancement. Experiments on real-world and synthetic underwater images and videos demonstrate that our method generalizes well to different underwater scenes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Single image haze removal using dark channel prior
He, K., Sun, J., & Tang, X. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.168 · Cited by 7,601
Recent advances in convolutional neural networks
Gu, J., Wang, Z., Kuen, J., Ma, L., Shahroudy, A., Shuai, B., Liu, T., Wang, X., Wang, G., Cai, J., et al. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.10.013 · Cited by 6,576
Indoor segmentation and support inference from rgbd images
Silberman, N., Hoiem, D., Kohli, P., & Fergus, R. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33715-4_54 · Cited by 5,760
An Underwater Image Enhancement Benchmark Dataset and Beyond
Li, C., Guo, C., Ren, W., Cong, R., Hou, J., Kwong, S., & Tao, D. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2955241 · Cited by 2,373
Self-citationLLNet: A deep autoencoder approach to natural low-light image enhancement
Lore, K. G., Akintayo, A., & Sarkar, S. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2016.06.008 · Cited by 1,951
Human-Visual-System-Inspired Underwater Image Quality Measures
Panetta, K., Gao, C., & Agaian, S. (2016) · IEEE Journal of Oceanic Engineering · doi:10.1109/joe.2015.2469915 · Cited by 1,718
Wider or Deeper: Revisiting the ResNet Model for Visual Recognition
Wu, Z., Shen, C., & van den Hengel, A. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2019.01.006 · Cited by 1,589
An Underwater Color Image Quality Evaluation Metric
Yang, M., & Sowmya, A. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2491020 · Cited by 1,569
Color balance and fusion for underwater image enhancement
Ancuti, C. O., Ancuti, C., De Vleeschouwer, C., & Bekaert, P. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2759252 · Cited by 1,357
Underwater Image Restoration Based on Image Blurriness and Light Absorption
Peng, Y.-T., & Cosman, P. C. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2663846 · Cited by 1,250
Underwater Image Enhancement by Wavelength Compensation and Dehazing
Chiang, J. Y., & Chen, Y.-C. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2179666 · Cited by 1,225
Enhancing underwater images and videos by fusion
Ancuti, C., Ancuti, C. O., Haber, T., & Bekaert, P. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247661 · Cited by 1,086
Automatic Red-Channel underwater image restoration
Galdran, A., Pardo, D., Picón, A., & Alvarez-Gila, A. (2015) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2014.11.006 · Cited by 995
Li, C.-Y., Guo, J.-C., Cong, R.-M., Pang, Y.-W., & Wang, B. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2612882 · Cited by 924
Self-citationLopes, A. T., de Aguiar, E., De Souza, A. F., & Oliveira-Santos, T. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2016.07.026 · Cited by 799
Underwater Depth Estimation and Image Restoration Based on Single Images
Drews, P. L. J., Nascimento, E. R., Botelho, S. S. C., & Montenegro Campos, M. F. (2016) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2016.26 · Cited by 739
Deep Visual Attention Prediction
Wang, W., & Shen, J. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2787612 · Cited by 585
Emerging From Water: Underwater Image Color Correction Based on Weakly Supervised Color Transfer
Li, C., Guo, J., & Guo, C. (2018) · IEEE Signal Processing Letters · doi:10.1109/lsp.2018.2792050 · Cited by 531
Self-citationUnderwater Image Enhancement Using a Multiscale Dense Generative Adversarial Network
Guo, Y., Li, H., & Zhuang, P. (2020) · IEEE Journal of Oceanic Engineering · doi:10.1109/joe.2019.2911447 · Cited by 508
Pyramid Dilated Deeper ConvLSTM for Video Salient Object Detection
Song, H., Wang, W., Zhao, S., Shen, J., & Lam, K.-M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01252-6_44 · Cited by 492
Fingerprint enhancement using STFT analysis
Chikkerur, S., Cartwright, A. N., & Govindaraju, V. (2007) · Pattern Recognition · doi:10.1016/j.patcog.2006.05.036 · Cited by 389
Revisiting Video Saliency: A Large-Scale Benchmark and a New Model
Wang, W., Shen, J., Guo, F., Cheng, M.-M., & Borji, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00514 · Cited by 268
Wang, W., Xu, Y., Shen, J., & Zhu, S.-C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00449 · Cited by 241
A hybrid method for underwater image correction
Li, C., Guo, J., Guo, C., Cong, R., & Gong, J. (2017) · Pattern Recognition Letters · doi:10.1016/j.patrec.2017.05.023 · Cited by 220
Self-citationShen, Z., Lai, W.-S., Xu, T., Kautz, J., & Yang, M.-H. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00862 · Cited by 213
Super-resolution of human face image using canonical correlation analysis
Huang, H., He, H., Fan, X., & Zhang, J. (2010) · Pattern Recognition · doi:10.1016/j.patcog.2010.02.007 · Cited by 212
Hierarchical Features Driven Residual Learning for Depth Map Super-Resolution
Guo, C., Li, C., Guo, J., Cong, R., Fu, H., & Han, P. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2887029 · Cited by 193
Self-citationPDR-Net: Perception-Inspired Single Image Dehazing Network With Refinement
Li, C., Guo, C., Guo, J., Han, P., Fu, H., & Cong, R. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2933334 · Cited by 170
Self-citationAttention driven person re-identification
Yang, F., Yan, K., Lu, S., Jia, H., Xie, X., & Gao, W. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2018.08.015 · Cited by 166
Semi-Supervised Video Object Segmentation with Super-Trajectories
Wang, W., Shen, J., Porikli, F., & Yang, R. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2819173 · Cited by 161
Self-citationUnderwater image enhancement by dehazing and color correction
Li, C., & Guo, J. (2015) · Journal of Electronic Imaging · doi:10.1117/1.jei.24.3.033023 · Cited by 108
Self-citationLi, C., Guo, J., Chen, S., Tang, Y., Pang, Y., & Wang, J. (2016) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2016.7532707 · Cited by 94
Self-citationSheinin, M., & Schechner, Y. Y. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.409 · Cited by 63
Multi-label learning of part detectors for occluded pedestrian detection
Zhou, C., & Yuan, J. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2018.08.018 · Cited by 33
Cited by
An Underwater Image Enhancement Benchmark Dataset and Beyond
Li, C., Guo, C., Ren, W., Cong, R., Hou, J., Kwong, S., & Tao, D. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2955241 · Cited by 2,373
Self-citationUnderwater Image Enhancement via Medium Transmission-Guided Multi-Color Space Embedding
Li, C., Anwar, S., Hou, J., Cong, R., Guo, C., & Ren, W. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3076367 · Cited by 1,033
Self-citationU-Shape Transformer for Underwater Image Enhancement
Peng, L., Zhu, C., & Bian, L. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3276332 · Cited by 912
Underwater Image Enhancement via Minimal Color Loss and Locally Adaptive Contrast Enhancement
Zhang, W., Zhuang, P., Sun, H.-H., Li, G., Kwong, S., & Li, C. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3177129 · Cited by 888
Self-citationUnderwater Image Enhancement With Hyper-Laplacian Reflectance Priors
Zhuang, P., Wu, J., Porikli, F., & Li, C. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3196546 · Cited by 529
Self-citation
Metadata
- Authors
- Li, C., Anwar, S., & Porikli, F.
- Venue
- Pattern Recognition
- Publisher
- Elsevier BV
- Published
- 2020-02
- Volume
- 98
- Pages
- 107038
- ISSN
- 0031-3203 (ISSN-L)
- OpenAlex
- W2971483169
- Cited by
- 1,252
- References
- 36
- FWCI
- 31.39
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.