The DOI matches its Crossref record; 70 of the 70 references it cites were found in a registry or an index.
Simultaneous Enhancement and Super-Resolution of Underwater Imagery for Improved Visual Perception
Open accessAbstract
In this paper, we introduce and tackle the simultaneous enhancement and super-resolution (SESR) problem for underwater robot vision and provide an efficient solution for near real-time applications.We present Deep SESR, a residualin-residual network-based generative model that can learn to restore perceptual image qualities at 2×, 3×, or 4× higher spatial resolution.We supervise its training by formulating a multi-modal objective function that addresses the chrominancespecific underwater color degradation, lack of image sharpness, and loss in high-level feature representation.It is also supervised to learn salient foreground regions in the image, which in turn guides the network to learn global contrast enhancement.We design an end-to-end training pipeline to jointly learn the saliency prediction and SESR on a shared hierarchical feature space for fast inference.Moreover, we present UFO-120, the first dataset to facilitate large-scale SESR learning; it contains over 1500 training samples and a benchmark test set of 120 samples.By thorough experimental evaluation on UFO-120 and several other standard datasets, we demonstrate that Deep SESR outperforms the existing solutions for underwater image enhancement and super-resolution.We also validate its generalization performance on several test cases that include underwater images with diverse spectral and spatial degradation levels, and also terrestrial images with unseen natural objects.Lastly, we analyze its computational feasibility for single-board deployments and demonstrate its operational benefits for visually-guided underwater robots.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
GAN（Generative Adversarial Nets）
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
(2010) · International Conference on Machine Learning · Cited by 13,995
Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network
Ledig, C., Theis, L., Huszar, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A., Tejani, A., Totz, J., Wang, Z., et al. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.19 · Cited by 12,696
TensorFlow: A system for large-scale machine learning
Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.08695 · Cited by 11,822
Perceptual Losses for Real-Time Style Transfer and Super-Resolution
Johnson, J., Alahi, A., & Fei-Fei, L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_43 · Cited by 11,283
Image Super-Resolution Using Deep Convolutional Networks
Dong, C., Loy, C. C., He, K., & Tang, X. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2439281 · Cited by 10,105
Accurate Image Super-Resolution Using Very Deep Convolutional Networks
Kim, J., Lee, J. K., & Lee, K. M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.182 · Cited by 7,870
Enhanced Deep Residual Networks for Single Image Super-Resolution
Lim, B., Son, S., Kim, H., Nah, S., & Lee, K. M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.151 · Cited by 7,736
Single image haze removal using dark channel prior
He, K., Sun, J., & Tang, X. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.168 · Cited by 7,601
(2017) · International Conference on Machine Learning · Cited by 6,382
“Least squares generative adversarial networks,”
Mao, X., Li, Q., Xie, H., Lau, R. Y. K., Wang, Z., & Smolley, S. P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.304 · Cited by 5,437
Image Quality Metrics: PSNR vs. SSIM
Hore, A., & Ziou, D. (2010) · 2010 20th International Conference on Pattern Recognition · doi:10.1109/icpr.2010.579 · Cited by 4,943
ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks
Wang, X., Yu, K., Wu, S., Gu, J., Liu, Y., Dong, C., Qiao, Y., & Loy, C. C. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-11021-5_5 · Cited by 4,731
Residual Dense Network for Image Super-Resolution
Zhang, Y., Tian, Y., Kong, Y., Zhong, B., & Fu, Y. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00262 · Cited by 4,168
DehazeNet: An End-to-End System for Single Image Haze Removal
Cai, B., Xu, X., Jia, K., Qing, C., & Tao, D. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2598681 · Cited by 3,367
On Single Image Scale-Up Using Sparse-Representations
Zeyde, R., Elad, M., & Protter, M. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-27413-8_47 · Cited by 3,352
A multiscale retinex for bridging the gap between color images and the human observation of scenes
Jobson, D. J., Rahman, Z., & Woodell, G. A. (1997) · IEEE Transactions on Image Processing · doi:10.1109/83.597272 · Cited by 3,036
Deeply-Recursive Convolutional Network for Image Super-Resolution
Kim, J., Lee, J. K., & Lee, K. M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.181 · Cited by 3,025
Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding
Bevilacqua, M., Roumy, A., Guillemot, C., & Morel, M.-L. A. (2012) · Procedings of the British Machine Vision Conference 2012 · doi:10.5244/c.26.135 · Cited by 2,701
An Underwater Image Enhancement Benchmark Dataset and Beyond
Li, C., Guo, C., Ren, W., Cong, R., Hou, J., Kwong, S., & Tao, D. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2955241 · Cited by 2,373
Human-Visual-System-Inspired Underwater Image Quality Measures
Panetta, K., Gao, C., & Agaian, S. (2016) · IEEE Journal of Oceanic Engineering · doi:10.1109/joe.2015.2469915 · Cited by 1,718
Fast Underwater Image Enhancement for Improved Visual Perception
Islam, M. J., Xia, Y., & Sattar, J. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.2974710 · Cited by 1,675
Self-citationImage Super-Resolution Using Dense Skip Connections
Tong, T., Li, G., Liu, X., & Gao, Q. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.514 · Cited by 1,373
Deep Learning for Single Image Super-Resolution: A Brief Review
Yang, W., Zhang, X., Tian, Y., Wang, W., Xue, J.-H., & Liao, Q. (2019) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2919431 · Cited by 1,154
Hierarchical Question-Image Co-Attention for Visual Question Answering
Lu, J., Yang, J., Batra, D., & Parikh, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.00061 · Cited by 1,129
Enhancing underwater images and videos by fusion
Ancuti, C., Ancuti, C. O., Haber, T., & Bekaert, P. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247661 · Cited by 1,086
EnhanceNet: Single Image Super-Resolution Through Automated Texture Synthesis
Sajjadi, M. S. M., Scholkopf, B., & Hirsch, M. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.481 · Cited by 1,058
Mean shift analysis and applications
Comaniciu, D., & Meer, P. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790416 · Cited by 987
Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network
Ledig, C., Theis, L., Huszár, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A. P., Tejani, A., Totz, J., Wang, Z., et al. (2016) · arXiv (Cornell University) · doi:10.17863/cam.51996 · Cited by 987
Fast and Accurate Single Image Super-Resolution via Information Distillation Network
Hui, Z., Wang, X., & Gao, X. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00082 · Cited by 955
Feedback Network for Image Super-Resolution
Li, Z., Yang, J., Liu, Z., Yang, X., Jeon, G., & Wu, W. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00399 · Cited by 883
Real-World Underwater Enhancement: Challenges, Benchmarks, and Solutions Under Natural Light
Liu, R., Fan, X., Zhu, M., Hou, M., & Luo, Z. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2019.2963772 · Cited by 863
Enhancing Underwater Imagery Using Generative Adversarial Networks
Fabbri, C., Islam, M. J., & Sattar, J. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8460552 · Cited by 808
Self-citationA no-reference objective image sharpness metric based on the notion of just noticeable blur (JNB)
Ferzli, R., & Karam, L. J. (2009) · IEEE Transactions on Image Processing · doi:10.1109/tip.2008.2011760 · Cited by 758
Sea-Thru: A Method for Removing Water From Underwater Images
Akkaynak, D., & Treibitz, T. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00178 · Cited by 625
Underwater Single Image Color Restoration Using Haze-Lines and a New Quantitative Dataset
Berman, D., Levy, D., Avidan, S., & Treibitz, T. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2977624 · Cited by 608
DSLR-Quality Photos on Mobile Devices with Deep Convolutional Networks
Ignatov, A., Kobyshev, N., Timofte, R., & Vanhoey, K. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.355 · Cited by 582
A retinex-based enhancing approach for single underwater image
Fu, X., Zhuang, P., Huang, Y., Liao, Y., Zhang, X.-P., & Ding, X. (2014) · 2014 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2014.7025927 · Cited by 573
Cheng, Z., Yang, Q., & Sheng, B. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.55 · Cited by 557
A Revised Underwater Image Formation Model
Akkaynak, D., & Treibitz, T. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00703 · Cited by 457
Enhancing the low quality images using Unsupervised Colour Correction Method
Iqbal, K., Odetayo, M. O., James, A. E., Salam, R. A., & Talib, A. Z. (2010) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2010.5642311 · Cited by 452
An improved Sobel edge detection
Gao, W., Zhang, X., Yang, L., & Liu, H. (2010) · 2010 3rd International Conference on Computer Science and Information Technology · doi:10.1109/iccsit.2010.5563693 · Cited by 452
Underwater image enhancement via extended multi-scale Retinex
Zhang, S., Wang, T., Dong, J., & Yu, H. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.03.029 · Cited by 443
Hierarchical Question-Image Co-Attention for Visual Question Answering
Lu, J. (2024) · TIB Data Manager · doi:10.57702/uhdmfu1r · Cited by 357
Huang, D., Wang, Y., Song, W., Sequeira, J., & Mavromatis, S. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-73603-7_37 · Cited by 308
Amortised MAP Inference for Image Super-resolution
Sønderby, C. K., Caballero, J., Theis, L., Shi, W., & Huszár, F. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.04490 · Cited by 300
Bingham, B. S., Foley, B., Singh, H., et al. (2010) · Journal of Field Robotics · doi:10.1002/rob.20350 · Cited by 250
A Fusion Adversarial Underwater Image Enhancement Network with a Public Test DatasetPreprint
Li, H., Li, J., & Wang, W. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.06819 · Cited by 249
Multi-level Attention Networks for Visual Question Answering
Yu, D., Fu, J., Mei, T., & Rui, Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.446 · Cited by 230
Underwater Image Enhancement With a Deep Residual Framework
Liu, P., Wang, G., Qi, H., Zhang, C., Zheng, H., & Yu, Z. (2019) · IEEE Access · doi:10.1109/access.2019.2928976 · Cited by 174
Super-resolution from internet-scale scene matching
Sun, L., & Hays, J. H. (2012) · IEEE International Conference on Computational Photography (ICCP) · doi:10.1109/iccphot.2012.6215221 · Cited by 156
Recurrent Mixture Density Network for Spatiotemporal Visual AttentionPreprint
Bazzani, L., Larochelle, H., & Torresani, L. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.08199 · Cited by 139
A Perceptual Image Sharpness Metric Based on Local Edge Gradient Analysis
Feichtenhofer, C., Fassold, H., & Schallauer, P. (2013) · IEEE Signal Processing Letters · doi:10.1109/lsp.2013.2248711 · Cited by 135
True Color Correction of Autonomous Underwater Vehicle Imagery
Bryson, M., Johnson‐Roberson, M., Pizarro, O. R., et al. (2015) · Journal of Field Robotics · doi:10.1002/rob.21638 · Cited by 129
Underwater Image Super-Resolution using Deep Residual Multipliers
Islam, J., Enan, S. S., Luo, P., & Sattar, J. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9197213 · Cited by 116
Self-citationUnderwater-GAN: Underwater Image Restoration via Conditional Generative Adversarial Network
Yu, X., Qu, Y., & Hong, M. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-05792-3_7 · Cited by 115
Model Assisted Multi-band Fusion for Single Image Enhancement and Applications to Robot Vision
Cho, Y., Jeong, J., & Kim, A. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2843127 · Cited by 95
Underwater Image Super-Resolution by Descattering and Fusion
Lu, H., Li, Y., Nakashima, S., Kim, H., & Serikawa, S. (2017) · IEEE Access · doi:10.1109/access.2017.2648845 · Cited by 91
Autonomous adaptive exploration using realtime online spatiotemporal topic modeling
Girdhar, Y., Giguère, P., & Dudek, G. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913507325 · Cited by 79
Underwater video enhancement using multi-camera super-resolution
Quevedo, E., Delory, E., Callicó, G. M., et al. (2017) · Optics Communications · doi:10.1016/j.optcom.2017.06.054 · Cited by 32
A Novel HVS Based Image Contrast Measurement Index
Trivedi, M., Jaiswal, A., & Bhateja, V. (2013) · Lecture notes in electrical engineering · doi:10.1007/978-81-322-1000-9_51 · Cited by 18
Underwater image feature extraction and matching based on visual saliency detection
Zhang, L., He, B., Song, Y., & Yan, T. (2016) · OCEANS 2016 - Shanghai · doi:10.1109/oceansap.2016.7485370 · Cited by 16
Potential Contrast – A New Image Quality Measure
Shaus, A., Faigenbaum-Golovin, S., Sober, B., & Turkel, E. (2017) · Electronic Imaging · doi:10.2352/issn.2470-1173.2017.12.iqsp-226 · Cited by 15
Robotic Visual Tracking of Relevant Cues in Underwater Environments with Poor Visibility Conditions
Maldonado-Ramírez, A., & Torres-Méndez, L. A. (2016) · Journal of Sensors · doi:10.1155/2016/4265042 · Cited by 11
Recovering Super-Resolution Generative Adversarial Network for Underwater Images
Chen, Y., Sun, J., Jiao, W., & Zhong, G. (2019) · Communications in computer and information science · doi:10.1007/978-3-030-36808-1_9 · Cited by 10
Metadata
- Authors
- Jahidul Islam, M., Luo, P., & Sattar, J.
- Venue
- Robotics: Science and Systems XVI
- Published
- 2020-07-12
- OpenAlex
- W3004469096
- Cited by
- 269
- References
- 70
- FWCI
- 8.76
- Type
- conference paper
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
