The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
WaterGAN: Unsupervised Generative Network to Enable Real-time Color Correction of Monocular Underwater Images
Open accessAbstract
This letter reports on WaterGAN, a generative adversarial network (GAN) for generating realistic underwater images from in-air image and depth pairings in an unsupervised pipeline used for color correction of monocular underwater images. Cameras onboard autonomous and remotely operated vehicles can capture high-resolution images to map the seafloor; however, underwater image formation is subject to the complex process of light propagation through the water column. The raw images retrieved are characteristically different than images taken in air due to effects, such as absorption and scattering, which cause attenuation of light at different rates for different wavelengths. While this physical process is well described theoretically, the model depends on many parameters intrinsic to the water column as well as the structure of the scene. These factors make recovery of these parameters difficult without simplifying assumptions or field calibration; hence, restoration of underwater images is a nontrivial problem. Deep learning has demonstrated great success in modeling complex nonlinear systems but requires a large amount of training data, which is difficult to compile in deep sea environments. Using WaterGAN, we generate a large training dataset of corresponding depth, in-air color images, and realistic underwater images. These data serve as input to a two-stage network for color correction of monocular underwater images. Our proposed pipeline is validated with testing on real data collected from both a pure water test tank and from underwater surveys collected in the field. Source code, sample datasets, and pretrained models are made publicly available.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation
Badrinarayanan, V., Kendall, A., & Cipolla, R. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2644615 · Cited by 19,631
Unsupervised representation learning with deep convolutional generative adversarial networks
Radford, A., Metz, L., & Chintala, S. (2015) · arXiv · doi:10.48550/arxiv.1511.06434 · Cited by 12,235
Computer modeling and the design of optimal underwater imaging systems
Jaffe, J. S. (1990) · IEEE Journal of Oceanic Engineering · doi:10.1109/48.50695 · Cited by 1,034
Scene Coordinate Regression Forests for Camera Relocalization in RGB-D Images
Shotton, J., Glocker, B., Zach, C., Izadi, S., Criminisi, A., & Fitzgibbon, A. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.377 · Cited by 930
Transmission Estimation in Underwater Single Images
Drews Jr, P., do Nascimento, E., Moraes, F., Botelho, S., & Campos, M. (2013) · 2013 IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2013.113 · Cited by 866
Underwater Depth Estimation and Image Restoration Based on Single Images
Drews, P. L. J., Nascimento, E. R., Botelho, S. S. C., & Montenegro Campos, M. F. (2016) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2016.26 · Cited by 739
Initial results in underwater single image dehazing
Carlevaris-Bianco, N., Mohan, A., & Eustice, R. M. (2010) · OCEANS 2010 MTS/IEEE SEATTLE · doi:10.1109/oceans.2010.5664428 · Cited by 483
Self-citationIndoor scene segmentation using a structured light sensor
Silberman, N., & Fergus, R. (2011) · 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops) · doi:10.1109/iccvw.2011.6130298 · Cited by 480
Unsupervised feature learning for 3D scene labeling
Lai, K., Bo, L., & Fox, D. (2014) · 2014 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2014.6907298 · Cited by 317 · cited 1×
“As input in-air RGB-D for all experiments, we compile four indoor Kinect datasets (B3DO [22], UW RGB-D Object [23], NYU Depth [24] and Microsoft 7-scenes [25]) for a total of 15000 RGB-D images.”
MethodA category-level 3-D object dataset: Putting the Kinect to work
Janoch, A., Karayev, S., Jia, Y., Barron, J. T., Fritz, M., Saenko, K., & Darrell, T. (2011) · 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops) · doi:10.1109/iccvw.2011.6130382 · Cited by 250
Supervised Learning of Image Restoration with Convolutional Networks
Jain, V., Murray, J. F., Roth, F., Turaga, S., Zhigulin, V., Briggman, K. L., Helmstaedter, M. N., Denk, W., & Seung, H. S. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4408909 · Cited by 217
True Color Correction of Autonomous Underwater Vehicle Imagery
Bryson, M., Johnson‐Roberson, M., Pizarro, O. R., et al. (2015) · Journal of Field Robotics · doi:10.1002/rob.21638 · Cited by 129
Self-citationEstimation of ambient light and transmission map with common convolutional architecture
Shin, Y.-S., Cho, Y., Pandey, G., & Kim, A. (2016) · MTS/IEEE OCEANS Conference (OCEANS) · doi:10.1109/oceans.2016.7761342 · Cited by 104
Colour-Consistent Structure-from-Motion Models using Underwater Imagery
Bryson, M., Johnson‐Roberson, M., Pizarro, O. R., et al. (2012) · doi:10.15607/rss.2012.viii.005 · Cited by 42
Self-citationRevisiting Image Vignetting Correction by Constrained Minimization of Log-Intensity Entropy
Lopez-Fuentes, L., Oliver, G., & Massanet, S. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-19222-2_38 · Cited by 27
Automatic color correction for 3D reconstruction of underwater scenes
Skinner, K. A., Iscar, E., & Johnson‐Roberson, M. (2017) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2017.7989601 · Cited by 24
Self-citationOut-of-Core Efficient Blending for Underwater Georeferenced Textured 3D Maps
Johnson‐Roberson, M., Bryson, M., Douillard, B., et al. (2013) · doi:10.1109/comgeo.2013.3 · Cited by 16
Self-citation
Cited by
U-Shape Transformer for Underwater Image Enhancement
Peng, L., Zhu, C., & Bian, L. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3276332 · Cited by 912
Underwater Image Enhancement via Minimal Color Loss and Locally Adaptive Contrast Enhancement
Zhang, W., Zhuang, P., Sun, H.-H., Li, G., Kwong, S., & Li, C. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3177129 · Cited by 888
Real-World Underwater Enhancement: Challenges, Benchmarks, and Solutions Under Natural Light
Liu, R., Fan, X., Zhu, M., Hou, M., & Luo, Z. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2019.2963772 · Cited by 863
Emerging From Water: Underwater Image Color Correction Based on Weakly Supervised Color Transfer
Li, C., Guo, J., & Guo, C. (2018) · IEEE Signal Processing Letters · doi:10.1109/lsp.2018.2792050 · Cited by 531
Underwater Image Enhancement With Hyper-Laplacian Reflectance Priors
Zhuang, P., Wu, J., Porikli, F., & Li, C. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3196546 · Cited by 529
Metadata
- Authors
- Li, J., Skinner, K. A., Eustice, R. M., & Johnson-Roberson, M.
- Venue
- IEEE Robotics and Automation Letters
- Published
- 2017
- Pages
- 1-1
- ISSN
- 2377-3766 (ISSN-L)
- 2377-3774
- OpenAlex
- W2593797484
- Cited by
- 397
- References
- 17
- FWCI
- 3.48
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.