The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Heavy Rain Image Restoration: Integrating Physics Model and Conditional Adversarial Learning
Open accessAbstract
Most deraining works focus on rain streaks removal but they cannot deal adequately with heavy rain images. In heavy rain, streaks are strongly visible, dense rain accumulation or rain veiling effect significantly washes out the image, further scenes are relatively more blurry, etc. In this paper, we propose a novel method to address these problems. We put forth a 2-stage network: a physics-based backbone followed by a depth-guided GAN refinement. The first stage estimates the rain streaks, the transmission, and the atmospheric light governed by the underlying physics. To tease out these components more reliably, a guided filtering framework is used to decompose the image into its low- and high-frequency components. This filtering is guided by a rain-free residue image - its content is used to set the passbands for the two channels in a spatially-variant manner so that the background details do not get mixed up with the rain-streaks. For the second stage, the refinement stage, we put forth a depth-guided GAN to recover the background details failed to be retrieved by the first stage, as well as correcting artefacts introduced by that stage. We have evaluated our method against state of the art methods. Extensive experiments show that our method outperforms them on real rain image data, recovering visually clean images with good details.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
Perceptual Losses for Real-Time Style Transfer and Super-Resolution
Johnson, J., Alahi, A., & Fei-Fei, L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_43 · Cited by 11,283
Conditional Generative Adversarial Nets
Mirza, M., & Osindero, S. (2014) · arXiv · doi:10.48550/arxiv.1411.1784 · Cited by 8,863
Indoor segmentation and support inference from rgbd images
Silberman, N., Hoiem, D., Kohli, P., & Fergus, R. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33715-4_54 · Cited by 5,760
DehazeNet: An End-to-End System for Single Image Haze Removal
Cai, B., Xu, X., Jia, K., Qing, C., & Tao, D. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2598681 · Cited by 3,367
Unsupervised Monocular Depth Estimation with Left-Right Consistency
Godard, C., Aodha, O. M., & Brostow, G. J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.699 · Cited by 3,270
Scope of validity of PSNR in image/video quality assessment
Huynh-Thu, Q., & Ghanbari, M. (2008) · Electronics Letters · doi:10.1049/el:20080522 · Cited by 2,959
Instance Normalization: The Missing Ingredient for Fast Stylization
Ulyanov, D., Vedaldi, A., & Lempitsky, V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.08022 · Cited by 2,775
Berman, D., Treibitz, T., & Avidan, S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.185 · Cited by 1,642
Removing Rain from Single Images via a Deep Detail Network
Fu, X., Huang, J., Zeng, D., Huang, Y., Ding, X., & Paisley, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.186 · Cited by 1,235
Density-Aware Single Image De-raining Using a Multi-stream Dense Network
Zhang, H., & Patel, V. M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00079 · Cited by 1,066
Rain Streak Removal Using Layer Priors
Li, Y., Tan, R. T., Guo, X., Lu, J., & Brown, M. S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.299 · Cited by 952
Self-citationAutomatic Single-Image-Based Rain Streaks Removal via Image Decomposition
Kang, L.-W., Lin, C.-W., & Fu, Y.-H. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2179057 · Cited by 905
Removing Rain from a Single Image via Discriminative Sparse Coding
Luo, Y., Xu, Y., & Ji, H. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.388 · Cited by 837
Attentive Generative Adversarial Network for Raindrop Removal from A Single Image
Qian, R., Tan, R. T., Yang, W., Su, J., & Liu, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00263 · Cited by 821
Self-citationGarg, K., & Nayar, S. K. (2007) · International Journal of Computer Vision · doi:10.1007/s11263-006-0028-6 · Cited by 477
Richter, S. R., Hayder, Z., & Koltun, V. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.243 · Cited by 419
Rain or Snow Detection in Image Sequences Through Use of a Histogram of Orientation of Streaks
Bossu, J., Hautière, N., & Tarel, J.-P. (2011) · International Journal of Computer Vision · doi:10.1007/s11263-011-0421-7 · Cited by 349
Joint Bi-layer Optimization for Single-Image Rain Streak Removal
Zhu, L., Fu, C.-W., Lischinski, D., & Heng, P.-A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.276 · Cited by 334
Rain Removal in Video by Combining Temporal and Chromatic Properties
Zhang, X., Li, H., Qi, Y., Leow, W., & Ng, T. (2006) · 2006 IEEE International Conference on Multimedia and Expo · doi:10.1109/icme.2006.262572 · Cited by 293
Fast End-to-End Trainable Guided Filter
Wu, H., Zheng, S., Zhang, J., & Huang, K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00197 · Cited by 278
Video Deraining and Desnowing Using Temporal Correlation and Low-Rank Matrix Completion
Kim, J.-H., Sim, J.-Y., & Kim, C.-S. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2428933 · Cited by 245
Joint Convolutional Analysis and Synthesis Sparse Representation for Single Image Layer Separation
Gu, S., Meng, D., Zuo, W., & Zhang, L. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.189 · Cited by 233
Video Rain Streak Removal by Multiscale Convolutional Sparse Coding
Li, M., Xie, Q., Zhao, Q., Wei, W., Gu, S., Tao, J., & Meng, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00695 · Cited by 209
Robust Video Content Alignment and Compensation for Rain Removal in a CNN Framework
Chen, J., Tan, C.-H., Hou, J., Chau, L.-P., & Li, H. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00658 · Cited by 194
Erase or Fill? Deep Joint Recurrent Rain Removal and Reconstruction in Videos
Liu, J., Yang, W., Yang, S., & Guo, Z. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00341 · Cited by 193
Video Desnowing and Deraining Based on Matrix Decomposition
Ren, W., Tian, J., Han, Z., Chan, A., & Tang, Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.303 · Cited by 181
Utilizing Local Phase Information to Remove Rain from Video
Santhaseelan, V., & Asari, V. K. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-014-0759-8 · Cited by 174
Narasimhan, S. G., & Nayar, S. K. (2003) · 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings. · doi:10.1109/cvpr.2003.1211417 · Cited by 172
Adherent Raindrop Modeling, Detection and Removal in Video
You, S., Tan, R. T., Kawakami, R., Mukaigawa, Y., & Ikeuchi, K. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2491937 · Cited by 172
Self-citationJiang, T.-X., Huang, T.-Z., Zhao, X.-L., Deng, L.-J., & Wang, Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.301 · Cited by 168
Should We Encode Rain Streaks in Video as Deterministic or Stochastic?
Wei, W., Yi, L., Xie, Q., Zhao, Q., Meng, D., & Xu, Z. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.275 · Cited by 144
A Rain Pixel Recovery Algorithm for Videos With Highly Dynamic Scenes
Chen, J., & Chau, L. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2290595 · Cited by 77
(2007) · Cited by 72
Video post processing: low-latency spatiotemporal approach for detection and removal of rain
Tripathi, A. K., & Mukhopadhyay, S. (2012) · IET Image Processing · doi:10.1049/iet-ipr.2010.0547 · Cited by 60
Robust Optical Flow in Rainy Scenes
Li, R., Tan, R. T., & Cheong, L. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01267-0_18 · Cited by 50
Self-citationJoint Rain Detection and Removal via Iterative Region Dependent Multi-Task Learning.Preprint
Yang, W., Tan, R. T., Feng, J., Liu, J., Guo, Z., & Yan, S. (2016) · arXiv (Cornell University) · Cited by 40
Self-citation
Cited by
Multi-Scale Progressive Fusion Network for Single Image Deraining
Jiang, K., Wang, Z., Yi, P., Chen, C., Huang, B., Luo, Y., Ma, J., & Jiang, J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00837 · Cited by 795
Restoring Vision in Adverse Weather Conditions With Patch-Based Denoising Diffusion Models
Özdenizci, O., & Legenstein, R. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3238179 · Cited by 469
TransWeather: Transformer-based Restoration of Images Degraded by Adverse Weather Conditions
Jose Valanarasu, J. M., Yasarla, R., & Patel, V. M. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00239 · Cited by 416
Xiao, J., Fu, X., Liu, A., Wu, F., & Zha, Z.-J. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3183612 · Cited by 389
Image-to-Image Translation: Methods and Applications
Pang, Y., Lin, J., Qin, T., & Chen, Z. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3109419 · Cited by 378
Metadata
- Authors
- Li, R., Cheong, L.-F., & Tan, R. T.
- Venue
- 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2019-06
- Pages
- 1633-1642
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2938125805
- Cited by
- 402
- References
- 41
- FWCI
- 13.66
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.