The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Clearing the Skies: A Deep Network Architecture for Single-Image Rain Removal
Open accessAbstract
We introduce a deep network architecture called DerainNet for removing rain streaks from an image. Based on the deep convolutional neural network (CNN), we directly learn the mapping relationship between rainy and clean image detail layers from data. Because we do not possess the ground truth corresponding to real-world rainy images, we synthesize images with rain for training. In contrast to other common strategies that increase depth or breadth of the network, we use image processing domain knowledge to modify the objective function and improve deraining with a modestly sized CNN. Specifically, we train our DerainNet on the detail (high-pass) layer rather than in the image domain. Though DerainNet is trained on synthetic data, we find that the learned network translates very effectively to real-world images for testing. Moreover, we augment the CNN framework with image enhancement to improve the visual results. Compared with the state-of-the-art single image de-raining methods, our method has improved rain removal and much faster computation time after network training.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
Image Super-Resolution Using Deep Convolutional Networks
Dong, C., Loy, C. C., He, K., & Tang, X. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2439281 · Cited by 10,105
Bilateral Filtering for Gray and Color Images
Tomasi, C., & Manduchi, R. (2002) · Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271) · doi:10.1109/iccv.1998.710815 · Cited by 8,177 · cited 4×
“Figure 15 shows one example of a de-raining result using different low-pass filters: guided filtering [24], bilateral filtering [25] and rolling guidance filtering [26].”
BackgroundMethodInfluentialAccurate Image Super-Resolution Using Very Deep Convolutional Networks
Kim, J., Lee, J. K., & Lee, K. M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.182 · Cited by 7,870
He, K., Sun, J., & Tang, X. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.213 · Cited by 5,546
Contour Detection and Hierarchical Image Segmentation
Arbeláez, P., Maire, M., Fowlkes, C., & Malik, J. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.161 · Cited by 5,454
Cited by
Restormer: Efficient Transformer for High-Resolution Image Restoration
Zamir, S. W., Arora, A., Khan, S., Hayat, M., Khan, F. S., & Yang, M.-H. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00564 · Cited by 4,143
Pre-Trained Image Processing Transformer
Chen, H., Wang, Y., Guo, T., Xu, C., Deng, Y., Liu, Z., Ma, S., Xu, C., Xu, C., & Gao, W. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01212 · Cited by 2,308
“Input DSC [28] GMM [49] JCAS [31] Clear [27] DDN [ demonstrates that the pre-trained model can capture more useful information and features from the large-scale dataset.”
MethodMulti-Stage Progressive Image Restoration
Zamir, S. W., Arora, A., Khan, S., Hayat, M., Khan, F. S., Yang, M.-H., & Shao, L. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01458 · Cited by 2,095
Image De-Raining Using a Conditional Generative Adversarial Network
Zhang, H., Sindagi, V., & Patel, V. M. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2019.2920407 · Cited by 1,214
Density-Aware Single Image De-raining Using a Multi-stream Dense Network
Zhang, H., & Patel, V. M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00079 · Cited by 1,066
Progressive Image Deraining Networks: A Better and Simpler Baseline
Ren, D., Zuo, W., Hu, Q., Zhu, P., & Meng, D. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00406 · Cited by 1,000
Recurrent Squeeze-and-Excitation Context Aggregation Net for Single Image Deraining
Li, X., Wu, J., Lin, Z., Liu, H., & Zha, H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_16 · Cited by 927
Attentive Generative Adversarial Network for Raindrop Removal from A Single Image
Qian, R., Tan, R. T., Yang, W., Su, J., & Liu, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00263 · Cited by 821
Gated Context Aggregation Network for Image Dehazing and Deraining
Chen, D., He, M., Fan, Q., Liao, J., Zhang, L., Hou, D., Yuan, L., & Hua, G. (2019) · 2019 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2019.00151 · Cited by 809
Multi-Scale Progressive Fusion Network for Single Image Deraining
Jiang, K., Wang, Z., Yi, P., Chen, C., Huang, B., Luo, Y., Ma, J., & Jiang, J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00837 · Cited by 795
Spatial Attentive Single-Image Deraining With a High Quality Real Rain Dataset
Wang, T., Yang, X., Xu, K., Chen, S., Zhang, Q., & Lau, R. W. H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01255 · Cited by 681
HINet: Half Instance Normalization Network for Image Restoration
Chen, L., Lu, X., Zhang, J., Chu, X., & Chen, C. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00027 · Cited by 647
MAXIM: Multi-Axis MLP for Image Processing
Tu, Z., Talebi, H., Zhang, H., Yang, F., Milanfar, P., Bovik, A., & Li, Y. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00568 · Cited by 616
Restoring Vision in Adverse Weather Conditions With Patch-Based Denoising Diffusion Models
Özdenizci, O., & Legenstein, R. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3238179 · Cited by 469
Zang, S., Ding, M., Smith, D., Tyler, P., Rakotoarivelo, T., & Kaafar, M. A. (2019) · IEEE Vehicular Technology Magazine · doi:10.1109/mvt.2019.2892497 · Cited by 457
Semi-Supervised Transfer Learning for Image Rain Removal
Wei, W., Meng, D., Zhao, Q., Xu, Z., & Wu, Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00400 · Cited by 458
A Model-Driven Deep Neural Network for Single Image Rain Removal
Wang, H., Xie, Q., Zhao, Q., & Meng, D. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00317 · Cited by 449
Joint Rain Detection and Removal from a Single Image with Contextualized Deep Networks
Yang, W., Tan, R. T., Feng, J., Guo, Z., Yan, S., & Liu, J. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2895793 · Cited by 439
DesnowNet: Context-Aware Deep Network for Snow Removal
Liu, Y.-F., Jaw, D.-W., Huang, S.-C., & Hwang, J.-N. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2806202 · Cited by 432
Lightweight Pyramid Networks for Image Deraining
Fu, X., Liang, B., Huang, Y., Ding, X., & Paisley, J. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2926481 · Cited by 421
Self-citationSAR Image Despeckling Using a Convolutional Neural Network
Wang, P., Zhang, H., & Patel, V. M. (2017) · IEEE Signal Processing Letters · doi:10.1109/lsp.2017.2758203 · Cited by 407
Depth-Attentional Features for Single-Image Rain Removal
Hu, X., Fu, C.-W., Zhu, L., & Heng, P.-A. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00821 · Cited by 390
Xiao, J., Fu, X., Liu, A., Wu, F., & Zha, Z.-J. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3183612 · Cited by 389
Self-citationPerceptual Adversarial Networks for Image-to-Image Transformation
Wang, C., Xu, C., Wang, C., & Tao, D. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2836316 · Cited by 381
Deep Dense Multi-Scale Network for Snow Removal Using Semantic and Depth Priors
Zhang, K., Li, R., Yu, Y., Luo, W., & Li, C. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3104166 · Cited by 370
Hyperspectral Image Classification With Convolutional Neural Network and Active Learning
Cao, X., Yao, J., Xu, Z., & Meng, D. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.2964627 · Cited by 365
An Overview of Autonomous Vehicles Sensors and Their Vulnerability to Weather Conditions
Vargas, J., Alsweiss, S., Toker, O., Razdan, R., & Santos, J. (2021) · Sensors · doi:10.3390/s21165397 · Cited by 354
Single Image Deraining: A Comprehensive Benchmark Analysis
Li, S., Araujo, I. B., Ren, W., Wang, Z., Tokuda, E. K., Junior, R. H., Cesar-Junior, R., Zhang, J., Guo, X., & Cao, X. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00396 · Cited by 342
Advancing Image Understanding in Poor Visibility Environments: A Collective Benchmark Study
Yang, W., Yuan, Y., Ren, W., Liu, J., Scheirer, W. J., Wang, Z., Zhang, T., Zhong, Q., Xie, D., Pu, S., et al. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2981922 · Cited by 342
Self-citationYasarla, R., & Patel, V. M. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00860 · Cited by 328
HSI-DeNet: Hyperspectral Image Restoration via Convolutional Neural Network
Chang, Y., Yan, L., Fang, H., Zhong, S., & Liao, W. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2859203 · Cited by 317
Hyperspectral Image Classification With Markov Random Fields and a Convolutional Neural Network
Cao, X., Zhou, F., Xu, L., Meng, D., Xu, Z., & Paisley, J. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2799324 · Cited by 305
Self-citationDeep Generalized Unfolding Networks for Image Restoration
Mou, C., Wang, Q., & Zhang, J. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01688 · Cited by 290
Single Image Deraining: From Model-Based to Data-Driven and Beyond
Yang, W., Tan, R. T., Wang, S., Fang, Y., & Liu, J. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2995190 · Cited by 284
Jin, Z., Qiu, Y., Zhang, K., Li, H., & Luo, W. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3559891 · Cited by 266
Image Restoration via Frequency Selection
Cui, Y., Ren, W., Cao, X., & Knoll, A. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3330416 · Cited by 259
DerainCycleGAN: Rain Attentive CycleGAN for Single Image Deraining and Rainmaking
Wei, Y., Zhang, Z., Wang, Y., Xu, M., Yang, Y., Yan, S., & Wang, M. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3074804 · Cited by 254
Classification-Driven Dynamic Image Enhancement
Sharma, V., Diba, A., Neven, D., Brown, M. S., Gool, L. V., & Stiefelhagen, R. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00424 · Cited by 66
Metadata
- Authors
- Fu, X., Huang, J., Ding, X., Liao, Y., & Paisley, J.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2017-06
- Volume
- 26
- Issue
- 6
- Pages
- 2944-2956
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W2509784253
- Cited by
- 940
- References
- 34
- FWCI
- 31.11
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.