The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
A Model-Driven Deep Neural Network for Single Image Rain Removal
Open accessAbstract
Deep learning (DL) methods have achieved state-of-the-art performance in the task of single image rain removal. Most of current DL architectures, however, are still lack of sufficient interpretability and not fully integrated with physical structures inside general rain streaks. To this issue, in this paper, we propose a model-driven deep neural network for the task, with fully interpretable network structures. Specifically, based on the convolutional dictionary learning mechanism for representing rain, we propose a novel single image deraining model and utilize the proximal gradient descent technique to design an iterative algorithm only containing simple operators for solving the model. Such a simple implementation scheme facilitates us to unfold it into a new deep network architecture, called rain convolutional dictionary network (RCDNet), with almost every network module one-to-one corresponding to each operation involved in the algorithm. By end-to-end training the proposed RCDNet, all the rain kernels and proximal operators can be automatically extracted, faithfully characterizing the features of both rain and clean background layers, and thus naturally lead to its better deraining performance, especially in real scenarios. Comprehensive experiments substantiate the superiority of the proposed network, especially its well generality to diverse testing scenarios and good interpretability for all its modules, as compared with state-of-the-arts both visually and quantitatively.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
Beck, A., & Teboulle, M. (2009) · SIAM Journal on Imaging Sciences · doi:10.1137/080716542 · Cited by 11,952
(2017) · Cited by 11,625
De-noising by soft-thresholding
Donoho, D. L. (1995) · IEEE Transactions on Information Theory · doi:10.1109/18.382009 · Cited by 9,619
Comaniciu, D., Ramesh, V., & Meer, P. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1195991 · Cited by 4,560
Scope of validity of PSNR in image/video quality assessment
Huynh-Thu, Q., & Ghanbari, M. (2008) · Electronics Letters · doi:10.1049/el:20080522 · Cited by 2,959
Removing Rain from Single Images via a Deep Detail Network
Fu, X., Huang, J., Zeng, D., Huang, Y., Ding, X., & Paisley, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.186 · Cited by 1,235
Image De-Raining Using a Conditional Generative Adversarial Network
Zhang, H., Sindagi, V., & Patel, V. M. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2019.2920407 · Cited by 1,214
Density-Aware Single Image De-raining Using a Multi-stream Dense Network
Zhang, H., & Patel, V. M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00079 · Cited by 1,066
Progressive Image Deraining Networks: A Better and Simpler Baseline
Ren, D., Zuo, W., Hu, Q., Zhu, P., & Meng, D. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00406 · Cited by 1,000
Self-citationRain Streak Removal Using Layer Priors
Li, Y., Tan, R. T., Guo, X., Lu, J., & Brown, M. S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.299 · Cited by 952
Clearing the Skies: A Deep Network Architecture for Single-Image Rain Removal
Fu, X., Huang, J., Ding, X., Liao, Y., & Paisley, J. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2691802 · Cited by 940
Recurrent Squeeze-and-Excitation Context Aggregation Net for Single Image Deraining
Li, X., Wu, J., Lin, Z., Liu, H., & Zha, H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_16 · Cited by 927
Automatic Single-Image-Based Rain Streaks Removal via Image Decomposition
Kang, L.-W., Lin, C.-W., & Fu, Y.-H. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2179057 · Cited by 905
Removing Rain from a Single Image via Discriminative Sparse Coding
Luo, Y., Xu, Y., & Ji, H. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.388 · Cited by 837
Spatial Attentive Single-Image Deraining With a High Quality Real Rain Dataset
Wang, T., Yang, X., Xu, K., Chen, S., Zhang, Q., & Lau, R. W. H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01255 · Cited by 681
Detection and removal of rain from videos
Garg, K., & Nayar, S. K. (2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315077 · Cited by 515
Garg, K., & Nayar, S. K. (2007) · International Journal of Computer Vision · doi:10.1007/s11263-006-0028-6 · Cited by 477
A Generalized Low-Rank Appearance Model for Spatio-temporally Correlated Rain Streaks
Chen, Y.-L., & Hsu, C.-T. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.247 · Cited by 458
Semi-Supervised Transfer Learning for Image Rain Removal
Wei, W., Meng, D., Zhao, Q., Xu, Z., & Wu, Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00400 · Cited by 458
Self-citationJoint Rain Detection and Removal from a Single Image with Contextualized Deep Networks
Yang, W., Tan, R. T., Feng, J., Guo, Z., Yan, S., & Liu, J. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2895793 · Cited by 439
Analysis of Rain and Snow in Frequency Space
Barnum, P. C., Narasimhan, S., & Kanade, T. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-008-0200-2 · Cited by 356
Rain or Snow Detection in Image Sequences Through Use of a Histogram of Orientation of Streaks
Bossu, J., Hautière, N., & Tarel, J.-P. (2011) · International Journal of Computer Vision · doi:10.1007/s11263-011-0421-7 · Cited by 349
Single Image Deraining: A Comprehensive Benchmark Analysis
Li, S., Araujo, I. B., Ren, W., Wang, Z., Tokuda, E. K., Junior, R. H., Cesar-Junior, R., Zhang, J., Guo, X., & Cao, X. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00396 · Cited by 342
Joint Bi-layer Optimization for Single-Image Rain Streak Removal
Zhu, L., Fu, C.-W., Lischinski, D., & Heng, P.-A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.276 · Cited by 334
Proximal Dehaze-Net: A Prior Learning-Based Deep Network for Single Image Dehazing
Yang, D., & Sun, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_43 · Cited by 315
Multispectral and Hyperspectral Image Fusion by MS/HS Fusion Net
Xie, Q., Zhou, M., Zhao, Q., Meng, D., Zuo, W., & Xu, Z. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00168 · Cited by 302
Self-citationRain Removal in Video by Combining Temporal and Chromatic Properties
Zhang, X., Li, H., Qi, Y., Leow, W., & Ng, T. (2006) · 2006 IEEE International Conference on Multimedia and Expo · doi:10.1109/icme.2006.262572 · Cited by 293
Single-image deraining using an adaptive nonlocal means filter
Kim, J.-H., Lee, C., Sim, J.-Y., & Kim, C.-S. (2013) · 2013 IEEE International Conference on Image Processing · doi:10.1109/icip.2013.6738189 · Cited by 273
Video Deraining and Desnowing Using Temporal Correlation and Low-Rank Matrix Completion
Kim, J.-H., Sim, J.-Y., & Kim, C.-S. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2428933 · Cited by 245
(2017) · Interval Analysis · doi:10.1515/9783110499469-009 · Cited by 235
Joint Convolutional Analysis and Synthesis Sparse Representation for Single Image Layer Separation
Gu, S., Meng, D., Zuo, W., & Zhang, L. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.189 · Cited by 233
Self-citationTrainable classifier-fusion schemes: An application to pedestrian detection
Junior, O. L., Delgado, D., Goncalves, V., & Nunes, U. (2009) · 2009 12th International IEEE Conference on Intelligent Transportation Systems · doi:10.1109/itsc.2009.5309700 · Cited by 229
A Hierarchical Approach for Rain or Snow Removing in a Single Color Image
Wang, Y., Liu, S., Chen, C., & Zeng, B. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2708502 · Cited by 229
Garg, K., & Nayar, S. K. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.253 · Cited by 225
Video Rain Streak Removal by Multiscale Convolutional Sparse Coding
Li, M., Xie, Q., Zhao, Q., Wei, W., Gu, S., Tao, J., & Meng, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00695 · Cited by 209
Self-citationRobust Video Content Alignment and Compensation for Rain Removal in a CNN Framework
Chen, J., Tan, C.-H., Hou, J., Chau, L.-P., & Li, H. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00658 · Cited by 194
Erase or Fill? Deep Joint Recurrent Rain Removal and Reconstruction in Videos
Liu, J., Yang, W., Yang, S., & Guo, Z. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00341 · Cited by 193
Learning Fully Convolutional Networks for Iterative Non-blind Deconvolution
Zhang, J., Pan, J., Lai, W.-S., Lau, R. W. H., & Yang, M.-H. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.737 · Cited by 190
Video Desnowing and Deraining Based on Matrix Decomposition
Ren, W., Tian, J., Han, Z., Chan, A., & Tang, Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.303 · Cited by 181
Jiang, T.-X., Huang, T.-Z., Zhao, X.-L., Deng, L.-J., & Wang, Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.301 · Cited by 168
Convolutional Sparse and Low-Rank Coding-Based Rain Streak Removal
Zhang, H., & Patel, V. M. (2017) · 2017 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2017.145 · Cited by 165
ADMM-Net: A Deep Learning Approach for Compressive Sensing MRIPreprint
Yang, Y., Sun, J. Z., Li, H., & Xu, Z. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.06869 · Cited by 161
Efficient convolutional sparse coding
Wohlberg, B. E. (2014) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2014.6854992 · Cited by 149
Should We Encode Rain Streaks in Video as Deterministic or Stochastic?
Wei, W., Yi, L., Xie, Q., Zhao, Q., Meng, D., & Xu, Z. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.275 · Cited by 144
Self-citationRemoving rain and snow in a single image using guided filter
Xu, J., Zhao, W., Liu, P., & Tang, X. (2012) · IEEE International Conference on Computer Science and Automation Engineering · doi:10.1109/csae.2012.6272780 · Cited by 130
D3R-Net: Dynamic Routing Residue Recurrent Network for Video Rain Removal
Liu, J., Yang, W., Yang, S., & Guo, Z. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2869722 · Cited by 117
Exploiting image structural similarity for single image rain removal
Sun, S.-H., Fan, S.-P., & Wang, Y.-C. F. (2014) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2014.7025909 · Cited by 115
Shehata, M., Cai, J., Badawy, W., Burr, T. W., Pervez, M. S., Johannesson, R. J., & Radmanesh, A. (2008) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2008.915644 · Cited by 109
Single image rain and snow removal via guided L0 smoothing filter
Ding, X., Chen, L., Zheng, X., Huang, Y., & Zeng, D. (2015) · Multimedia Tools and Applications · doi:10.1007/s11042-015-2657-7 · Cited by 100
Survey on rain removal from videos or a single image
Wang, H., Wu, Y., Li, M., Zhao, Q., & Meng, D. (2021) · Science China Information Sciences · doi:10.1007/s11432-020-3225-9 · Cited by 96
Self-citationLearning Bilevel Layer Priors for Single Image Rain Streaks Removal
Mu, P., Chen, J., Liu, R., Fan, X., & Luo, Z. (2018) · IEEE Signal Processing Letters · doi:10.1109/lsp.2018.2889277 · Cited by 54
Single image rain streaks removal: a review and an exploration
Wang, H., Xie, Q., Wu, Y., Zhao, Q., & Meng, D. (2020) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-020-01061-2 · Cited by 37
Self-citationConvolutional Dictionary Learning through Tensor FactorizationPreprint
Huang, F., & Anandkumar, A. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.03509 · Cited by 35
Cited by
Pre-Trained Image Processing Transformer
Chen, H., Wang, Y., Guo, T., Xu, C., Deng, Y., Liu, Z., Ma, S., Xu, C., Xu, C., & Gao, W. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01212 · Cited by 2,308
Uformer: A General U-Shaped Transformer for Image Restoration
Wang, Z., Cun, X., Bao, J., Zhou, W., Liu, J., & Li, H. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01716 · Cited by 2,274
Learning A Sparse Transformer Network for Effective Image Deraining
Chen, X., Li, H., Li, M., & Pan, J. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00571 · Cited by 538
All-In-One Image Restoration for Unknown Corruption
Li, B., Liu, X., Hu, P., Wu, Z., Lv, J., & Peng, X. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01693 · Cited by 432
TransWeather: Transformer-based Restoration of Images Degraded by Adverse Weather Conditions
Jose Valanarasu, J. M., Yasarla, R., & Patel, V. M. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00239 · Cited by 416
Metadata
- Authors
- Wang, H., Xie, Q., Zhao, Q., & Meng, D.
- Venue
- 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2020-06
- Pages
- 3100-3109
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W3035250394
- Cited by
- 449
- References
- 56
- FWCI
- 18.57
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.