The DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
Single Image Deraining: From Model-Based to Data-Driven and Beyond
Open accessAbstract
The goal of single-image deraining is to restore the rain-free background scenes of an image degraded by rain streaks and rain accumulation. The early single-image deraining methods employ a cost function, where various priors are developed to represent the properties of rain and background layers. Since 2017, single-image deraining methods step into a deep-learning era, and exploit various types of networks, i.e., convolutional neural networks, recurrent neural networks, generative adversarial networks, etc., demonstrating impressive performance. Given the current rapid development, in this paper, we provide a comprehensive survey of deraining methods over the last decade. We summarize the rain appearance models, and discuss two categories of deraining approaches: model-based and data-driven approaches. For the former, we organize the literature based on their basic models and priors. For the latter, we discuss the developed ideas related to architectures, constraints, loss functions, and training datasets. We present milestones of single-image deraining methods, review a broad selection of previous works in different categories, and provide insights on the historical development route from the model-based to data-driven methods. We also summarize performance comparisons quantitatively and qualitatively. Beyond discussing the technicality of deraining methods, we also discuss the future possible directions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
The Cityscapes Dataset for Semantic Urban Scene Understanding
Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., & Schiele, B. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.350 · Cited by 12,433
Making a “Completely Blind” Image Quality Analyzer
Mittal, A., Soundararajan, R., & Bovik, A. C. (2013) · IEEE Signal Processing Letters · doi:10.1109/lsp.2012.2227726 · Cited by 6,766
Indoor segmentation and support inference from rgbd images
Silberman, N., Hoiem, D., Kohli, P., & Fergus, R. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33715-4_54 · Cited by 5,760
Contour Detection and Hierarchical Image Segmentation
Arbeláez, P., Maire, M., Fowlkes, C., & Malik, J. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.161 · Cited by 5,454
Unsupervised Monocular Depth Estimation with Left-Right Consistency
Godard, C., Aodha, O. M., & Brostow, G. J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.699 · Cited by 3,270
Rank Analysis of Incomplete Block Designs: I. The Method of Paired Comparisons
Bradley, R. A., & Terry, M. E. (1952) · Biometrika · doi:10.2307/2334029 · Cited by 2,412
RANK ANALYSIS OF INCOMPLETE BLOCK DESIGNS: THE METHOD OF PAIRED COMPARISONS
BRADLEY, R. A., & TERRY, M. E. (1952) · Biometrika · doi:10.1093/biomet/39.3-4.324 · Cited by 1,434
A Feature-Enriched Completely Blind Image Quality Evaluator
Zhang, L., Zhang, L., & Bovik, A. C. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2426416 · Cited by 1,311
Removing Rain from Single Images via a Deep Detail Network
Fu, X., Huang, J., Zeng, D., Huang, Y., Ding, X., & Paisley, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.186 · Cited by 1,235
Deep Joint Rain Detection and Removal from a Single Image
Yang, W., Tan, R. T., Feng, J., Liu, J., Guo, Z., & Yan, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.183 · Cited by 1,231
Self-citationImage De-Raining Using a Conditional Generative Adversarial Network
Zhang, H., Sindagi, V., & Patel, V. M. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2019.2920407 · Cited by 1,214
UCID: an uncompressed color image database:
Schaefer, G., & Stich, M. (2003) · SPIE Proceedings · doi:10.1117/12.525375 · Cited by 1,071
Density-Aware Single Image De-raining Using a Multi-stream Dense Network
Zhang, H., & Patel, V. M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00079 · Cited by 1,066
Progressive Image Deraining Networks: A Better and Simpler Baseline
Ren, D., Zuo, W., Hu, Q., Zhu, P., & Meng, D. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00406 · Cited by 1,000
Blind image quality evaluation using perception based features
Venkatanath, N., Praneeth, D., Bh, M. C., Channappayya, S. S., & Medasani, S. S. (2015) · 2015 Twenty First National Conference on Communications (NCC) · doi:10.1109/ncc.2015.7084843 · Cited by 978
Rain Streak Removal Using Layer Priors
Li, Y., Tan, R. T., Guo, X., Lu, J., & Brown, M. S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.299 · Cited by 952
Self-citationClearing the Skies: A Deep Network Architecture for Single-Image Rain Removal
Fu, X., Huang, J., Ding, X., Liao, Y., & Paisley, J. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2691802 · Cited by 940
Recurrent Squeeze-and-Excitation Context Aggregation Net for Single Image Deraining
Li, X., Wu, J., Lin, Z., Liu, H., & Zha, H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_16 · Cited by 927
Automatic Single-Image-Based Rain Streaks Removal via Image Decomposition
Kang, L.-W., Lin, C.-W., & Fu, Y.-H. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2179057 · Cited by 905
Removing Rain from a Single Image via Discriminative Sparse Coding
Luo, Y., Xu, Y., & Ji, H. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.388 · Cited by 837
Attentive Generative Adversarial Network for Raindrop Removal from A Single Image
Qian, R., Tan, R. T., Yang, W., Su, J., & Liu, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00263 · Cited by 821
Self-citationNo-reference image quality assessment based on spatial and spectral entropies
Liu, L., Liu, B., Huang, H., & Bovik, A. C. (2014) · Signal Processing: Image Communication · doi:10.1016/j.image.2014.06.006 · Cited by 721
Spatial Attentive Single-Image Deraining With a High Quality Real Rain Dataset
Wang, T., Yang, X., Xu, K., Chen, S., Zhang, Q., & Lau, R. W. H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01255 · Cited by 681
Learning a no-reference quality metric for single-image super-resolution
Ma, C., Yang, C.-Y., Yang, X., & Yang, M.-H. (2017) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2016.12.009 · Cited by 605
Detection and removal of rain from videos
Garg, K., & Nayar, S. K. (2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315077 · Cited by 515
Garg, K., & Nayar, S. K. (2007) · International Journal of Computer Vision · doi:10.1007/s11263-006-0028-6 · Cited by 477
Semi-Supervised Transfer Learning for Image Rain Removal
Wei, W., Meng, D., Zhao, Q., Xu, Z., & Wu, Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00400 · Cited by 458
Restoring an Image Taken through a Window Covered with Dirt or Rain
Eigen, D., Krishnan, D., & Fergus, R. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.84 · Cited by 454
Joint Rain Detection and Removal from a Single Image with Contextualized Deep Networks
Yang, W., Tan, R. T., Feng, J., Guo, Z., Yan, S., & Liu, J. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2895793 · Cited by 439
Self-citationDesnowNet: Context-Aware Deep Network for Snow Removal
Liu, Y.-F., Jaw, D.-W., Huang, S.-C., & Hwang, J.-N. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2806202 · Cited by 432
Lightweight Pyramid Networks for Image Deraining
Fu, X., Liang, B., Huang, Y., Ding, X., & Paisley, J. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2926481 · Cited by 421
Blind/Referenceless Image Spatial Quality Evaluator
Mittal, A., Moorthy, A. K., & Bovik, A. C. (2011) · 2011 Conference Record of the Forty Fifth Asilomar Conference on Signals, Systems and Computers (ASILOMAR) · doi:10.1109/acssc.2011.6190099 · Cited by 414
Heavy Rain Image Restoration: Integrating Physics Model and Conditional Adversarial Learning
Li, R., Cheong, L.-F., & Tan, R. T. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00173 · Cited by 402
Self-citationDepth-Attentional Features for Single-Image Rain Removal
Hu, X., Fu, C.-W., Zhu, L., & Heng, P.-A. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00821 · Cited by 390
Image Denoising Via Learned Dictionaries and Sparse representation
Elad, M., & Aharon, M. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPR'06) · doi:10.1109/cvpr.2006.142 · Cited by 378
A DCT Statistics-Based Blind Image Quality Index
Saad, M. A., Bovik, A. C., & Charrier, C. (2010) · IEEE Signal Processing Letters · doi:10.1109/lsp.2010.2045550 · Cited by 372
Single Image Deraining: A Comprehensive Benchmark Analysis
Li, S., Araujo, I. B., Ren, W., Wang, Z., Tokuda, E. K., Junior, R. H., Cesar-Junior, R., Zhang, J., Guo, X., & Cao, X. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00396 · Cited by 342
Joint Bi-layer Optimization for Single-Image Rain Streak Removal
Zhu, L., Fu, C.-W., Lischinski, D., & Heng, P.-A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.276 · Cited by 334
Yasarla, R., & Patel, V. M. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00860 · Cited by 328
Blind image quality assessment through anisotropy
Gabarda, S., & Cristóbal, G. (2007) · Journal of the Optical Society of America A · doi:10.1364/josaa.24.000b42 · Cited by 301
Non-locally Enhanced Encoder-Decoder Network for Single Image De-raining
Li, G., He, X., Zhang, W., Chang, H., Dong, L., & Lin, L. (2018) · Proceedings of the 26th ACM international conference on Multimedia · doi:10.1145/3240508.3240636 · Cited by 246
Joint Convolutional Analysis and Synthesis Sparse Representation for Single Image Layer Separation
Gu, S., Meng, D., Zuo, W., & Zhang, L. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.189 · Cited by 233
A Hierarchical Approach for Rain or Snow Removing in a Single Color Image
Wang, Y., Liu, S., Chen, C., & Zeng, B. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2708502 · Cited by 229
Learning Dual Convolutional Neural Networks for Low-Level Vision
Pan, J., Liu, S., Sun, D., Zhang, J., Liu, Y., Ren, J., Li, Z., Tang, J., Lu, H., Tai, Y.-W., et al. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00324 · Cited by 207
Erase or Fill? Deep Joint Recurrent Rain Removal and Reconstruction in Videos
Liu, J., Yang, W., Yang, S., & Guo, Z. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00341 · Cited by 193
Self-citationResidual-Guide Network for Single Image Deraining
Fan, Z., Wu, H., Fu, X., Huang, Y., & Ding, X. (2018) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3240508.3240694 · Cited by 182
Brooks, A. C., Zhao, X., & Pappas, T. N. (2008) · IEEE Transactions on Image Processing · doi:10.1109/tip.2008.926161 · Cited by 175
Adherent Raindrop Modeling, Detection and Removal in Video
You, S., Tan, R. T., Kawakami, R., Mukaigawa, Y., & Ikeuchi, K. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2491937 · Cited by 172
Self-citationConvolutional Sparse and Low-Rank Coding-Based Rain Streak Removal
Zhang, H., & Patel, V. M. (2017) · 2017 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2017.145 · Cited by 165
Deep Learning for Seeing Through Window With Raindrops
Quan, Y., Deng, S., Chen, Y., & Ji, H. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00255 · Cited by 159
A directional global sparse model for single image rain removal
Deng, L.-J., Huang, T., Zhao, X.-L., et al. (2018) · Applied Mathematical Modelling · doi:10.1016/j.apm.2018.03.001 · Cited by 151
No-reference color image quality assessment: from entropy to perceptual quality
Chen, X., Zhang, Q., Lin, M., Yang, G., & He, C. (2019) · EURASIP Journal on Image and Video Processing · doi:10.1186/s13640-019-0479-7 · Cited by 149
Physics-Based Rendering for Improving Robustness to Rain
Halder, S., Lalonde, J.-F., & Charette, R. D. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.01030 · Cited by 130
Scale-Free Single Image Deraining Via Visibility-Enhanced Recurrent Wavelet Learning
Yang, W., Liu, J., Yang, S., & Guo, Z. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2892685 · Cited by 126
Self-citationFrame-Consistent Recurrent Video Deraining With Dual-Level Flow
Yang, W., Liu, J., & Feng, J. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00176 · Cited by 123
Self-citationSurvey on rain removal from videos or a single image
Wang, H., Wu, Y., Li, M., Zhao, Q., & Meng, D. (2021) · Science China Information Sciences · doi:10.1007/s11432-020-3225-9 · Cited by 92
Unsupervised Single Image Deraining with Self-Supervised Constraints
Jin, X., Chen, Z., Lin, J., Chen, Z., & Zhou, W. (2019) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2019.8803238 · Cited by 88
Single Image Deraining using Scale-Aware Multi-Stage Recurrent NetworkPreprint
Li, R., Cheong, L., & Tan, R. T. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.06830 · Cited by 67
Self-citationRobust Optical Flow in Rainy Scenes
Li, R., Tan, R. T., & Cheong, L. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01267-0_18 · Cited by 57
Self-citationRemoval of adherent waterdrops from images acquired with stereo camera
Yamashita, A., Tanaka, Y., & Kaneko, T. (2005) · 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2005.1545103 · Cited by 55
RainFlow: Optical Flow Under Rain Streaks and Rain Veiling Effect
Li, R., Tan, R. T., Cheong, L. F., Avilés-Rivero, A. I., Fan, Q., & Schönlieb, C. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00740 · Cited by 38
Self-citationYamashita, A., Fukuchi, I., & Kaneko, T. (2009) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2009.5354639 · Cited by 28
Beyond Synthetic Data: A Blind Deraining Quality Assessment Metric Towards Authentic Rain Image
Wu, Q., Wang, L., Ngan, K. N., Li, H., & Meng, F. (2019) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2019.8803329 · Cited by 19
Cited by
Learning A Sparse Transformer Network for Effective Image Deraining
Chen, X., Li, H., Li, M., & Pan, J. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00571 · Cited by 538
Restoring Vision in Adverse Weather Conditions With Patch-Based Denoising Diffusion Models
Özdenizci, O., & Legenstein, R. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3238179 · Cited by 469
TransWeather: Transformer-based Restoration of Images Degraded by Adverse Weather Conditions
Jose Valanarasu, J. M., Yasarla, R., & Patel, V. M. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00239 · Cited by 416
Xiao, J., Fu, X., Liu, A., Wu, F., & Zha, Z.-J. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3183612 · Cited by 389
Image Restoration via Frequency Selection
Cui, Y., Ren, W., Cao, X., & Knoll, A. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3330416 · Cited by 259
Metadata
- Authors
- Yang, W., Tan, R. T., Wang, S., Fang, Y., & Liu, J.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2021-11-01
- Volume
- 43
- Issue
- 11
- Pages
- 4059-4077
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W3028045870
- Cited by
- 284
- References
- 64
- FWCI
- 17.04
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.