The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Clearing the Skies: A Deep Network Architecture for Single-Image Rain Removal
Open accessAbstract
We introduce a deep network architecture called DerainNet for removing rain streaks from an image. Based on the deep convolutional neural network (CNN), we directly learn the mapping relationship between rainy and clean image detail layers from data. Because we do not possess the ground truth corresponding to real-world rainy images, we synthesize images with rain for training. In contrast to other common strategies that increase depth or breadth of the network, we use image processing domain knowledge to modify the objective function and improve deraining with a modestly sized CNN. Specifically, we train our DerainNet on the detail (high-pass) layer rather than in the image domain. Though DerainNet is trained on synthetic data, we find that the learned network translates very effectively to real-world images for testing. Moreover, we augment the CNN framework with image enhancement to improve the visual results. Compared with the state-of-the-art single image de-raining methods, our method has improved rain removal and much faster computation time after network training.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
Image Super-Resolution Using Deep Convolutional Networks
Dong, C., Loy, C. C., He, K., & Tang, X. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2439281 · Cited by 10,105
Bilateral Filtering for Gray and Color Images
Tomasi, C., & Manduchi, R. (2002) · Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271) · doi:10.1109/iccv.1998.710815 · Cited by 8,177 · cited 4×
“Figure 15 shows one example of a de-raining result using different low-pass filters: guided filtering [24], bilateral filtering [25] and rolling guidance filtering [26].”
BackgroundMethodInfluentialAccurate Image Super-Resolution Using Very Deep Convolutional Networks
Kim, J., Lee, J. K., & Lee, K. M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.182 · Cited by 7,870
He, K., Sun, J., & Tang, X. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.213 · Cited by 5,546
Contour Detection and Hierarchical Image Segmentation
Arbeláez, P., Maire, M., Fowlkes, C., & Malik, J. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.161 · Cited by 5,454
Image Denoising and Inpainting with Deep Neural Networks
Xie, J., Xu, L., & Chen, E. (2012) · Cited by 1,237
A Two-Step Framework for Constructing Blind Image Quality Indices
Moorthy, A. K., & Bovik, A. C. (2010) · IEEE Signal Processing Letters · doi:10.1109/lsp.2010.2043888 · Cited by 1,196
UCID: an uncompressed color image database:
Schaefer, G., & Stich, M. (2003) · SPIE Proceedings · doi:10.1117/12.525375 · Cited by 1,071
Rain Streak Removal Using Layer Priors
Li, Y., Tan, R. T., Guo, X., Lu, J., & Brown, M. S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.299 · Cited by 952
Automatic Single-Image-Based Rain Streaks Removal via Image Decomposition
Kang, L.-W., Lin, C.-W., & Fu, Y.-H. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2179057 · Cited by 905
Removing Rain from a Single Image via Discriminative Sparse Coding
Luo, Y., Xu, Y., & Ji, H. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.388 · Cited by 837
Deep Convolutional Neural Network for Image Deconvolution
Li, X., Ren, J., Liu, C., & Jia, J. (2014) · Rare & Special e-Zone (The Hong Kong University of Science and Technology) · Cited by 836
Zhang, Q., Shen, X., Xu, L., & Jia, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10578-9_53 · Cited by 580
Detection and removal of rain from videos
Garg, K., & Nayar, S. K. (2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315077 · Cited by 515
A Generalized Low-Rank Appearance Model for Spatio-temporally Correlated Rain Streaks
Chen, Y.-L., & Hsu, C.-T. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.247 · Cited by 458
Restoring an Image Taken through a Window Covered with Dirt or Rain
Eigen, D., Krishnan, D., & Fergus, R. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.84 · Cited by 454
Analysis of Rain and Snow in Frequency Space
Barnum, P. C., Narasimhan, S., & Kanade, T. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-008-0200-2 · Cited by 356
Rain or Snow Detection in Image Sequences Through Use of a Histogram of Orientation of Streaks
Bossu, J., Hautière, N., & Tarel, J.-P. (2011) · International Journal of Computer Vision · doi:10.1007/s11263-011-0421-7 · Cited by 349
Single-image deraining using an adaptive nonlocal means filter
Kim, J.-H., Lee, C., Sim, J.-Y., & Kim, C.-S. (2013) · 2013 IEEE International Conference on Image Processing · doi:10.1109/icip.2013.6738189 · Cited by 273
Photorealistic rendering of rain streaks
Garg, K., & Nayar, S. K. (2006) · ACM Transactions on Graphics · doi:10.1145/1141911.1141985 · Cited by 227
Self-Learning Based Image Decomposition With Applications to Single Image Denoising
Huang, D.-A., Kang, L.-W., Wang, Y.-C. F., & Lin, C.-W. (2014) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2013.2284759 · Cited by 214
Visual Depth Guided Color Image Rain Streaks Removal Using Sparse Coding
Chen, D.-Y., Chen, C.-C., & Kang, L.-W. (2014) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2014.2308627 · Cited by 180
Li, X., Ren, J., Yan, Q., Liao, R., & Jia, J. (2015) · Cited by 175
Utilizing Local Phase Information to Remove Rain from Video
Santhaseelan, V., & Asari, V. K. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-014-0759-8 · Cited by 174
Shepard convolutional neural networks
Ren, J., Xu, L., Yan, Q., & Sun, W. (2015) · neural information processing systems · Cited by 161
A Contrast Enhancement Framework with JPEG Artifacts Suppression
Li, Y., Guo, F., Tan, R. T., & Brown, M. S. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10605-2_12 · Cited by 133
Context-Aware Single Image Rain Removal
Huang, D.-A., Kang, L., Yang, M.-C., Lin, C., & Wang, Y.-C. F. (2012) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2012.92 · Cited by 111
LLSURE: Local Linear SURE-Based Edge-Preserving Image Filtering
Qiu, T., Wang, A., Yu, N., & Song, A. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2214052 · Cited by 55
Photorealistic rendering of rain streaks
Garg, K., & Nayar, S. K. (2006) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1179352.1141985 · Cited by 33
Cited by
Restormer: Efficient Transformer for High-Resolution Image Restoration
Zamir, S. W., Arora, A., Khan, S., Hayat, M., Khan, F. S., & Yang, M.-H. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00564 · Cited by 4,143
Pre-Trained Image Processing Transformer
Chen, H., Wang, Y., Guo, T., Xu, C., Deng, Y., Liu, Z., Ma, S., Xu, C., Xu, C., & Gao, W. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01212 · Cited by 2,308
Multi-Stage Progressive Image Restoration
Zamir, S. W., Arora, A., Khan, S., Hayat, M., Khan, F. S., Yang, M.-H., & Shao, L. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01458 · Cited by 2,095
Image De-Raining Using a Conditional Generative Adversarial Network
Zhang, H., Sindagi, V., & Patel, V. M. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2019.2920407 · Cited by 1,214
Density-Aware Single Image De-raining Using a Multi-stream Dense Network
Zhang, H., & Patel, V. M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00079 · Cited by 1,066
Metadata
- Authors
- Fu, X., Huang, J., Ding, X., Liao, Y., & Paisley, J.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2017-06
- Volume
- 26
- Issue
- 6
- Pages
- 2944-2956
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W2509784253
- Cited by
- 940
- References
- 34
- FWCI
- 31.11
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.