The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Self2Self With Dropout: Learning Self-Supervised Denoising From Single Image
Abstract
In last few years, supervised deep learning has emerged as one powerful tool for image denoising, which trains a denoising network over an external dataset of noisy/clean image pairs. However, the requirement on a high-quality training dataset limits the broad applicability of the denoising networks. Recently, there have been a few works that allow training a denoising network on the set of external noisy images only. Taking one step further, this paper proposes a self-supervised learning method which only uses the input noisy image itself for training. In the proposed method, the network is trained with dropout on the pairs of Bernoulli-sampled instances of the input image, and the result is estimated by averaging the predictions generated from multiple instances of the trained model with dropout. The experiments show that the proposed method not only significantly outperforms existing single-image learning or non-learning methods, but also is competitive to the denoising networks trained on external datasets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2014) · Cited by 33,419
Image denoising by sparse 3-D transform-domain collaborative filtering
Dabov, K., Foi, A., Katkovnik, V., & Egiazarian, K. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.901238 · Cited by 9,283
Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising
Zhang, K., Zuo, W., Chen, Y., Meng, D., & Zhang, L. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2662206 · Cited by 8,983
Martin, D., Fowlkes, C., Tal, D., & Malik, J. (2002) · Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001 · doi:10.1109/iccv.2001.937655 · Cited by 8,216
Dropout as a bayesian approximation: Representing model uncertainty in deep learning
Gal, Y., & Ghahramani, Z. (2015) · arXiv · doi:10.48550/arxiv.1506.02142 · Cited by 6,471
Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries
Elad, M., & Aharon, M. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.881969 · Cited by 5,321
chambolle (2004) · doi:10.1023/b:jmiv.0000011321.19549.88 · Cited by 3,227
FFDNet: Toward a Fast and Flexible Solution for CNN-Based Image Denoising
Zhang, K., Zuo, W., & Zhang, L. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2839891 · Cited by 2,678
Image Inpainting for Irregular Holes Using Partial Convolutions
Liu, G., Reda, F. A., Shih, K. J., Wang, T.-C., Tao, A., & Catanzaro, B. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01252-6_6 · Cited by 2,419 · cited 1×
“noisy image of the size H ×W ×C, the encoder first maps the image to an H × W × 48 feature cube with a partial convolutional (PConv) layer [20], which is then processed by the following six encoder’s blocks (EBs).”
MethodLempitsky, V., Vedaldi, A., & Ulyanov, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00984 · Cited by 1,916
Image Denoising and Inpainting with Deep Neural Networks
Xie, J., Xu, L., & Chen, E. (2012) · neural information processing systems · Cited by 1,498
Noise2Void - Learning Denoising From Single Noisy Images
Krull, A., Buchholz, T.-O., & Jug, F. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00223 · Cited by 1,366
Chen, Y., & Pock, T. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2596743 · Cited by 1,344
Toward Convolutional Blind Denoising of Real Photographs
Guo, S., Yan, Z., Zhang, K., Zuo, W., & Zhang, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00181 · Cited by 1,221
Noise2Noise: Learning Image Restoration without Clean Data
Lehtinen, J., Munkberg, J., Hasselgren, J., Laine, S., Karras, T., Aittala, M., & Aila, T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.04189 · Cited by 944
FFDNet: Toward a fast and flexible solution for CNN-Based image denoising
Zhang, K., Zuo, W., & Zhang, L. (2018) · TUScholarShare (Temple University) · Cited by 916
Noise2Self: Blind Denoising by Self-SupervisionPreprint
Batson, J., & Royer, L. A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.11365 · Cited by 899
Ulyanov, D., Vedaldi, A., & Lempitsky, V. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-020-01303-4 · Cited by 719
Image Blind Denoising with Generative Adversarial Network Based Noise Modeling
Chen, J., Chen, J., Chao, H., & Yang, M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00333 · Cited by 599
Shrinkage Fields for Effective Image Restoration
Schmidt, U., & Roth, S. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.349 · Cited by 543
Universal Denoising Networks : A Novel CNN Architecture for Image Denoising
Lefkimmiatis, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00338 · Cited by 300
Real-world Noisy Image Denoising: A New BenchmarkPreprint
Xu, J., Li, H., Liang, Z., Zhang, D. D., & Zhang, L. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.02603 · Cited by 289
A Trilateral Weighted Sparse Coding Scheme for Real-World Image Denoising
Xu, J., Zhang, L., & Zhang, D. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01237-3_2 · Cited by 278
An Efficient Statistical Method for Image Noise Level Estimation
Chen, G., Zhu, F., & Heng, P. A. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.62 · Cited by 267
Data-driven tight frame construction and image denoising
Cai, J.-F., Ji, H., Shen, Z., & Ye, G.-B. (2014) · Applied and Computational Harmonic Analysis · doi:10.1016/j.acha.2013.10.001 · Cited by 252
Self-citationDictionary Learning for Sparse Coding: Algorithms and Convergence Analysis
Bao, C., Ji, H., Quan, Y., & Shen, Z. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2487966 · Cited by 180
Self-citationFOCNet: A Fractional Optimal Control Network for Image Denoising
Jia, X., Liu, S., Feng, X., & Zhang, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00621 · Cited by 160
Convolutional Dictionary Learning via Local Processing
Papyan, V., Romano, Y., Elad, M., & Sulam, J. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.566 · Cited by 152
Fast Sparsity-Based Orthogonal Dictionary Learning for Image Restoration
Bao, C., Cai, J., & Ji, H. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.420 · Cited by 96
Self-citationVemulapalli, R., Tuzel, O., & Liu, M.-Y. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.519 · Cited by 80
Image Denoising via Sequential Ensemble Learning
Yang, X., Xu, Y., Quan, Y., & Ji, H. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2978645 · Cited by 58
Self-citationGAN2GAN: Generative Noise Learning for Blind Denoising with Single Noisy ImagesPreprint
Cha, S., Park, T., Kim, B., Baek, J., & Moon, T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.10488 · Cited by 15
Cited by
Deep learning models for digital image processing: a review
Archana, R., & Jeevaraj, P. S. E. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-023-10631-z · Cited by 617
Neighbor2Neighbor: Self-Supervised Denoising from Single Noisy Images
Huang, T., Li, S., Jia, X., Lu, H., & Liu, J. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01454 · Cited by 448
Ji, K., Lin, W., Sun, Y., Cui, L.-S., Shamsi, J., Chiang, Y.-H., Chen, J., Tennyson, E. M., Dai, L., Li, Q., et al. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-023-00736-z · Cited by 36
“The noise-level detector enables blind denoising based on a self-supervised 21 learning strategy.”
BackgroundMethodInfluential
Metadata
- Authors
- Quan, Y., Chen, M., Pang, T., & Ji, H.
- Venue
- 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2020-06
- Pages
- 1887-1895
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W3035542568
- Cited by
- 430
- References
- 32
- FWCI
- 16.71
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.