The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Deep Image Prior
Abstract
Deep convolutional networks have become a popular tool for image generation and restoration. Generally, their excellent performance is imputed to their ability to learn realistic image priors from a large number of example images. In this paper, we show that, on the contrary, the structure of a generator network is sufficient to capture a great deal of low-level image statistics prior to any learning. In order to do so, we show that a randomly-initialized neural network can be used as a handcrafted prior with excellent results in standard inverse problems such as denoising, superresolution, and inpainting. Furthermore, the same prior can be used to invert deep neural representations to diagnose them, and to restore images based on flash-no flash input pairs. Apart from its diverse applications, our approach highlights the inductive bias captured by standard generator network architectures. It also bridges the gap between two very popular families of image restoration methods: learning-based methods using deep convolutional networks and learning-free methods based on handcrafted image priors such as self-similarity.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network
Ledig, C., Theis, L., Huszar, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A., Tejani, A., Totz, J., Wang, Z., et al. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.19 · Cited by 12,696
He, K., Sun, J., & Tang, X. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.213 · Cited by 5,546
Super-resolution from a single image
Glasner, D., Bagon, S., & Irani, M. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459271 · Cited by 1,889
Understanding deep image representations by inverting them
Mahendran, A., & Vedaldi, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299155 · Cited by 1,827
Self-citation
Research works printed but not linked: 27
- zhang, 2017, Understanding deep learning requires rethinking generalization, Proc ICLR
- zeyde, 2010, On single image scale-up using sparse-representations, Curves and Surfaces, 711
- 10.1109/CVPR.2010.5539957 · DOI · Paper page
- ulyanov, 0, Deep Image Prior webpage
- goodfellow, 2014, Generative adversarial nets, Proc NIPS, 2672
- 10.1109/ICCV.2015.212 · DOI · Paper page
- 10.1109/CVPR.2015.7299149 · DOI
- iizuka, 2017, Globally and Locally Consistent Image Completion, ACM Trans Graphics (Proc ACM SIGGRAPH), 36, 107:1
- 10.1109/CVPR.2017.618 · DOI · Paper page
- 10.1109/ICCV.2017.481 · DOI · Paper page
- 10.1109/CVPR.2005.38 · DOI · Paper page
- ren, 2015, Shepard convolutional neural networks, Proc NIPS, 901
- bojanowski, 2017, Optimizing the latent space of generative networks
- 10.1109/TIP.2007.901238 · DOI · Paper page
- 10.1109/CVPR.2017.298 · DOI · Paper page
- 10.1109/CVPR.2012.6247952 · DOI · Paper page
- dosovitskiy, 2016, Inverting convolutional networks with convolutional networks, Proc CVPR
- dong, 2014, Learning a deep convolutional network for image super-resolution, Proc ECCV, 184
- 10.5244/C.26.135 · DOI · Paper page
- 10.1109/CVPR.2015.7298761 · DOI · Paper page
- 10.1109/ICCV.2017.356 · DOI
- lefkimmiatis, 2016, Non-local color image denoising with convolutional neural networks, Proc CVPR
- mahendran, 2016, Visualizing deep convolutional neural networks using natural pre-images, IJCV, 10.1007/s11263-016-0911-8 · DOI · Paper page
- papyan, 2017, Convolutional neural networks analyzed via convolutional sparse coding, Journal of Machine Learning Research, 18, 1
- mairal, 2010, Online learning for matrix factorization and sparse coding, Journal of Machine Learning Research, 11, 19
- 10.1145/1015706.1015777 · DOI · Paper page
- 10.1109/ICCV.2017.566 · DOI
Cited by
Shortcut learning in deep neural networks
Geirhos, R., Jacobsen, J.-H., Michaelis, C., Zemel, R., Brendel, W., Bethge, M., & Wichmann, F. A. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-00257-z · Cited by 2,224
CNN-Generated Images Are Surprisingly Easy to Spot… for Now
Wang, S.-Y., Wang, O., Zhang, R., Owens, A., & Efros, A. A. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00872 · Cited by 1,210
A survey of human-in-the-loop for machine learning
Wu, X., Xiao, L., Sun, Y., Zhang, J., Ma, T., & He, L. (2022) · Future Generation Computer Systems · doi:10.1016/j.future.2022.05.014 · Cited by 800
Artificial intelligence in the creative industries: a review
Anantrasirichai, N., & Bull, D. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-10039-7 · Cited by 793
Deep learning for tomographic image reconstruction
Wang, G., Ye, J. C., & De Man, B. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-00273-z · Cited by 531
Learning human–environment interactions using conformal tactile textiles
Luo, Y., Li, Y., Sharma, P., Shou, W., Wu, K., Foshey, M., Li, B., Palacios, T., Torralba, A., & Matusik, W. (2021) · Nature Electronics · doi:10.1038/s41928-021-00558-0 · Cited by 395
Countering Malicious DeepFakes: Survey, Battleground, and Horizon
Juefei-Xu, F., Wang, R., Huang, Y., Guo, Q., Ma, L., & Liu, Y. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-022-01606-8 · Cited by 191
Information Leakage in Embedding Models
Song, C., & Raghunathan, A. (2020) · Proceedings of the 2020 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3372297.3417270 · Cited by 175
Weight Agnostic Neural Networks
Gaier, A., & Ha, D. (2019) · Unpublished · doi:10.13140/rg.2.2.16025.88169 · Cited by 161
Ethical machines: The human-centric use of artificial intelligence
Lepri, B., Oliver, N., & Pentland, A. (2021) · iScience · doi:10.1016/j.isci.2021.102249 · Cited by 149
Data-Free Network Quantization With Adversarial Knowledge Distillation
Choi, Y., Choi, J., El-Khamy, M., & Lee, J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00363 · Cited by 135
What makes instance discrimination good for transfer learning?
Zhao, N., Wu, Z., Lau, R. W. H., & Lin, S. (2020) · arXiv · doi:10.48550/arxiv.2006.06606 · Cited by 115
Deepfake Detection: A Comprehensive Survey from the Reliability Perspective
Wang, T., Liao, X., Chow, K. P., Lin, X., & Wang, Y. (2025) · ACM Computing Surveys · doi:10.1145/3699710 · Cited by 107
Wavelet-Improved Score-Based Generative Model for Medical Imaging
Wu, W., Wang, Y., Liu, Q., Wang, G., & Zhang, J. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2023.3325824 · Cited by 105
Pseudo-Labeling and Confirmation Bias in Deep Semi-Supervised Learning
Arazo, E., Ortego, D., Albert, P., O'Connor, N. E., & McGuinness, K. (2020) · 2020 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207304 · Cited by 77
Stochastic Image Denoising by Sampling from the Posterior Distribution
Kawar, B., Vaksman, G., & Elad, M. (2021) · 2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw54120.2021.00213 · Cited by 42
A Deep-Learning Based Bayesian Approach to Seismic Imaging and Uncertainty Quantification
Siahkoohi, A., Rizzuti, G., & Herrmann, F. (2020) · EAGE 2020 Annual Conference & Exhibition Online · doi:10.3997/2214-4609.202010770 · Cited by 27
DIPPAS: a deep image prior PRNU anonymization scheme
Picetti, F., Mandelli, S., Bestagini, P., Lipari, V., & Tubaro, S. (2022) · EURASIP Journal on Information Security · doi:10.1186/s13635-022-00128-7 · Cited by 26
Hybrid Physical-Deep Learning Model for Astronomical Inverse Problems
Lanusse, F., Melchior, P., & Moolekamp, F. (2019) · arXiv · doi:10.48550/arxiv.1912.03980 · Cited by 9
A lightweight backdoor defense framework based on image inpainting
Wei, Y., Gao, H., Wang, Y., Gao, Y., & Liu, H. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.03.052 · Cited by 6
Metadata
- Authors
- Lempitsky, V., Vedaldi, A., & Ulyanov, D.
- Venue
- 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
- Publisher
- IEEE
- Published
- 2018-06
- Pages
- 9446-9454
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2964013315
- Cited by
- 1,916
- References
- 6
- FWCI
- 63.69
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.