The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Photorealistic Style Transfer via Wavelet Transforms
Open accessAbstract
Recent style transfer models have provided promising artistic results. However, given a photograph as a reference style, existing methods are limited by spatial distortions or unrealistic artifacts, which should not happen in real photographs. We introduce a theoretically sound correction to the network architecture that remarkably enhances photorealism and faithfully transfers the style. The key ingredient of our method is wavelet transforms that naturally fits in deep networks. We propose a wavelet corrected transfer based on whitening and coloring transforms (WCT2) that allows features to preserve their structural information and statistical properties of VGG feature space during stylization. This is the first and the only end-to-end model that can stylize a 1024x1024 resolution image in 4.7 seconds, giving a pleasing and photorealistic quality without any post-processing. Last but not least, our model provides a stable video stylization without temporal constraints. Our code, generated images, pre-trained models and supplementary documents are all available at https://github.com/ClovaAI/WCT2.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Image Style Transfer Using Convolutional Neural Networks
Gatys, L. A., Ecker, A. S., & Bethge, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.265 · Cited by 6,025
Arbitrary Style Transfer in Real-Time with Adaptive Instance Normalization
Huang, X., & Belongie, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.167 · Cited by 5,076
Holistically-Nested Edge Detection
Xie, S., & Tu, Z. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.164 · Cited by 3,096
Reinhard, E., Adhikhmin, M., Gooch, B., & Shirley, P. (2001) · IEEE Computer Graphics and Applications · doi:10.1109/38.946629 · Cited by 2,937
Invariant Scattering Convolution Networks
Bruna, J., & Mallat, S. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.230 · Cited by 1,633
Image Processing and Analysis: Variational, PDE, Wavelet, and Stochastic Methods
Chan, T. F., & Shen, J. (. (2005) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9780898717877 · Cited by 915
Luan, F., Paris, S., Shechtman, E., & Bala, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.740 · Cited by 714
Holistically-nested edge detection
Xie, S., & Tu, Z. (2017) · International Journal of Computer Vision · doi:10.1007/s11263-017-1004-z · Cited by 682
Framing U-Net via Deep Convolutional Framelets: Application to Sparse-View CT
Han, Y., & Ye, J. C. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2823768 · Cited by 588
Visual attribute transfer through deep image analogy
Liao, J., Yao, Y., Yuan, L., Hua, G., & Kang, S. B. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073683 · Cited by 487
Controlling Perceptual Factors in Neural Style Transfer
Gatys, L. A., Ecker, A. S., Bethge, M., Hertzmann, A., & Shechtman, E. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.397 · Cited by 486
A Closed-Form Solution to Photorealistic Image Stylization
Li, Y., Liu, M.-Y., Li, X., Yang, M.-H., & Kautz, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01219-9_28 · Cited by 400
Universal Style Transfer via Feature Transforms
Li, Y., Chen, F., Yang, J., Wang, Z., Lü, X., & Yang, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.08086 · Cited by 346
Deep Convolutional Framelet Denosing for Low-Dose CT via Wavelet Residual Network
Kang, E., Chang, W., Yoo, J., & Ye, J. C. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2823756 · Cited by 336
Self-citationTwo-scale tone management for photographic look
Bae, S., Paris, S., & Durand, F. (2006) · ACM Transactions on Graphics · doi:10.1145/1141911.1141935 · Cited by 332
N-dimensional probability density function transfer and its application to color transfer
Pitie, F., Kokaram, A. C., & Dahyot, R. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.166 · Cited by 331
Deep Convolutional Framelets: A General Deep Learning Framework for Inverse Problems
Ye, J. C., Han, Y., & Cha, E. (2018) · SIAM Journal on Imaging Sciences · doi:10.1137/17m1141771 · Cited by 330
Avatar-Net: Multi-scale Zero-Shot Style Transfer by Feature Decoration
Sheng, L., Lin, Z., Shao, J., & Wang, X. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00860 · Cited by 313
Universal Style Transfer via Feature Transforms
Li, Y., Chen, F., Yan, S., Wang, Z., Lü, X., & Yang, M. (2017) · neural information processing systems · Cited by 300
Bae, W., Yoo, J., & Ye, J. C. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.152 · Cited by 212
Self-citationScaling the Scattering Transform: Deep Hybrid Networks
Oyallon, E., Belilovsky, E., & Zagoruyko, S. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.599 · Cited by 201
Wavelet Pooling for Convolutional Neural Networks
Williams, T., & Li, R. (2018) · International Conference on Learning Representations · Cited by 182
Arbitrary Style Transfer with Deep Feature Reshuffle
Gu, S., Chen, C., Liao, J., & Yuan, L. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00858 · Cited by 181
Wavelet Convolutional Neural Networks for Texture ClassificationPreprint
Fujieda, S., Takayama, K., & Hachisuka, T. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.07394 · Cited by 132
Image Restoration: Wavelet Frame Shrinkage, Nonlinear Evolution PDEs, and Beyond
Dong, B., Jiang, Q., & Shen, Z. (2017) · Multiscale Modeling and Simulation · doi:10.1137/15m1037457 · Cited by 88
A Tale of Two Bases: Local-Nonlocal Regularization on Image Patches with Convolution Framelets
Yin, R., Gao, T., Lu, Y., & Daubechies, I. C. (2017) · SIAM Journal on Imaging Sciences · doi:10.1137/16m1091447 · Cited by 53
DFT-based Transformation Invariant Pooling Layer for Visual Classification
Ryu, J., Yang, M., & Lim, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01264-9_6 · Cited by 46
Convolutional Neural Network Feature Reduction using Wavelet Transform
Ļevinskis, A. (2013) · Elektronika ir Elektrotechnika · doi:10.5755/j01.eee.19.3.3698 · Cited by 17
A Mathematical Framework for Deep Learning in Elastic Source Imaging
Yoo, J., Wahab, A., & Ye, J. C. (2018) · SIAM Journal on Applied Mathematics · doi:10.1137/18m1174027 · Cited by 10
Self-citation
Cited by
Contrastive Learning for Unpaired Image-to-Image Translation
Park, T., Efros, A. A., Zhang, R., & Zhu, J.-Y. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58545-7_19 · Cited by 1,442
ILVR: Conditioning Method for Denoising Diffusion Probabilistic Models
Choi, J., Kim, S., Jeong, Y., Gwon, Y., & Yoon, S. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01410 · Cited by 634
StyleGAN-NADA: CLIP-guided domain adaptation of image generators
Gal, R., Patashnik, O., Maron, H., Bermano, A. H., Chechik, G., & Cohen-Or, D. (2022) · ACM Transactions on Graphics · doi:10.1145/3528223.3530164 · Cited by 500
Focal Frequency Loss for Image Reconstruction and Synthesis
Jiang, L., Dai, B., Wu, W., & Loy, C. C. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01366 · Cited by 459
Camouflaged Object Detection with Feature Decomposition and Edge Reconstruction
He, C., Li, K., Zhang, Y., Tang, L., Zhang, Y., Guo, Z., & Li, X. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.02111 · Cited by 382
Metadata
- Authors
- Yoo, J., Uh, Y., Chun, S., Kang, B., & Ha, J.-W.
- Venue
- 2019 IEEE/CVF International Conference on Computer Vision (ICCV)
- Publisher
- IEEE
- Published
- 2019-10
- Pages
- 9035-9044
- OpenAlex
- W2989045104
- Cited by
- 388
- References
- 34
- FWCI
- 14.84
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.