The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Learning Linear Transformations for Fast Image and Video Style Transfer
Abstract
Given a random pair of images, a universal style transfer method extracts the feel from a reference image to synthesize an output based on the look of a content image. Recent algorithms based on second-order statistics, however, are either computationally expensive or prone to generate artifacts due to the trade-off between image quality and runtime performance. In this work, we present an approach for universal style transfer that learns the transformation matrix in a data-driven fashion. Our algorithm is efficient yet flexible to transfer different levels of styles with the same auto-encoder network. It also produces stable video style transfer results due to the preservation of the content affinity. In addition, we propose a linear propagation module to enable a feed-forward network for photo-realistic style transfer. We demonstrate the effectiveness of our approach on three tasks: artistic style, photo-realistic and video style transfer, with comparisons to state-of-the-art methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Zhao, H., Shi, J., Qi, X., Wang, X., & Jia, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.660 · Cited by 16,438
The Cityscapes Dataset for Semantic Urban Scene Understanding
Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., & Schiele, B. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.350 · Cited by 12,433
(2017) · Cited by 11,625
Perceptual Losses for Real-Time Style Transfer and Super-Resolution
Johnson, J., Alahi, A., & Fei-Fei, L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_43 · Cited by 11,283
Image Style Transfer Using Convolutional Neural Networks
Gatys, L. A., Ecker, A. S., & Bethge, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.265 · Cited by 6,025
Arbitrary Style Transfer in Real-Time with Adaptive Instance Normalization
Huang, X., & Belongie, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.167 · Cited by 5,076
Return of Frustratingly Easy Domain Adaptation
Sun, B., Feng, J., & Saenko, K. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10306 · Cited by 2,004 · cited 1×
“Instead of computing the transformation of the 2 nd moment statistic in the intermediate layers of the auto-encoder, as being conducted in many previous work [18, 19, 29], we make the transformation matrix learnable by outputting it via a light-weighted CNN block.”
MethodPlaying for Data: Ground Truth from Computer Games
Richter, S. R., Vineet, V., Roth, S., & Koltun, V. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_7 · Cited by 1,815
Precomputed Real-Time Texture Synthesis with Markovian Generative Adversarial Networks
Li, C., & Wand, M. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46487-9_43 · Cited by 1,421
Ulyanov, D., Vedaldi, A., & Lempitsky, V. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.437 · Cited by 815
A Learned Representation For Artistic Style
Dumoulin, V., Shlens, J., & Kudlur, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.07629 · Cited by 763
Combining Markov Random Fields and Convolutional Neural Networks for Image Synthesis
Li, C., & Wand, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.272 · Cited by 741
Luan, F., Paris, S., Shechtman, E., & Bala, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.740 · Cited by 714
Texture Networks: Feed-forward Synthesis of Textures and Stylized Images
Ulyanov, D., Lebedev, V., Vedaldi, A., & Lempitsky, V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.03417 · Cited by 531
Demystifying Neural Style Transfer
Li, Y., Wang, N., Liu, J., & Hou, X. (2017) · Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/310 · Cited by 514
Controlling Perceptual Factors in Neural Style Transfer
Gatys, L. A., Ecker, A. S., Bethge, M., Hertzmann, A., & Shechtman, E. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.397 · Cited by 486
A Closed-Form Solution to Photorealistic Image Stylization
Li, Y., Liu, M.-Y., Li, X., Yang, M.-H., & Kautz, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01219-9_28 · Cited by 400
Self-citationUniversal Style Transfer via Feature Transforms
Li, Y., Chen, F., Yang, J., Wang, Z., Lü, X., & Yang, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.08086 · Cited by 346
Self-citationAvatar-Net: Multi-scale Zero-Shot Style Transfer by Feature Decoration
Sheng, L., Lin, Z., Shao, J., & Wang, X. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00860 · Cited by 313
Exploring the structure of a real-time, arbitrary neural artistic stylization network
Ghiasi, G., Lee, H., Kudlur, M., Dumoulin, V., & Shlens, J. (2017) · Procedings of the British Machine Vision Conference 2017 · doi:10.5244/c.31.114 · Cited by 306
Universal Style Transfer via Feature Transforms
Li, Y., Chen, F., Yan, S., Wang, Z., Lü, X., & Yang, M. (2017) · neural information processing systems · Cited by 300
Self-citationDiversified Texture Synthesis with Feed-Forward Networks
Li, Y., Fang, C., Yang, J., Wang, Z., Lu, X., & Yang, M.-H. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.36 · Cited by 277
Self-citationMulti-style Generative Network for Real-Time Transfer
Zhang, H., & Dana, K. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-11018-5_32 · Cited by 250
Semantic Style Transfer and Turning Two-Bit Doodles into Fine Artworks
Champandard, A. J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.01768 · Cited by 184
Wang, X., Oxholm, G., Zhang, D., & Wang, Y.-F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.759 · Cited by 182
Stable and Controllable Neural Texture Synthesis and Style Transfer Using Histogram Losses
Risser, E., Wilmot, P., & Barnes, C. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.08893 · Cited by 177
Neural Style Transfer via Meta Networks
Shen, F., Yan, S., & Zeng, G. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00841 · Cited by 139
Split and Match: Example-Based Adaptive Patch Sampling for Unsupervised Style Transfer
Frigo, O., Sabater, N., Delon, J., et al. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.66 · Cited by 134
Characterizing and Improving Stability in Neural Style Transfer
Gupta, A., Johnson, J., Alahi, A., & Fei-Fei, L. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.438 · Cited by 124
Domain Stylization: A Strong, Simple Baseline for Synthetic to Real Image Domain AdaptationPreprint
Dündar, A., Liu, M.-Y., Wang, T.-C., Zedlewski, J., & Kautz, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.09384 · Cited by 76
Self-citation
Cited by
Inversion-based Style Transfer with Diffusion Models
Zhang, Y., Huang, N., Tang, F., Huang, H., Ma, C., Dong, W., & Xu, C. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00978 · Cited by 353
Metadata
- Authors
- Li, X., Liu, S., Kautz, J., & Yang, M.-H.
- Venue
- 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2019-06
- Volume
- 2019
- Pages
- 3804-3812
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2959891120
- Cited by
- 295
- References
- 34
- FWCI
- 10.29
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.