The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
ArtFlow: Unbiased Image Style Transfer via Reversible Neural Flows
Open accessAbstract
Universal style transfer retains styles from reference images in content images. While existing methods have achieved state-of-the-art style transfer performance, they are not aware of the content leak phenomenon that the image content may corrupt after several rounds of stylization process. In this paper, we propose ArtFlow to prevent content leak during universal style transfer. ArtFlow consists of reversible neural flows and an unbiased feature transfer module. It supports both forward and backward inferences and operates in a projection-transfer-reversion scheme. The forward inference projects input images into deep features, while the backward inference remaps deep features back to input images in a lossless and unbiased way. Extensive experiments demonstrate that ArtFlow achieves comparable performance to state-of-the-art style transfer methods while avoiding content leak.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
A Style-Based Generator Architecture for Generative Adversarial Networks
Karras, T., Laine, S., & Aila, T. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00453 · Cited by 11,714
(2017) · Cited by 11,625
Perceptual Losses for Real-Time Style Transfer and Super-Resolution
Johnson, J., Alahi, A., & Fei-Fei, L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_43 · Cited by 11,283
Arbitrary Style Transfer in Real-Time with Adaptive Instance Normalization
Huang, X., & Belongie, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.167 · Cited by 5,076
Instance Normalization: The Missing Ingredient for Fast Stylization
Ulyanov, D., Vedaldi, A., & Lempitsky, V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.08022 · Cited by 2,775
A Neural Algorithm of Artistic Style
Gatys, L., Ecker, A., & Bethge, M. (2016) · Journal of Vision · doi:10.1167/16.12.326 · Cited by 2,612
Hertzmann, A., Jacobs, C. E., Oliver, N., Curless, B., & Salesin, D. H. (2001) · Proceedings of the 28th annual conference on Computer graphics and interactive techniques · doi:10.1145/383259.383295 · Cited by 1,518
NICE: Non-linear Independent Components Estimation
Dinh, L., Krueger, D., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1410.8516 · Cited by 1,493
Training Generative Adversarial Networks with Limited Data
Karras, T., Aittala, M., Hellsten, J., Laine, S., Lehtinen, J., & Aila, T. (2020) · arXiv · doi:10.48550/arxiv.2006.06676 · Cited by 1,170
“Waveglow: a flow-based generative network for speech synthesis,”
Prenger, R., Valle, R., & Catanzaro, B. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8683143 · Cited by 1,004
Separating Style and Content with Bilinear Models
Tenenbaum, J. B., & Freeman, W. T. (2000) · Neural Computation · doi:10.1162/089976600300015349 · Cited by 840 · cited 5×
“Following the theoretical framework of the Bilinear Model [52], we can define the unbiased style transfer as: Definition 1 Suppose we have a bilinear style transfer module f cs = C ( f c ) S ( f s ) , where C, S denote the content factor and the style factor in the bilinear model, respectively. f cs is an unbiased style…”
BackgroundMethodInfluentialUlyanov, D., Vedaldi, A., & Lempitsky, V. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.437 · Cited by 815
A Learned Representation For Artistic Style
Dumoulin, V., Shlens, J., & Kudlur, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.07629 · Cited by 763
Combining Markov Random Fields and Convolutional Neural Networks for Image Synthesis
Li, C., & Wand, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.272 · Cited by 741
Painterly rendering with curved brush strokes of multiple sizes
Hertzmann, A. (1998) · Proceedings of the 25th annual conference on Computer graphics and interactive techniques - SIGGRAPH '98 · doi:10.1145/280814.280951 · Cited by 604
CREST: Convolutional Residual Learning for Visual Tracking
Song, Y., Ma, C., Gong, L., Zhang, J., Lau, R. W. H., & Yang, M.-H. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.279 · Cited by 562
Self-citationWinnemöller, H., Olsen, S. C., & Gooch, B. (2006) · ACM Transactions on Graphics · doi:10.1145/1141911.1142018 · Cited by 533
Texture Networks: Feed-forward Synthesis of Textures and Stylized Images
Ulyanov, D., Lebedev, V., Vedaldi, A., & Lempitsky, V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.03417 · Cited by 531
Demystifying Neural Style Transfer
Li, Y., Wang, N., Liu, J., & Hou, X. (2017) · Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/310 · Cited by 514
StyleBank: An Explicit Representation for Neural Image Style Transfer
Chen, D., Yuan, L., Liao, J., Yu, N., & Hua, G. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.296 · Cited by 502
Visual attribute transfer through deep image analogy
Liao, J., Yao, Y., Yuan, L., Hua, G., & Kang, S. B. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073683 · Cited by 487
A Closed-Form Solution to Photorealistic Image Stylization
Li, Y., Liu, M.-Y., Li, X., Yang, M.-H., & Kautz, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01219-9_28 · Cited by 400
Photorealistic Style Transfer via Wavelet Transforms
Yoo, J., Uh, Y., Chun, S., Kang, B., & Ha, J.-W. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00913 · Cited by 388
Universal Style Transfer via Feature Transforms
Li, Y., Chen, F., Yang, J., Wang, Z., Lü, X., & Yang, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.08086 · Cited by 346
Avatar-Net: Multi-scale Zero-Shot Style Transfer by Feature Decoration
Sheng, L., Lin, Z., Shao, J., & Wang, X. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00860 · Cited by 313
Rethinking Image Inpainting via a Mutual Encoder-Decoder with Feature Equalizations
Liu, H., Jiang, B., Song, Y., Huang, W., & Yang, C. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58536-5_43 · Cited by 290
Self-citationMulti-style Generative Network for Real-Time Transfer
Zhang, H., & Dana, K. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-11018-5_32 · Cited by 250
Ho, J., Chen, X., Srinivas, A., Duan, Y., & Abbeel, P. (2019) · arXiv · Cited by 245
Style transfer for headshot portraits
Shih, Y., Paris, S., Barnes, C., Freeman, W. T., & Durand, F. (2014) · ACM Transactions on Graphics · doi:10.1145/2601097.2601137 · Cited by 219
Real-Time Neural Style Transfer for Videos
Huang, H., Wang, H., Luo, W., Ma, L., Jiang, W., Zhu, X., Li, Z., & Liu, W. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.745 · Cited by 217
Self-citationGlow-TTS: A Generative Flow for Text-to-Speech via Monotonic Alignment Search
Kim, J., Kim, S., Kong, J., & Yoon, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.11129 · Cited by 193
Dynamic Instance Normalization for Arbitrary Style Transfer
Jing, Y., Liu, X., Ding, Y., Wang, X., Ding, E., Song, M., & Wen, S. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5862 · Cited by 189
Wang, X., Oxholm, G., Zhang, D., & Wang, Y.-F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.759 · Cited by 182 · cited 1×
“We categorize these methods into one style per model [29, 54, 23, 53, 55, 58, 44, 30], multi-style per model [7, 3, 19, 14], and universal style transfer methods [4, 32, 20, 45, 15, 2, 56, 38, 60, 1] with respect to their generalization abilities.”
MethodFast Patch-based Style Transfer of Arbitrary Style
Chen, T. Q., & Schmidt, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.04337 · Cited by 182
Arbitrary Style Transfer with Deep Feature Reshuffle
Gu, S., Chen, C., Liao, J., & Yuan, L. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00858 · Cited by 181
Stable and Controllable Neural Texture Synthesis and Style Transfer Using Histogram Losses
Risser, E., Wilmot, P., & Barnes, C. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.08893 · Cited by 177
Unsupervised Deep Representation Learning for Real-Time Tracking
Wang, N., Zhou, W., Song, Y., Ma, C., Liu, W., & Li, H. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-020-01357-4 · Cited by 136
Self-citationSplit and Match: Example-Based Adaptive Patch Sampling for Unsupervised Style Transfer
Frigo, O., Sabater, N., Delon, J., et al. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.66 · Cited by 134
Collaborative Distillation for Ultra-Resolution Universal Style Transfer
Wang, H., Li, Y., Wang, Y., Hu, H. R., & Yang, M. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00193 · Cited by 128
Diversified Arbitrary Style Transfer via Deep Feature Perturbation
Wang, Z., Zhao, L., Chen, H., Qiu, L., Mo, Q., Lin, S., Xing, W., & Lu, D. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00781 · Cited by 114
Preserving Color in Neural Artistic Style TransferPreprint
Gatys, L. A., Bethge, M., Hertzmann, A., & Shechtman, E. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.05897 · Cited by 113
Learning to Hallucinate Face Images via Component Generation and Enhancement
Song, Y., Zhang, J., He, S., Bao, L., & Yang, Q. (2017) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/633 · Cited by 111
Self-citationBeautyGlow: On-Demand Makeup Transfer Framework With Reversible Generative Network
Chen, H.-J., Hui, K.-M., Wang, S.-Y., Tsao, L.-W., Shuai, H.-H., & Cheng, W.-H. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01028 · Cited by 109
Learning Linear Transformations for Fast Arbitrary Style TransferPreprint
Li, X., Liu, S., Kautz, J., & Yang, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.04537 · Cited by 104
Laplacian-Steered Neural Style Transfer
Li, S., Xu, X., Nie, L., & Chua, T.-S. (2017) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3123266.3123425 · Cited by 103
Ultrafast Photorealistic Style Transfer via Neural Architecture Search
An, J., Xiong, H., Huan, J., & Luo, J. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6614 · Cited by 75
Self-citationRethinking Image Deraining via Rain Streaks and Vapors
Wang, Y., Song, Y., Ma, C., & Zeng, B. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58520-4_22 · Cited by 65
Self-citationJoint Face Hallucination and Deblurring via Structure Generation and Detail Enhancement
Song, Y., Zhang, J., Gong, L., et al. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-019-01148-6 · Cited by 54
Self-citationStylizing face images via multiple exemplars
Song, Y., Bao, L., He, S., et al. (2017) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2017.08.009 · Cited by 40
Self-citationNeural Stereoscopic Image Style Transfer
Gong, X., Huang, H., Ma, L., Shen, F., Liu, W., & Zhang, T. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01228-1_4 · Cited by 35
Self-citationReal-time Universal Style Transfer on High-resolution Images via Zero-channel PruningPreprint
An, J., Li, T., Huang, H., Li, S., Wang, X., Tang, Y., Ma, J., Liu, W., & Luo, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.09029 · Cited by 17
Self-citationGeometric Style TransferPreprint
Liu, X.-C., Li, X., Cheng, M., & Hall, P. M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.05471 · Cited by 14
Cited by
StyTr2: Image Style Transfer with Transformers
Deng, Y., Tang, F., Dong, W., Ma, C., Pan, X., Wang, L., & Xu, C. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01104 · Cited by 402
Inversion-based Style Transfer with Diffusion Models
Zhang, Y., Huang, N., Tang, F., Huang, H., Ma, C., Dong, W., & Xu, C. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00978 · Cited by 353
Metadata
- Authors
- An, J., Huang, S., Song, Y., Dou, D., Liu, W., & Luo, J.
- Venue
- 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2021-06
- Pages
- 862-871
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W3177457352
- Cited by
- 262
- References
- 56
- FWCI
- 14.38
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.