The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Deep Photo Style Transfer
Open accessAbstract
This paper introduces a deep-learning approach to photographic style transfer that handles a large variety of image content while faithfully transferring the reference style. Our approach builds upon the recent work on painterly transfer that separates style from the content of an image by considering different layers of a neural network. However, as is, this approach is not suitable for photorealistic style transfer. Even when both the input and reference images are photographs, the output still exhibits distortions reminiscent of a painting. Our contribution is to constrain the transformation from the input to the output to be locally affine in colorspace, and to express this constraint as a custom fully differentiable energy term. We show that this approach successfully suppresses distortion and yields satisfying photorealistic style transfers in a broad variety of scenarios, including transfer of the time of day, weather, season, and artistic edits.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2016) · arXiv · doi:10.48550/arxiv.1606.00915 · Cited by 22,392
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2699184 · Cited by 22,392
Image Style Transfer Using Convolutional Neural Networks
Gatys, L. A., Ecker, A. S., & Bethge, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.265 · Cited by 6,025
Reinhard, E., Adhikhmin, M., Gooch, B., & Shirley, P. (2001) · IEEE Computer Graphics and Applications · doi:10.1109/38.946629 · Cited by 2,937
A Closed-Form Solution to Natural Image Matting
Levin, A., Lischinski, D., & Weiss, Y. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1177 · Cited by 1,616
Hertzmann, A., Jacobs, C. E., Oliver, N., Curless, B., & Salesin, D. H. (2001) · Proceedings of the 28th annual conference on Computer graphics and interactive techniques · doi:10.1145/383259.383295 · Cited by 1,518
Combining Markov Random Fields and Convolutional Neural Networks for Image Synthesis
Li, C., & Wand, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.272 · Cited by 741
Two-scale tone management for photographic look
Bae, S., Paris, S., & Durand, F. (2006) · ACM Transactions on Graphics · doi:10.1145/1141911.1141935 · Cited by 332
Self-citationN-dimensional probability density function transfer and its application to color transfer
Pitie, F., Kokaram, A. C., & Dahyot, R. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.166 · Cited by 331
Transient attributes for high-level understanding and editing of outdoor scenes
Laffont, P.-Y., Ren, Z., Tao, X., Qian, C., & Hays, J. (2014) · ACM Transactions on Graphics · doi:10.1145/2601097.2601101 · Cited by 271
Style transfer for headshot portraits
Shih, Y., Paris, S., Barnes, C., Freeman, W. T., & Durand, F. (2014) · ACM Transactions on Graphics · doi:10.1145/2601097.2601137 · Cited by 219
Self-citationMulti-scale image harmonization
Sunkavalli, K., Johnson, M. K., Matusik, W., & Pfister, H. (2010) · ACM Transactions on Graphics · doi:10.1145/1778765.1778862 · Cited by 211
Data-driven hallucination of different times of day from a single outdoor photo
Shih, Y., Paris, S., Durand, F., & Freeman, W. T. (2013) · ACM Transactions on Graphics · doi:10.1145/2508363.2508419 · Cited by 187
Self-citationSemantic Style Transfer and Turning Two-Bit Doodles into Fine Artworks
Champandard, A. J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.01768 · Cited by 184
Painting style transfer for head portraits using convolutional neural networks
Selim, A., Elgharib, M., & Doyle, L. (2016) · ACM Transactions on Graphics · doi:10.1145/2897824.2925968 · Cited by 181
Deep Manifold Traversal: Changing Labels with Convolutional FeaturesPreprint
Gardner, J. R., Upchurch, P., Kusner, M. J., Li, Y., Weinberger, K. Q., Bala, K., & Hopcroft, J. E. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.06421 · Cited by 84
Self-citationTwo-scale tone management for photographic look
Bae, S., Paris, S., & Durand, F. (2006) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1179352.1141935 · Cited by 68
Self-citation
Cited by
Data augmentation for improving deep learning in image classification problem
Mikolajczyk, A., & Grochowski, M. (2018) · 2018 International Interdisciplinary PhD Workshop (IIPhDW) · doi:10.1109/iiphdw.2018.8388338 · Cited by 1,697
Contrastive Learning for Unpaired Image-to-Image Translation
Park, T., Efros, A. A., Zhang, R., & Zhu, J.-Y. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58545-7_19 · Cited by 1,442
Data augmentation: A comprehensive survey of modern approaches
Mumuni, A., & Mumuni, F. (2022) · Array · doi:10.1016/j.array.2022.100258 · Cited by 891
Neural Style Transfer: A Review
Jing, Y., Yang, Y., Feng, Z., Ye, J., Yu, Y., & Song, M. (2020) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2019.2921336 · Cited by 856
Shift-Net: Image Inpainting via Deep Feature Rearrangement
Yan, Z., Li, X., Li, M., Zuo, W., & Shan, S. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_1 · Cited by 511
Metadata
- Authors
- Luan, F., Paris, S., Shechtman, E., & Bala, K.
- Venue
- 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2017-07
- Pages
- 6997-7005
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2604721644
- Cited by
- 714
- References
- 18
- FWCI
- 24.35
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.