The DOI matches its Crossref record; 58 of the 58 references it cites were found in a registry or an index.
Visual attribute transfer through deep image analogy
Open accessAbstract
We propose a new technique for visual attribute transfer across images that may have very different appearance but have perceptually similar semantic structure. By visual attribute transfer, we mean transfer of visual information (such as color, tone, texture, and style) from one image to another. For example, one image could be that of a painting or a sketch while the other is a photo of a real scene, and both depict the same type of scene. Our technique finds semantically-meaningful dense correspondences between two input images. To accomplish this, it adapts the notion of "image analogy" [Hertzmann et al. 2001] with features extracted from a Deep Convolutional Neutral Network for matching; we call our technique deep image analogy. A coarse-to-fine strategy is used to compute the nearest-neighbor field for generating the results. We validate the effectiveness of our proposed method in a variety of cases, including style/texture transfer, color/style swap, sketch/painting to photo, and time lapse.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
(1981) · Cited by 11,963
Perceptual Losses for Real-Time Style Transfer and Super-Resolution
Johnson, J., Alahi, A., & Fei-Fei, L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_43 · Cited by 11,283
Algorithm 778: L-BFGS-B: Fortran subroutines for large-scale bound-constrained optimization
Zhu, C., Byrd, R. H., Lu, P., & Nocedal, J. (1997) · ACM Transactions on Mathematical Software · doi:10.1145/279232.279236 · Cited by 3,462
Reinhard, E., Adhikhmin, M., Gooch, B., & Shirley, P. (2001) · IEEE Computer Graphics and Applications · doi:10.1109/38.946629 · Cited by 2,937
PatchMatch: a randomized correspondence algorithm for structural image editing
Barnes, C., Shechtman, E., Finkelstein, A., & Goldman, D. B. (2009) · ACM Transactions on Graphics · doi:10.1145/1531326.1531330 · Cited by 2,880
A Neural Algorithm of Artistic Style
Gatys, L., Ecker, A., & Bethge, M. (2016) · Journal of Vision · doi:10.1167/16.12.326 · Cited by 2,612
High Accuracy Optical Flow Estimation Based on a Theory for Warping
Brox, T., Bruhn, A., Papenberg, N., & Weickert, J. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24673-2_3 · Cited by 2,570
Image quilting for texture synthesis and transfer
Efros, A. A., & Freeman, W. T. (2001) · Proceedings of the 28th annual conference on Computer graphics and interactive techniques · doi:10.1145/383259.383296 · Cited by 2,347
A Database and Evaluation Methodology for Optical Flow
Baker, S., Scharstein, D., Lewis, J. P., Roth, S., Black, M. J., & Szeliski, R. (2011) · International Journal of Computer Vision · doi:10.1007/s11263-010-0390-2 · Cited by 2,205 · cited 2×
“Category (I) is tested on the Middlebury optical flow benchmark dataset [Baker et al. 2011], total 23 color image pairs.”
MethodSIFT Flow: Dense Correspondence across Scenes and Its Applications
Liu, C., Yuen, J., & Torralba, A. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.147 · Cited by 1,582
Hertzmann, A., Jacobs, C. E., Oliver, N., Curless, B., & Salesin, D. H. (2001) · Proceedings of the 28th annual conference on Computer graphics and interactive techniques · doi:10.1145/383259.383295 · Cited by 1,518
Edge-preserving decompositions for multi-scale tone and detail manipulation
Farbman, Z., Fattal, R., Lischinski, D., & Szeliski, R. (2008) · ACM Transactions on Graphics · doi:10.1145/1360612.1360666 · Cited by 1,443
Matching Local Self-Similarities across Images and Videos
Shechtman, E., & Irani, M. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383198 · Cited by 1,076
DeepFlow: Large Displacement Optical Flow with Deep Matching
Weinzaepfel, P., Revaud, J., Harchaoui, Z., & Schmid, C. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.175 · Cited by 997
Combining Markov Random Fields and Convolutional Neural Networks for Image Synthesis
Li, C., & Wand, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.272 · Cited by 741
Beyond PASCAL: A benchmark for 3D object detection in the wild
Xiang, Y., Mottaghi, R., & Savarese, S. (2014) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2014.6836101 · Cited by 727
Transferring color to greyscale images
Welsh, T., Ashikhmin, M., & Mueller, K. (2002) · Proceedings of the 29th annual conference on Computer graphics and interactive techniques · doi:10.1145/566570.566576 · Cited by 713
Summarizing visual data using bidirectional similarity
Simakov, D., Caspi, Y., Shechtman, E., & Irani, M. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587842 · Cited by 613
Sketch2Photo: internet image montage
Chen, T., Cheng, M.-M., Tan, P., Shamir, A., & Hu, S.-M. (2009) · ACM Transactions on Graphics · doi:10.1145/1618452.1618470 · Cited by 574
Inceptionism: Going Deeper into Neural Networks
Mordvintsev, A., Olah, C., & Tyka, M. (2015) · Cited by 574
Texture Networks: Feed-forward Synthesis of Textures and Stylized Images
Ulyanov, D., Lebedev, V., Vedaldi, A., & Lempitsky, V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.03417 · Cited by 531
The Generalized PatchMatch Correspondence Algorithm
Barnes, C., Shechtman, E., Goldman, D. B., & Finkelstein, A. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15558-1_3 · Cited by 530
StyleBank: An Explicit Representation for Neural Image Style Transfer
Chen, D., Yuan, L., Liao, J., Yu, N., & Hua, G. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.296 · Cited by 502
Self-citationTexture Synthesis Using Convolutional Neural Networks
Gatys, L. A., Ecker, A. S., & Bethge, M. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1505.07376 · Cited by 378
Learning Dense Correspondence via 3D-Guided Cycle Consistency
Zhou, T., Krahenbuhl, P., Aubry, M., Huang, Q., & Efros, A. A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.20 · Cited by 350
Local Color Transfer via Probabilistic Segmentation by Expectation-Maximization
Tai, Y.-W., Jia, J., & Tang, C.-K. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.215 · Cited by 332
N-dimensional probability density function transfer and its application to color transfer
Pitie, F., Kokaram, A. C., & Dahyot, R. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.166 · Cited by 331
Non-rigid dense correspondence with applications for image enhancement
HaCohen, Y., Shechtman, E., Goldman, D. B., & Lischinski, D. (2011) · ACM SIGGRAPH 2011 papers · doi:10.1145/1964921.1964965 · Cited by 287
Large displacement optical flow
Brox, T., Bregler, C., & Malik, J. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206697 · Cited by 277
Transient attributes for high-level understanding and editing of outdoor scenes
Laffont, P.-Y., Ren, Z., Tao, X., Qian, C., & Hays, J. (2014) · ACM Transactions on Graphics · doi:10.1145/2601097.2601101 · Cited by 271
Registration of Challenging Image Pairs: Initialization, Estimation, and Decision
Yang, G., Stewart, C. V., Sofka, M., & Tsai, C.-L. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1116 · Cited by 259
Edge-preserving decompositions for multi-scale tone and detail manipulation
Farbman, Z., Fattal, R., Lischinski, D., & Szeliski, R. (2008) · ACM SIGGRAPH 2008 papers · doi:10.1145/1399504.1360666 · Cited by 252
Non-rigid dense correspondence with applications for image enhancement
HaCohen, Y., Shechtman, E., Goldman, D. B., & Lischinski, D. (2011) · ACM Transactions on Graphics · doi:10.1145/2010324.1964965 · Cited by 247
Style transfer for headshot portraits
Shih, Y., Paris, S., Barnes, C., Freeman, W. T., & Durand, F. (2014) · ACM Transactions on Graphics · doi:10.1145/2601097.2601137 · Cited by 219
Data-driven visual similarity for cross-domain image matching
Shrivastava, A., Malisiewicz, T., Gupta, A., & Efros, A. A. (2011) · Proceedings of the 2011 SIGGRAPH Asia Conference · doi:10.1145/2024156.2024188 · Cited by 209
Reed, S., Zhang, Y., Zhang, Y., & Lee, H. (2015) · neural information processing systems · Cited by 198
Efficient Coarse-to-Fine Patch Match for Large Displacement Optical Flow
Hu, Y., Song, R., & Li, Y. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.615 · Cited by 188
Data-driven hallucination of different times of day from a single outdoor photo
Shih, Y., Paris, S., Durand, F., & Freeman, W. T. (2013) · ACM Transactions on Graphics · doi:10.1145/2508363.2508419 · Cited by 187
Painting style transfer for head portraits using convolutional neural networks
Selim, A., Elgharib, M., & Doyle, L. (2016) · ACM Transactions on Graphics · doi:10.1145/2897824.2925968 · Cited by 181
Data-driven visual similarity for cross-domain image matching
Shrivastava, A., Malisiewicz, T., Gupta, A. K., & Efros, A. A. (2011) · ACM Transactions on Graphics · doi:10.1145/2070781.2024188 · Cited by 155
Split and Match: Example-Based Adaptive Patch Sampling for Unsupervised Style Transfer
Frigo, O., Sabater, N., Delon, J., et al. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.66 · Cited by 134
Ashikhmin, M. (2003) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2003.1210863 · Cited by 108
DAISY Filter Flow: A Generalized Discrete Approach to Dense Correspondences
Yang, H., Lin, W.-Y., & Lu, J. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.435 · Cited by 92
CG2Real: Improving the Realism of Computer Generated Images Using a Large Collection of Photographs
Johnson, M. K., Dale, K. M., Avidan, S., Pfister, H., Freeman, W. T., & Matusik, W. (2010) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2010.233 · Cited by 90
Lee, H., Seo, S., Ryoo, S.-T., & Yoon, K. (2010) · International Symposium on Non-Photorealistic Animation and Rendering (NPAR) · doi:10.1145/1809939.1809945 · Cited by 78
Image restoration using online photo collections
Dale, K. M., Johnson, M. K., Sunkavalli, K., Matusik, W., & Pfister, H. (2009) · IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2009.5459473 · Cited by 75
Ham, B., Cho, M., Schmid, C., & Ponce, J. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · Cited by 73
Automating Image Morphing Using Structural Similarity on a Halfway Domain
Liao, J., Lima, R. S., Nehab, D., Hoppe, H., Sander, P. V., & Yu, J. (2014) · ACM Transactions on Graphics · doi:10.1145/2629494 · Cited by 67
Self-citationBarnes, C., Zhang, F., Lou, L., et al. (2015) · ACM Transactions on Graphics · doi:10.1145/2766934 · Cited by 58
Automatic alignment of paintings and photographs depicting a 3D scene
Russell, B. C., Šivic, J., Ponce, J., & Dessales, H. (2011) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2011.6130291 · Cited by 56
Consistent image analogies using semi-supervised learning
Cheng, L., Vishwanathan, S. V. N., & Zhang, X. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587364 · Cited by 29
Needle-Match: Reliable Patch Matching under High Uncertainty
Lotan, O., & Irani, M. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.54 · Cited by 22
Regional foremost matching for internet scene images
Shen, X., Tao, X., Zhou, C., Gao, H., & Jia, J. (2016) · ACM Transactions on Graphics · doi:10.1145/2980179.2980249 · Cited by 10
Cited by
Neural Style Transfer: A Review
Jing, Y., Yang, Y., Feng, Z., Ye, J., Yu, Y., & Song, M. (2020) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2019.2921336 · Cited by 856
StyleGAN-NADA: CLIP-guided domain adaptation of image generators
Gal, R., Patashnik, O., Maron, H., Bermano, A. H., Chechik, G., & Cohen-Or, D. (2022) · ACM Transactions on Graphics · doi:10.1145/3528223.3530164 · Cited by 500
Deformable GANs for Pose-Based Human Image Generation
Siarohin, A., Sangineto, E., Lathuiliere, S., & Sebe, N. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00359 · Cited by 489
CartoonGAN: Generative Adversarial Networks for Photo Cartoonization
Chen, Y., Lai, Y.-K., & Liu, Y.-J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00986 · Cited by 428
Photorealistic Style Transfer via Wavelet Transforms
Yoo, J., Uh, Y., Chun, S., Kang, B., & Ha, J.-W. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00913 · Cited by 388
Metadata
- Authors
- Liao, J., Yao, Y., Yuan, L., Hua, G., & Kang, S. B.
- Venue
- ACM Transactions on Graphics
- Published
- 2017-07-20
- Volume
- 36
- Issue
- 4
- Pages
- 1-15
- ISSN
- 0730-0301 (ISSN-L)
- 1557-7368
- OpenAlex
- W2611605760
- Cited by
- 487
- References
- 58
- FWCI
- 24.26
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.