The DOI matches its Crossref record; 82 of the 82 references it cites were found in a registry or an index.
State of the "Art”: A Taxonomy of Artistic Stylization Techniques for Images and Video
Abstract
This paper surveys the field of nonphotorealistic rendering (NPR), focusing on techniques for transforming 2D input (images and video) into artistically stylized renderings. We first present a taxonomy of the 2D NPR algorithms developed over the past two decades, structured according to the design characteristics and behavior of each technique. We then describe a chronology of development from the semiautomatic paint systems of the early nineties, through to the automated painterly rendering systems of the late nineties driven by image gradient analysis. Two complementary trends in the NPR literature are then addressed, with reference to our taxonomy. First, the fusion of higher level computer vision and NPR, illustrating the trends toward scene analysis to drive artistic abstraction and diversity of style. Second, the evolution of local processing approaches toward edge-aware filtering for real-time stylization of images and video. The survey then concludes with a discussion of open challenges for 2D NPR identified in recent NPR symposia, including topics such as user and aesthetic evaluation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Kass, M., Witkin, A., & Terzopoulos, D. (1988) · International Journal of Computer Vision · doi:10.1007/bf00133570 · Cited by 17,070
Least squares quantization in PCM
Lloyd, S. (1982) · IEEE Transactions on Information Theory · doi:10.1109/tit.1982.1056489 · Cited by 15,836
Mean shift: a robust approach toward feature space analysis
Comaniciu, D., & Meer, P. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.1000236 · Cited by 11,305
Texture synthesis by non-parametric sampling
Efros, A. A., & Leung, T. K. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790383 · Cited by 3,023
Reinhard, E., Adhikhmin, M., Gooch, B., & Shirley, P. (2001) · IEEE Computer Graphics and Applications · doi:10.1109/38.946629 · Cited by 2,937
Image quilting for texture synthesis and transfer
Efros, A. A., & Freeman, W. T. (2001) · Proceedings of the 28th annual conference on Computer graphics and interactive techniques · doi:10.1145/383259.383296 · Cited by 2,347
Anisotropic diffusion in image processing
Weickert, J. (1998) · Cited by 2,225
Hertzmann, A., Jacobs, C. E., Oliver, N., Curless, B., & Salesin, D. H. (2001) · Proceedings of the 28th annual conference on Computer graphics and interactive techniques · doi:10.1145/383259.383295 · Cited by 1,518
Edge-preserving decompositions for multi-scale tone and detail manipulation
Farbman, Z., Fattal, R., Lischinski, D., & Szeliski, R. (2008) · ACM Transactions on Graphics · doi:10.1145/1360612.1360666 · Cited by 1,443
Fast texture synthesis using tree-structured vector quantization
Wei, L.-Y., & Levoy, M. (2000) · Proceedings of the 27th annual conference on Computer graphics and interactive techniques - SIGGRAPH '00 · doi:10.1145/344779.345009 · Cited by 1,356
Imaging vector fields using line integral convolution
Cabral, B., & Leedom, L. C. (1993) · Proceedings of the 20th annual conference on Computer graphics and interactive techniques · doi:10.1145/166117.166151 · Cited by 1,315
Ulichney, R. A. (1987) · Cited by 808
Feature-Oriented Image Enhancement Using Shock Filters
Osher, S., & Rudin, L. I. (1990) · SIAM Journal on Numerical Analysis · doi:10.1137/0727053 · Cited by 785
Ulichney, R. (1987) · The MIT Press eBooks · doi:10.7551/mitpress/2421.001.0001 · Cited by 672
Principles of traditional animation applied to 3D computer animation
Lasseter, J. (1987) · Proceedings of the 14th annual conference on Computer graphics and interactive techniques · doi:10.1145/37401.37407 · Cited by 620
Painterly rendering with curved brush strokes of multiple sizes
Hertzmann, A. (1998) · Proceedings of the 25th annual conference on Computer graphics and interactive techniques - SIGGRAPH '98 · doi:10.1145/280814.280951 · Cited by 604
Bilateral Filtering: Theory and Applications
Paris, S., Kornprobst, P., Tumblin, J., & Durand, F. (2009) · Foundations and Trends in Computer Graphics and Vision · doi:10.1561/0600000020 · Cited by 586
Schödl, A., Szeliski, R., Salesin, D. H., & Essa, I. (2000) · Proceedings of the 27th annual conference on Computer graphics and interactive techniques - SIGGRAPH '00 · doi:10.1145/344779.345012 · Cited by 571
Winnemöller, H., Olsen, S. C., & Gooch, B. (2006) · ACM Transactions on Graphics · doi:10.1145/1141911.1142018 · Cited by 533
Gooch, B., & Gooch, A. (2001) · A K Peters/CRC Press eBooks · doi:10.1201/9781439864173 · Cited by 467
Curtis, C. J., Anderson, S. E., Seims, J. E., Fleischer, K. W., & Salesin, D. H. (1997) · Proceedings of the 24th annual conference on Computer graphics and interactive techniques - SIGGRAPH '97 · doi:10.1145/258734.258896 · Cited by 457
Stylization and abstraction of photographs
DeCarlo, D., & Santella, A. (2002) · Proceedings of the 29th annual conference on Computer graphics and interactive techniques · doi:10.1145/566570.566650 · Cited by 432
Processing images and video for an impressionist effect
Litwinowicz, P. (1997) · Proceedings of the 24th annual conference on Computer graphics and interactive techniques - SIGGRAPH '97 · doi:10.1145/258734.258893 · Cited by 384
Edge detection with embedded confidence
Meer, P., & Georgescu, B. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.977560 · Cited by 377
Liu, C., Torralba, A., Freeman, W. T., Durand, F., & Adelson, E. H. (2005) · ACM Transactions on Graphics · doi:10.1145/1073204.1073223 · Cited by 301
Orientable textures for image-based pen-and-ink illustration
Salisbury, M. P., Wong, M. T., Hughes, J. F., & Salesin, D. H. (1997) · Proceedings of the 24th annual conference on Computer graphics and interactive techniques - SIGGRAPH '97 · doi:10.1145/258734.258890 · Cited by 293
Kang, H., Lee, S., & Chui, C. K. (2007) · Proceedings of the 5th international symposium on Non-photorealistic animation and rendering · doi:10.1145/1274871.1274878 · Cited by 279
Interactive pen-and-ink illustration
Salisbury, M. P., Anderson, S. E., Barzel, R., & Salesin, D. H. (1994) · Proceedings of the 21st annual conference on Computer graphics and interactive techniques - SIGGRAPH '94 · doi:10.1145/192161.192185 · Cited by 270
Secord, A. (2002) · Proceedings of the 2nd international symposium on Non-photorealistic animation and rendering · doi:10.1145/508530.508537 · Cited by 239
A survey of stroke-based rendering
Hertzmann, A. (2003) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2003.1210867 · Cited by 238
Carroll, J. M., Kellogg, W. A., & Rosson, M. B. (1991) · Cambridge University Press eBooks · Cited by 235
Human facial illustrations: Creation and psychophysical evaluation
Gooch, B., Reinhard, E., & Gooch, A. (2004) · ACM Transactions on Graphics · doi:10.1145/966131.966133 · Cited by 229
Strassmann, S. (1986) · ACM SIGGRAPH Computer Graphics · doi:10.1145/15886.15911 · Cited by 222
Wang, J., Xu, Y., Shum, H.-Y., & Cohen, M. F. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015763 · Cited by 214
Keyframe-based tracking for rotoscoping and animation
Agarwala, A., Hertzmann, A., Salesin, D. H., & Seitz, S. M. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015764 · Cited by 210
Floating Points: A Method for Computing Stipple Drawings
Deussen, O., Hiller, S., Van Overveld, C., & Strothotte, T. (2000) · Computer Graphics Forum · doi:10.1111/1467-8659.00396 · Cited by 208
Kang, H., Lee, S., & Chui, C. K. (2009) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2008.81 · Cited by 187
Lee, T. (2005) · Cited by 183
Geodesic image and video editing
Criminisi, A., Sharp, T., Rother, C., & P'erez, P. (2010) · ACM Transactions on Graphics · doi:10.1145/1857907.1857910 · Cited by 175
Automated generation of interactive 3D exploded view diagrams
Li, W., Agrawala, M., Curless, B., & Salesin, D. (2008) · ACM Transactions on Graphics · doi:10.1145/1360612.1360700 · Cited by 136
From image parsing to painterly rendering
Zeng, K., Zhao, M., Xiong, C., & Zhu, S. C. (2009) · ACM Transactions on Graphics · doi:10.1145/1640443.1640445 · Cited by 135
An invitation to discuss computer depiction
Durand, F. (2002) · International Symposium on Non-Photorealistic Animation and Rendering (NPAR) · doi:10.1145/508530.508550 · Cited by 128
Progressive color transfer for images of arbitrary dynamic range
Pouli, T., & Reinhard, E. (2010) · Computers & Graphics · doi:10.1016/j.cag.2010.11.003 · Cited by 120
Image and Video Abstraction by Anisotropic Kuwahara Filtering
Kyprianidis, J. E., Kang, H., & Döllner, J. (2009) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2009.01574.x · Cited by 119
Self-citationAshikhmin, M. (2003) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2003.1210863 · Cited by 108
Image Abstraction by Structure Adaptive Filtering
Kyprianidis, J. E., & Döllner, J. (2008) · Eurographics · doi:10.2312/localchapterevents/tpcg/tpcg08/051-058 · Cited by 104
Self-citationHertzmann, A. (2002) · Computer Graphics International · doi:10.1109/cgi.2001.934657 · Cited by 103
Image and Video Abstraction by Coherence‐Enhancing Filtering
Kyprianidis, J. E., & Kang, H. (2011) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2011.01882.x · Cited by 99
Self-citationVisual interest and NPR: an evaluation and manifesto
Santella, A., & DeCarlo, D. (2004) · International Symposium on Non-Photorealistic Animation and Rendering (NPAR) · doi:10.1145/987657.987669 · Cited by 96
Pang, W., Qu, Y., Wong, T., Cohen‐Or, D., & Heng, P. (2008) · ACM Transactions on Graphics · doi:10.1145/1360612.1360688 · Cited by 95
Structure-preserving manipulation of photographs
Orzan, A., Bousseau, A., Barla, P., & Thollot, J. (2007) · International Symposium on Non-Photorealistic Animation and Rendering (NPAR) · doi:10.1145/1274871.1274888 · Cited by 91
Artistic Edge and Corner Enhancing Smoothing
Pápari, G., Petkov, N., & Campisi, P. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.903912 · Cited by 86
Non-photorealistic rendering in context
Isenberg, T., Isenberg, P., Carpendale, S., Sousa, M. C., & Jorge, J. A. (2006) · International Symposium on Non-Photorealistic Animation and Rendering (NPAR) · doi:10.1145/1124728.1124747 · Cited by 81
Self-citationWinnemöller, H., Olsen, S. C., & Gooch, B. (2006) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1179352.1142018 · Cited by 80
Lee, H., Seo, S., Ryoo, S.-T., & Yoon, K. (2010) · International Symposium on Non-Photorealistic Animation and Rendering (NPAR) · doi:10.1145/1809939.1809945 · Cited by 78
Non-Photorealistic Rendering and the science of art
Hertzmann, A. (2010) · International Symposium on Non-Photorealistic Animation and Rendering (NPAR) · doi:10.1145/1809939.1809957 · Cited by 78
Abstracted painterly renderings using eye-tracking data
Santella, A., & DeCarlo, D. (2002) · International Symposium on Non-Photorealistic Animation and Rendering (NPAR) · doi:10.1145/508530.508544 · Cited by 76
Winnemöller, H. (2011) · doi:10.1145/2024676.2024700 · Cited by 71
Empathic painting: interactive stylization through observed emotional state
Shugrina, M., Betke, M., & Collomosse, J. P. (2006) · International Symposium on Non-Photorealistic Animation and Rendering (NPAR) · doi:10.1145/1124728.1124744 · Cited by 65
Self-citationFast Primitive Distribution for Illustration
Secord, A., Heidrich, W., & Streit, L. M. (2002) · doi:10.2312/egwr/egwr02/215-226 · Cited by 60
The Electric Sheep Screen-Saver: A Case Study in Aesthetic Evolution
Draves, S. (2005) · Lecture notes in computer science · doi:10.1007/978-3-540-32003-6_46 · Cited by 58
Zhao, M., & Zhu, S. C. (2010) · International Symposium on Non-Photorealistic Animation and Rendering (NPAR) · doi:10.1145/1809939.1809951 · Cited by 58
Portrait painting using active templates
Zhao, M., & Zhu, S. C. (2011) · doi:10.1145/2024676.2024696 · Cited by 57
Shape‐simplifying Image Abstraction
Kang, H., & Lee, S. (2008) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2008.01322.x · Cited by 55
Kim, S. Y., Maciejewski, R., Isenberg, T., Andrews, W. M., Chen, W., Sousa, M. C., & Ebert, D. S. (2009) · International Symposium on Non-Photorealistic Animation and Rendering (NPAR) · doi:10.1145/1572614.1572622 · Cited by 55
Self-citationEmotionally aware automated portrait painting
Colton, S., Valstar, M., & Pantić, M. (2008) · Digital Interactive Media in Entertainment and Arts · doi:10.1145/1413634.1413690 · Cited by 48
Richness-preserving manga screening
Qu, Y., Pang, W., Wong, T., & Heng, P. (2008) · ACM Transactions on Graphics · doi:10.1145/1409060.1409108 · Cited by 47
Abstraction of 2D shapes in terms of parts
Mi, X., DeCarlo, D., & Stone, M. (2009) · International Symposium on Non-Photorealistic Animation and Rendering (NPAR) · doi:10.1145/1572614.1572617 · Cited by 46
Defining Pictorial Style: Lessons from Linguistics and Computer Graphics
Willats, J., & Durand, F. (2005) · Axiomathes · doi:10.1007/s10516-004-5449-7 · Cited by 46
SnakeToonz: a semi-automatic approach to creating cel animation from video
Agarwala, A. (2002) · International Symposium on Non-Photorealistic Animation and Rendering (NPAR) · doi:10.1145/508530.508554 · Cited by 41
Maharik, R., Bessmeltsev, M., Sheffer, A., Shamir, A., & Carr, N. (2011) · ACM Transactions on Graphics · doi:10.1145/2010324.1964995 · Cited by 39
A spectral approach to NPR packing
Dalal, K., Klein, A. W., Liu, Y., & Smith, K. (2006) · International Symposium on Non-Photorealistic Animation and Rendering (NPAR) · doi:10.1145/1124728.1124741 · Cited by 38
Image and video abstraction by multi-scale anisotropic Kuwahara filtering
Kyprianidis, J. E. (2011) · doi:10.1145/2024676.2024686 · Cited by 33
Self-citationPainterly animation using video semantics and feature correspondence
Lin, L., Zeng, K., Lv, H., Wang, Y., Xu, Y., & Zhu, S. C. (2010) · International Symposium on Non-Photorealistic Animation and Rendering (NPAR) · doi:10.1145/1809939.1809948 · Cited by 31
Structure-preserving stippling by priority-based error diffusion
Li, H., & Mould, D. (2011) · Graphics Interface · Cited by 29
Maharik, R., Bessmeltsev, M., Sheffer, A., Shamir, A., & Carr, N. (2011) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1964921.1964995 · Cited by 25
Modeling with rendering primitives
Schwarz, M., Isenberg, T., Mason, K. M., et al. (2007) · International Symposium on Non-Photorealistic Animation and Rendering (NPAR) · doi:10.1145/1274871.1274874 · Cited by 21
Self-citationContinuous Glass Patterns for Painterly Rendering
Pápari, G., & Petkov, N. (2009) · IEEE Transactions on Image Processing · doi:10.1109/tip.2008.2009800 · Cited by 18
Bangham, J., Gibson, S. E., & Harvey, R. (2003) · British Machine Vision Conference (BMVC) · doi:10.5244/c.17.58 · Cited by 17
Video stylization for digital ambient displays of home movies
Wang, T., Collomosse, J. P., Slatter, D., Cheatle, P., & Greig, D. (2010) · International Symposium on Non-Photorealistic Animation and Rendering (NPAR) · doi:10.1145/1809939.1809955 · Cited by 12
Self-citationOptimization of Paintbrush Rendering of Images by Dynamic MCMC Methods
Szirányi, T., & Toth, Z. G. (2001) · Lecture notes in computer science · doi:10.1007/3-540-44745-8_14 · Cited by 10
DeCarlo, D., & Stone, M. (2010) · International Symposium on Non-Photorealistic Animation and Rendering (NPAR) · doi:10.1145/1809939.1809960 · Cited by 8
Cited by
Image Style Transfer Using Convolutional Neural Networks
Gatys, L. A., Ecker, A. S., & Bethge, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.265 · Cited by 6,025
Arbitrary Style Transfer in Real-Time with Adaptive Instance Normalization
Huang, X., & Belongie, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.167 · Cited by 5,076
A Neural Algorithm of Artistic Style
Gatys, L., Ecker, A., & Bethge, M. (2016) · Journal of Vision · doi:10.1167/16.12.326 · Cited by 2,612
Neural Style Transfer: A Review
Jing, Y., Yang, Y., Feng, Z., Ye, J., Yu, Y., & Song, M. (2020) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2019.2921336 · Cited by 856
Unsupervised Cross-Domain Image Generation
Taigman, Y., Polyak, A., & Wolf, L. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.02200 · Cited by 359
Metadata
- Authors
- Kyprianidis, J. E., Collomosse, J., Wang, T., & Isenberg, T.
- Venue
- IEEE Transactions on Visualization and Computer Graphics
- Published
- 2013-05
- Volume
- 19
- Issue
- 5
- Pages
- 866-885
- ISSN
- 1077-2626 (ISSN-L)
- OpenAlex
- W2109253138
- Cited by
- 270
- References
- 82
- FWCI
- 32.58
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.