The DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index.
Aesthetics and Emotions in Images
Abstract
In this tutorial, we define and discuss key aspects of the problem of computational inference of aesthetics and emotion from images. We begin with a background discussion on philosophy, photography, paintings, visual arts, and psychology. This is followed by introduction of a set of key computational problems that the research community has been striving to solve and the computational framework required for solving them. We also describe data sets available for performing assessment and outline several real-world applications where research in this domain can be employed. A significant number of papers that have attempted to solve problems in aesthetics and emotion inference are surveyed in this tutorial. We also discuss future directions that researchers can pursue and make a strong case for seriously attempting to solve problems in this research domain.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Content-based image retrieval at the end of the early years
Smeulders, A. W. M., Worring, M., Santini, S., Gupta, A., & Jain, R. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.895972 · Cited by 6,056
Freud, S. (1913) · MacMillan Co eBooks · doi:10.1037/10561-000 · Cited by 5,920
Bower, G. H. (1981) · American Psychologist · doi:10.1037/0003-066x.36.2.129 · Cited by 4,154
Using collaborative filtering to weave an information tapestry
Goldberg, D., Nichols, D., Oki, B. M., & Terry, D. (1992) · Communications of the ACM · doi:10.1145/138859.138867 · Cited by 4,066
Looking at pictures: Affective, facial, visceral, and behavioral reactions
LANG, P. J., GREENWALD, M. K., BRADLEY, M. M., & HAMM, A. O. (1993) · Psychophysiology · doi:10.1111/j.1469-8986.1993.tb03352.x · Cited by 3,190
Image retrieval: Ideas, influences, and trends of the new age
Datta, R., Joshi, D., Li, J., & Wang, J. Z. (2008) · ACM Computing Surveys · doi:10.1145/1348246.1348248 · Cited by 3,040
Self-citationFab: content-based, collaborative recommendation
Balabanović, M., & Shoham, Y. (1997) · Communications of the ACM · doi:10.1145/245108.245124 · Cited by 2,934
Processing Fluency and Aesthetic Pleasure: Is Beauty in the Perceiver's Processing Experience?
Reber, R., Schwarz, N., & Winkielman, P. (2004) · Personality and Social Psychology Review · doi:10.1207/s15327957pspr0804_3 · Cited by 2,907
International Affective Picture System (IAPS) : Technical Manual and Affective Ratings
Lang, P. J. (1995) · Medical Entomology and Zoology · Cited by 2,870
Arnheim, R. (1974) · doi:10.1525/9780520351271 · Cited by 1,997
80 Million Tiny Images: A Large Data Set for Nonparametric Object and Scene Recognition
Torralba, A., Fergus, R., & Freeman, W. T. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.128 · Cited by 1,921
Languages of Art: An Approach to a Theory of Symbols
Goodman, N. (1976) · Bloomsbury Publishing Plc eBooks · doi:10.5040/9781350928541 · Cited by 1,596
Iconology: Image, Text, Ideology
Mitchell, W. J. T. (1986) · doi:10.7208/chicago/9780226148052.001.0001 · Cited by 1,295
Designing games with a purpose
von Ahn, L., & Dabbish, L. (2008) · Communications of the ACM · doi:10.1145/1378704.1378719 · Cited by 1,155
Studying Aesthetics in Photographic Images Using a Computational Approach
Datta, R., Joshi, D., Li, J., & Wang, J. Z. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744078_23 · Cited by 1,107
Self-citationvon Ahn, L. (2006) · Computer · doi:10.1109/mc.2006.196 · Cited by 955
The science of art: A neurological theory of aesthetic experience
Ramachandran, V. S., & Hirstein, W. (1999) · PhilPapers (PhilPapers Foundation) · Cited by 900
Beauty in a smile: the role of medial orbitofrontal cortex in facial attractiveness
O’Doherty, J., Winston, J., Critchley, H., Perrett, D., Burt, D. M., & Dolan, R. J. (2003) · Neuropsychologia · doi:10.1016/s0028-3932(02)00145-8 · Cited by 898
Kawabata, H., & Zeki, S. (2004) · Journal of Neurophysiology · doi:10.1152/jn.00696.2003 · Cited by 880
IM2GPS: estimating geographic information from a single image
Hays, J., & Efros, A. A. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587784 · Cited by 877
Affective image classification using features inspired by psychology and art theory
Machajdik, J., & Hanbury, A. (2010) · Proceedings of the 18th ACM international conference on Multimedia · doi:10.1145/1873951.1873965 · Cited by 852
Facial shape and judgements of female attractiveness
Perrett, D. I., May, K. A., & Yoshikawa, S. (1994) · Nature · doi:10.1038/368239a0 · Cited by 849
The visible differences predictor: an algorithm for the assessment of image fidelity
Daly, S. J. (1993) · The MIT Press eBooks · Cited by 828
Visible differences predictor: an algorithm for the assessment of image fidelity
Daly, S. J. (1992) · SPIE Proceedings · doi:10.1117/12.135952 · Cited by 718
Scene completion using millions of photographs
Hays, J., & Efros, A. A. (2007) · ACM SIGGRAPH 2007 papers · doi:10.1145/1275808.1276382 · Cited by 687
The Design of High-Level Features for Photo Quality Assessment
Ke, Y., Tang, X., & Jing, F. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPR'06) · doi:10.1109/cvpr.2006.303 · Cited by 630
West, C. K., & Berlyne, D. E. (1978) · Journal of Aesthetic Education · doi:10.2307/3331807 · Cited by 627
No-reference quality assessment using natural scene statistics: JPEG2000
Sheikh, H. R., Bovik, A. C., & Cormack, L. (2005) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.854492 · Cited by 575
Facial attractiveness, symmetry and cues of good genes
Scheib, J. E., Gangestad, S. W., & Thornhill, R. (1999) · Proceedings of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rspb.1999.0866 · Cited by 551
The Art Instinct: Beauty, Pleasure, and Human Evolution: Dennis Dutton
Hickman, R. (2010) · International Journal of Art & Design Education · doi:10.1111/j.1476-8070.2010.01651.x · Cited by 489
Fractal analysis of Pollock's drip paintings
Taylor, R. P., Micolich, A. P., & Jonas, D. (1999) · Nature · doi:10.1038/20833 · Cited by 410
Generating diverse and representative image search results for landmarks
Kennedy, L. S., & Naaman, M. (2008) · International World Wide Web Conference (WWW) · doi:10.1145/1367497.1367539 · Cited by 392
Kennedy, L., Naaman, M., Ahern, S., Nair, R., & Rattenbury, T. (2007) · Proceedings of the 15th ACM international conference on Multimedia · doi:10.1145/1291233.1291384 · Cited by 385
Modulation of aesthetic value by semantic context: An fMRI study
Kirk, U., Skov, M., Hulme, O., Christensen, M. S., & Zeki, S. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.10.009 · Cited by 381
The Art Instinct: Beauty, Pleasure, and Human Evolution
Dutton, D. (2008) · Cited by 379
Art and Culture: Critical Essays
Colt, P., Greenberg, C., & Canaday, J. (1962) · Art Journal · doi:10.2307/774678 · Cited by 379
Fechner, G. T. (2013) · Cambridge University Press eBooks · doi:10.1017/cbo9781139854597 · Cited by 351
Image processing for artist identification
Johnson, C. R., Hendriks, E., Berezhnoy, I., Brevdo, E., Hughes, S. M., Daubechies, I. C., Li, J., Postma, E. O., & Wang, J. Z. (2008) · IEEE Signal Processing Magazine · doi:10.1109/msp.2008.923513 · Cited by 298
Self-citationAesthetic Visual Quality Assessment of Paintings
Li, C., & Chen, T. (2009) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2009.2015077 · Cited by 273
Facial Attractiveness: Beauty and the Machine
Eisenthal, Y., Dror, G., & Ruppin, E. (2006) · Neural Computation · doi:10.1162/089976606774841602 · Cited by 273
A framework for photo-quality assessment and enhancement based on visual aesthetics
Bhattacharya, S., Sukthankar, R., & Shah, M. (2010) · Proceedings of the 18th ACM international conference on Multimedia · doi:10.1145/1873951.1873990 · Cited by 268
Inner Vision: An Exploration of Art and the Brain
Alais, D. (2000) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01518-7 · Cited by 263
The Role of Formal Art Training on Perception and Aesthetic Judgment of Art Compositions
Nodine, C. F., Locher, P. J., & Krupinski, E. A. (1993) · Leonardo · doi:10.2307/1575815 · Cited by 244
The evaluation of high art and popular art by naive and experienced viewers.
Winston, A. S., & Cupchik, G. C. (1992) · Visual Arts Research · Cited by 208
Beauty in the Eye of Expert and Nonexpert Beholders: A Study in the Appraisal of Art
Hekkert, P., & Wieringen, P. C. W. V. (1996) · The American Journal of Psychology · doi:10.2307/1423013 · Cited by 194
Asymmetry and human facial attractiveness: symmetry may not always be beautiful
(1995) · Proceedings of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rspb.1995.0124 · Cited by 191
Emotional valence categorization using holistic image features
Yanulevskaya, V., van Gemert, J. C., Roth, K., Herbold, A. K., Sebe, N., & Geusebroek, J. M. (2008) · 2008 15th IEEE International Conference on Image Processing · doi:10.1109/icip.2008.4711701 · Cited by 190
Studying Digital Imagery of Ancient Paintings by Mixtures of Stochastic Models
Li, J., & Wang, J. Z. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.821349 · Cited by 184
Self-citationAlgorithmic inferencing of aesthetics and emotion in natural images: An exposition
Datta, R., Li, J., & Wang, J. Z. (2008) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2008.4711702 · Cited by 155
Self-citationCheng, B., Ni, B., Yan, S., & Tian, Q. (2010) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/1873951.1873992 · Cited by 154
Painting by Numbers: Komar and Melamid's Scientific Guide to Art
Wypijewski, J. (1999) · Journal of Aesthetics and Art Criticism · doi:10.2307/432083 · Cited by 143
THE FACE, BEAUTY, AND SYMMETRY: PERCEIVING ASYMMETRY IN BEAUTIFUL FACES
Zaidel, D. W., & COHEN, J. A. (2005) · International Journal of Neuroscience · doi:10.1080/00207450590914464 · Cited by 118
A survey on emotional semantic image retrieval
Wang, N., & He, Q. (2008) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2008.4711705 · Cited by 118
The Experimental Psychology of Beauty
Valentine, C. W. (2015) · Routledge eBooks · doi:10.4324/9781315707617 · Cited by 114
Toward a perceptual video-quality metric
Watson, A. B. (1998) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.320105 · Cited by 110
Evaluation of image appeal in consumer photography
Savakis, A. E., Etz, S. P., & Loui, A. C. P. (2000) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.387147 · Cited by 96
Photo assessment based on computational visual attention model
Sun, X., Yao, H., Ji, R., & Liu, S. (2009) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/1631272.1631351 · Cited by 94
Freeman, M. (2007) · Routledge eBooks · doi:10.4324/9780080556161 · Cited by 81
Arapakis, I., Konstas, I., & Jose, J. M. (2009) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/1631272.1631336 · Cited by 78
Computational reconstruction of ancient artifacts
Willis, A., & Cooper, D. B. (2008) · IEEE Signal Processing Magazine · doi:10.1109/msp.2008.923101 · Cited by 70
Geo-location inference from image content and user tags
Gallagher, A., Joshi, D., Yu, J., & Luo, J. (2009) · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2009.5204168 · Cited by 59
Self-citationLearning the consensus on visual quality for next-generation image management
Datta, R., Li, J., & Wang, J. Z. (2007) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/1291233.1291364 · Cited by 52
Self-citationRetrieval of Images From Artistic Repositories Using a Decision Fusion Framework
Kushki, A., Androutsos, P., Plataniotis, K. N., & Venetsanopoulos, A. N. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.821350 · Cited by 52
Facial Expression Recognition: A Fully Integrated Approach
Valenti, R., Sebe, N., & Gevers, T. (2007) · doi:10.1109/iciapw.2007.25 · Cited by 45
Facial asymmetry quantification for expression invariant human identification
Liu, Y., Schmidt, K. L., Cohn, J. F., & Weaver, R. (2003) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.2002.1004156 · Cited by 45
Measuring the perceived aesthetic quality of photographic images
Cerosaletti, C. D., & Loui, A. C. P. (2009) · International Conference on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex.2009.5246977 · Cited by 34
Subramanian, R., Katti, H., Huang, R. Z., Chua, T., & Kankanhalli, M. (2009) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/1631272.1631399 · Cited by 28
Analysis of human attractiveness using manifold kernel regression
Davis, B. C., & Lazebnik, S. (2008) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2008.4711703 · Cited by 23
An analysis of the relationship between painters based on their work
Bressan, M., Cifarelli, C., & Perronnin, F. (2008) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2008.4711704 · Cited by 21
Zunjarwad, A., Sundaram, H., & Xie, L. (2007) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/1291233.1291382 · Cited by 20
Sonify your face: facial expressions for sound generation
Valenti, R., Jaimes, A., & Sebe, N. (2010) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/1873951.1874219 · Cited by 14
Cited by
AVA: A large-scale database for aesthetic visual analysis
Murray, N., Marchesotti, L., & Perronnin, F. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247954 · Cited by 936
Large-scale visual sentiment ontology and detectors using adjective noun pairs
Borth, D., Ji, R., Chen, T., Breuel, T., & Chang, S.-F. (2013) · Proceedings of the 21st ACM international conference on Multimedia · doi:10.1145/2502081.2502282 · Cited by 851
Robust Image Sentiment Analysis Using Progressively Trained and Domain Transferred Deep Networks
You, Q., Luo, J., Jin, H., & Yang, J. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9179 · Cited by 548
Self-citationDeep Learning the City: Quantifying Urban Perception at a Global Scale
Dubey, A., Naik, N., Parikh, D., Raskar, R., & Hidalgo, C. A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_12 · Cited by 513
RAPID: Rating Pictorial Aesthetics using Deep Learning
Lu, X., Lin, Z., Jin, H., Yang, J., & Wang, J. Z. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654927 · Cited by 383
Self-citation
Metadata
- Authors
- Joshi, D., Datta, R., Fedorovskaya, E., Luong, Q.-T., Wang, J., Li, J., & Luo, J.
- Venue
- IEEE Signal Processing Magazine
- Published
- 2011-09
- Volume
- 28
- Issue
- 5
- Pages
- 94-115
- ISSN
- 1053-5888 (ISSN-L)
- OpenAlex
- W2063948594
- Cited by
- 408
- References
- 71
- FWCI
- 7.08
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.