The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
LIRIS-ACCEDE: A Video Database for Affective Content Analysis
Abstract
Research in affective computing requires ground truth data for training and benchmarking computational models for machine-based emotion understanding. In this paper, we propose a large video database, namely LIRIS-ACCEDE, for affective content analysis and related applications, including video indexing, summarization or browsing. In contrast to existing datasets with very few video resources and limited accessibility due to copyright constraints, LIRIS-ACCEDE consists of 9,800 good quality video excerpts with a large content diversity. All excerpts are shared under creative commons licenses and can thus be freely distributed without copyright issues. Affective annotations were achieved using crowdsourcing through a pair-wise video comparison protocol, thereby ensuring that annotations are fully consistent, as testified by a high inter-annotator agreement, despite the large diversity of raters' cultural backgrounds. In addition, to enable fair comparison and landmark progresses of future affective computational models, we further provide four experimental protocols and a baseline for prediction of emotions using a large set of both visual and audio features. The dataset (the video clips, annotations, features and protocols) is publicly available at: http://liris-accede.ec-lyon.fr/.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
Russell, J. A. (1980) · Journal of Personality and Social Psychology · doi:10.1037/h0077714 · Cited by 16,334 · cited 1×
“To ensure reliability and consistency of raters’ affective annotations despite the subjective nature of emotions and the large diversity of their backgrounds, we design a pairwise video excerpt comparison protocol leading to a high inter-rater agreement as revealed by objective measurements.”
Measuring emotion: The self-assessment manikin and the semantic differential
Bradley, M. M., & Lang, P. J. (1994) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/0005-7916(94)90063-9 · Cited by 9,538
Measuring nominal scale agreement among many raters.
Fleiss, J. L. (1971) · Psychological Bulletin · doi:10.1037/h0031619 · Cited by 8,733
DEAP: A Database for Emotion Analysis ;Using Physiological Signals
Koelstra, S., Muhl, C., Soleymani, M., Lee, J.-S., Yazdani, A., Ebrahimi, T., Pun, T., Nijholt, A., & Patras, I. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.15 · Cited by 5,093
SUN database: Large-scale scene recognition from abbey to zoo
Xiao, J., Hays, J., Ehinger, K. A., Oliva, A., & Torralba, A. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539970 · Cited by 3,283
Characterization of signals from multiscale edges
Mallat, S., & Zhong, S. (1992) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.142909 · Cited by 3,200
CROWDSOURCING A WORD–EMOTION ASSOCIATION LEXICON
Mohammad, S. M., & Turney, P. D. (2013) · Computational Intelligence · doi:10.1111/j.1467-8640.2012.00460.x · Cited by 2,634
Emotion elicitation using films
Gross, J. J., & Levenson, R. W. (1995) · Cognition & Emotion · doi:10.1080/02699939508408966 · Cited by 2,179
A Multimodal Database for Affect Recognition and Implicit Tagging
Soleymani, M., Lichtenauer, J., Pun, T., & Pantic, M. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.25 · Cited by 1,664
Emotions evoked by the sound of music: Characterization, classification, and measurement.
Zentner, M., Grandjean, D., & Scherer, K. R. (2008) · Emotion · doi:10.1037/1528-3542.8.4.494 · Cited by 1,229
Schaefer, A., Nils, F., Sanchez, X., & Philippot, P. (2010) · Cognition & Emotion · doi:10.1080/02699930903274322 · Cited by 875
Emotion Elicitation Using Films
Rottenberg, J., Ray, R. D., & Gross, J. J. (2007) · Handbook of Emotion Elicitation and Assessment · doi:10.1093/oso/9780195169157.003.0002 · Cited by 838
The relationship of emotion to cognition: A functional approach to a semantic controversy.
Leventhal, H., & Scherer, K. (1987) · Cognition & Emotion · doi:10.1080/02699938708408361 · Cited by 832
Measuring colorfulness in natural images
Hasler, D., & Suesstrunk, S. E. (2003) · SPIE Proceedings · doi:10.1117/12.477378 · Cited by 729
Skiena, S. S. (2008) · Springer eBooks · doi:10.1007/978-1-84800-070-4 · Cited by 706
Emotional Effects Of Music: Production Rules
Scherer, K. R., & Zentner, M. R. (2001) · Music And Emotion · doi:10.1093/oso/9780192631886.003.0016 · Cited by 662
The Design of High-Level Features for Photo Quality Assessment
Ke, Y., Tang, X., & Jing, F. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPR'06) · doi:10.1109/cvpr.2006.303 · Cited by 630
Affective video content representation and modeling
Hanjalic, A., & Xu, L.-Q. (2005) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2004.840618 · Cited by 594
Estimating the Reliability, Systematic Error and Random Error of Interval Data
Krippendorff, K. (1970) · Educational and Psychological Measurement · doi:10.1177/001316447003000105 · Cited by 491
Photo and Video Quality Evaluation: Focusing on the Subject
Luo, Y., & Tang, X. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88690-7_29 · Cited by 444
Randolph, J. (2005) · Cited by 399
Comparison of automatic shot boundary detection algorithms:
Lienhart, R. W. (1998) · SPIE Proceedings · doi:10.1117/12.333848 · Cited by 394
Inducing and assessing differentiated emotion-feeling states in the laboratory
Philippot, P. (1993) · Cognition and Emotion · doi:10.1080/02699939308409183 · Cited by 390
Douglas-Cowie, E., Cowie, R., Sneddon, I., Cox, C., Lowry, O., McRorie, M., Martin, J.-C., Devillers, L., Abrilian, S., Batliner, A., et al. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74889-2_43 · Cited by 321
Comparison of Four Subjective Methods for Image Quality Assessment
Mantiuk, R. K., Tomaszewska, A., & Mantiuk, R. (2012) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2012.03188.x · Cited by 288
Affective understanding in film
Wang, H. L., & Cheong, L.-F. (2006) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2006.873781 · Cited by 267
Comparing Check-All and Forced-Choice Question Formats in Web Surveys
Smyth, J. D. (2006) · Public Opinion Quarterly · doi:10.1093/poq/nfj007 · Cited by 265
Empirical studies of emotional response to music.
Sloboda, J. A. (2004) · Cognitive bases of musical communication. · doi:10.1037/10104-003 · Cited by 234
Extracting moods from pictures and sounds: towards truly personalized TV
Hanjalic, A. (2006) · IEEE Signal Processing Magazine · doi:10.1109/msp.2006.1621452 · Cited by 227
The Emotional Movie Database (EMDB): A Self-Report and Psychophysiological Study
Carvalho, S., Leite, J., Galdo-Álvarez, S., & Gonçalves, Ó. F. (2012) · Applied Psychophysiology and Biofeedback · doi:10.1007/s10484-012-9201-6 · Cited by 224
Annotation and processing of continuous emotional attributes: Challenges and opportunities
Metallinou, A., & Narayanan, S. S. (2013) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2013.6553804 · Cited by 153
Affective content detection using HMMs
Kang, H.-B. (2003) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/957013.957066 · Cited by 149
Ranking-Based Emotion Recognition for Music Organization and Retrieval
Yang, Y., & Chen, H. H. (2010) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2010.2064164 · Cited by 131
Hierarchical movie affective content analysis based on arousal and valence features
Xu, M. G., Jin, J. S., Luo, S., & Duan, L. (2008) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/1459359.1459457 · Cited by 101
Affective Visualization and Retrieval for Music Video
Zhang, S., Huang, Q., Jiang, S., Gao, W., & Tian, Q. (2010) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2010.2059634 · Cited by 98
Soleymani, M., Chanel, G., Kierkels, J. J. M., & Pun, T. (2008) · IEEE International Symposium on Multimedia (ISM) · doi:10.1109/ism.2008.14 · Cited by 95
A supervised approach to movie emotion tracking
Malandrakis, N., Potamianos, A., Evangelopoulos, G., & Zlatintsi, A. (2011) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2011.5946961 · Cited by 93
Affective Recommendation of Movies Based on Selected Connotative Features
Canini, L., Benini, S., & Leonardi, R. (2012) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2012.2211935 · Cited by 92
Ranking vs. Preference: A Comparative Study of Self-reporting
Yannakakis, G. N., & Hallam, J. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-24600-5_47 · Cited by 90
Crowdsourcing for Affective Annotation of Video: Development of a Viewer-reported Boredom Corpus
Soleymani, M., & Larson, M. (2010) · Archive ouverte UNIGE (University of Geneva) · Cited by 83
A Bayesian framework for video affective representation
Soleymani, M., Kierkels, J. J. M., Chanel, G., & Pun, T. (2009) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2009.5349563 · Cited by 83
Predicting Viewer Perceived Emotions in Animated GIFs
Jou, B., Bhattacharya, S., & Chang, S. (2014) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2647868.2656408 · Cited by 81
Irie, G., Satou, T., Kojima, A., Yamasaki, T., & Aizawa, K. (2010) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2010.2051871 · Cited by 79
Corpus Development for Affective Video Indexing
Soleymani, M., Larson, M., Pun, T., & Hanjalić, A. (2014) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2014.2305573 · Cited by 68
Prediction of the inter-observer visual congruency (IOVC) and application to image ranking
Meur, O. L., Baccino, T., & Roumy, A. (2011) · ACM Multimedia · doi:10.1145/2072298.2072347 · Cited by 66
Multimedia content analysis for emotional characterization of music video clips
Yazdani, A., Skodras, E., Fakotakis, N. D., & Ebrahimi, T. (2013) · EURASIP Journal on Image and Video Processing · doi:10.1186/1687-5281-2013-26 · Cited by 60
A Large Video Database for Computational Models of Induced Emotion
Baveye, Y., Bettinelli, J.-N., Dellandréa, E., Chen, L., & Chamaret, C. (2013) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2013.9 · Cited by 52
Self-citationAffective Level Video Segmentation by Utilizing the Pleasure-Arousal-Dominance Information
Arifin, S., & Cheung, P. Y. K. (2008) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2008.2004911 · Cited by 52
An improved valence-arousal emotion space for video affective content representation and recognition
Sun, K., Yu, J., Huang, Y., & Hu, X. (2009) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2009.5202559 · Cited by 52
Corpus Development for Affective Video Indexing
Soleymani, M., Larson, M., Pun, T., & Hanjalić, A. (2014) · Archive ouverte UNIGE (University of Geneva) · Cited by 49
Affective content detection using HMMs
Kang, H.-B. (2003) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/957052.957066 · Cited by 49
Video indexing and recommendation based on affective analysis of viewers
Zhao, S., Yao, H., Sun, X., Xu, P., Liu, X., & Ji, R. (2011) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2072298.2072043 · Cited by 47
Sun, K., & Yu, J. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-74889-2_52 · Cited by 42
Multimedia stimuli databases usage patterns: a survey reportPreprint
Horvat, M., Popović, S., & Ćosić, K. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1303.4893 · Cited by 14
Image and Video Saliency Models Improvement by Blur Identification
Baveye, Y., Urban, F., & Chamaret, C. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33564-8_34 · Cited by 11
Self-citation
Cited by
EmotionMeter: A Multimodal Framework for Recognizing Human Emotions
Zheng, W.-L., Liu, W., Lu, Y., Lu, B.-L., & Cichocki, A. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2797176 · Cited by 1,276
Survey on Emotional Body Gesture Recognition
Noroozi, F., Corneanu, C. A., Kaminska, D., Sapinski, T., Escalera, S., & Anbarjafari, G. (2021) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2874986 · Cited by 455
Real-Time Movie-Induced Discrete Emotion Recognition from EEG Signals
Liu, Y.-J., Yu, M., Zhao, G., Song, J., Ge, Y., & Shi, Y. (2018) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2660485 · Cited by 356
Metadata
- Authors
- Baveye, Y., Dellandrea, E., Chamaret, C., & Chen, L.
- Venue
- IEEE Transactions on Affective Computing
- Published
- 2015-01-01
- Volume
- 6
- Issue
- 1
- Pages
- 43-55
- ISSN
- 1949-3045 (ISSN-L)
- OpenAlex
- W2044807399
- Cited by
- 306
- References
- 56
- FWCI
- 40.52
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.