The DOI matches its Crossref record; 13 of the 14 references it cites were found in a registry or an index.
FaceTube: predicting personality from facial expressions of emotion in online conversational video
Abstract
The advances in automatic facial expression recognition make possible to mine and characterize large amounts of data, opening a wide research domain on behavioral understanding. In this paper, we leverage the use of a state-of-the-art facial expression recognition technology to characterize users of a popular type of online social video, conversational vlogs. First, we propose the use of several activity cues to characterize vloggers based on frame-by-frame estimates of facial expressions of emotion. Then, we present results for the task of automatically predicting vloggers' personality impressions using facial expressions and the Big-Five traits. Our results are promising, specially for the case of the Extraversion impression, and in addition our work poses interesting questions regarding the representation of multiple natural facial expressions occurring in conversational video.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“While there are works on detecting personality and mood from FEs only [251], [252] the dominant approach is to use multimodality either by combining acoustic with visual cues [251], [257] or physiological with visual cues [258].”
From Survey on RGB, 3D, Thermal, and Multimodal Approaches for Facial Expression Recognition: History, Trends, and Affect-Related Applications (2016) · cites this paper as [251]
In the citing paper
“Practically though, while many studies have showed improvements of prediction when combined with physiological or acoustic cues, FEs remain marginal in the study of personality trait prediction [251], [257], [259], [260].”
From Survey on RGB, 3D, Thermal, and Multimodal Approaches for Facial Expression Recognition: History, Trends, and Affect-Related Applications (2016) · cites this paper as [251]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A very brief measure of the Big-Five personality domains
Gosling, S. D., Rentfrow, P. J., & Swann, W. B. (2003) · Journal of Research in Personality · doi:10.1016/s0092-6566(03)00046-1 · Cited by 8,307
Nonverbal communication in human interaction
Knapp, M. L. (1972) · Cited by 2,183
Automatic facial expression analysis: a survey
Fasel, B., & Luettin, J. (2003) · Pattern Recognition · doi:10.1016/s0031-3203(02)00052-3 · Cited by 1,810
Donato, G., Bartlett, M. S., Hager, J. C., Ekman, P., & B, T. J. S. A. (1999) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.799905 · Cited by 999
Facial expressions of emotion influence interpersonal trait inferences
Knutson, B. (1996) · Journal of Nonverbal Behavior · doi:10.1007/bf02281954 · Cited by 644
The computer expression recognition toolbox (CERT)
Littlewort, G. C., Whitehill, J., Wu, T., Fasel, I., Frank, M. G., Movellan, J. R., & Bartlett, M. S. (2011) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2011.5771414 · Cited by 571
The YouTube Lens: Crowdsourced Personality Impressions and Audiovisual Analysis of Vlogs
Biel, J.-I., & Gatica-Perez, D. (2013) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2012.2225032 · Cited by 209 · cited 20×
“Moreover, in an attempt to address the personality prediction task from automatically extracted nonverbal cues [4], the same authors found that nonverbal cues from audio and visual activity patterns seemed useful mainly to predict Extraversion [4].”
BackgroundMethodResultInfluentialSelf-citationPlease, tell me about yourself: automatic personality assessment using short self-presentations
Batrinca, L. M., Mana, N., Lepri, B., Pianesi, F., & Sebe, N. (2011) · Proceedings of the 13th international conference on multimodal interfaces · doi:10.1145/2070481.2070528 · Cited by 96
You Are Known by How You Vlog: Personality Impressions and Nonverbal Behavior in YouTube
Biel, J.-I., Aran, O., & Gática-Pérez, D. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v5i1.14160 · Cited by 92
Self-citationModeling the Personality of Participants During Group Interactions
Lepri, B., Mana, N., Cappelletti, A., Pianesi, F., & Zancanaro, M. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-02247-0_13 · Cited by 46
Crowdsourced data collection of facial responses
McDuff, D., el Kaliouby, R., & Picard, R. W. (2011) · International Conference on Multimodal Interfaces · doi:10.1145/2070481.2070486 · Cited by 27
Multimodal Biometrics-based Student Attendance Measurement in Learning Management Systems
González-Agulla, E., Rúa, E. A., Alba‐Castro, J. L., Jiménez, D. G., & Anido, L. (2009) · IEEE International Symposium on Multimedia (ISM) · doi:10.1109/ism.2009.25 · Cited by 22
Nonverbal emotion displays, communication modality, and the judgment of personality
Hall, J. A., Gunnery, S. D., & Andrzejewski, S. A. (2010) · Journal of Research in Personality · doi:10.1016/j.jrp.2010.11.012 · Cited by 19
Research works printed but not linked: 1
- 10.5555/1681508.1682269 · DOI
Cited by
Sorted by citations
Corneanu, C. A., Simon, M. O., Cohn, J. F., & Guerrero, S. E. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2515606 · Cited by 527
Recent trends in deep learning based personality detection
Mehta, Y., Majumder, N., Gelbukh, A. F., & Cambria, E. (2019) · Artificial Intelligence Review · doi:10.1007/s10462-019-09770-z · Cited by 352
ChaLearn LAP 2016: First Round Challenge on First Impressions - Dataset and Results
Ponce-López, V., Chen, B., Oliu, M., Corneanu, C. A., Clapés, A., Guyon, I., Baró, X., Escalante, H. J., & Escalera, S. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-49409-8_32 · Cited by 223
Lab And/Or Field? Measuring Personality Processes and Their Social Consequences
Wrzus, C., & Mehl, M. R. (2015) · European Journal of Personality · doi:10.1002/per.1986 · Cited by 200
Facial Expression Recognition Using Computer Vision: A Systematic Review
Canedo, D., & Neves, A. J. R. (2019) · Applied Sciences · doi:10.3390/app9214678 · Cited by 200
Metadata
- Authors
- Biel, J.-I., Teijeiro-Mosquera, L., & Gatica-Perez, D.
- Affiliations
- École Polytechnique Fédérale de Lausanne (CH)
- Universidade de Vigo (ES)
- Ecole Polytechnique Fédérale de Lausanne, Martigny, Switzerland
- Venue
- Proceedings of the 14th ACM international conference on Multimodal interaction
- Publisher
- ACM
- Published
- 2012-10-22
- Pages
- 53-56
- OpenAlex
- W2133269263
- Cited by
- 104
- References
- 14
- Citations by year
- 2026: 6 · 2025: 1 · 2024: 8 · 2023: 6 · 2022: 6 · 2021: 8 · 2020: 9 · 2019: 13 · 2018: 4 · 2017: 11 · 2016: 17 · 2015: 3 · 2014: 8 · 2013: 4
- FWCI
- 9.28
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION (publishedVersion)
- Funders
- Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung
- University of California, San Diego
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face and Expression Recognition
- Keywords
- facial expression recognition, vlogs, personality prediction, Big Five personality traits, extraversion, conversational video, emotion recognition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
