The DOI matches its Crossref record; 55 of the 60 references it cites were found in a registry or an index.
The YouTube Lens: Crowdsourced Personality Impressions and Audiovisual Analysis of Vlogs
Open accessAbstract
Despite an increasing interest in understanding human perception in social media through the automatic analysis of users' personality, existing attempts have explored user profiles and text blog data only. We approach the study of personality impressions in social media from the novel perspective of crowdsourced impressions, social attention, and audiovisual behavioral analysis on slices of conversational vlogs extracted from YouTube. Conversational vlogs are a unique case study to understand users in social media, as vloggers implicitly or explicitly share information about themselves that words, either written or spoken cannot convey. In addition, research in vlogs may become a fertile ground for the study of video interactions, as conversational video expands to innovative applications. In this work, we first investigate the feasibility of crowdsourcing personality impressions from vlogging as a way to obtain judgements from a variate audience that consumes social media video. Then, we explore how these personality impressions mediate the online video watching experience and relate to measures of attention in YouTube. Finally, we investigate on the use of automatic nonverbal cues as a suitable lens through which impressions are made, and we address the task of automatic prediction of vloggers' personality impressions using nonverbal cues and machine learning techniques. Our study, conducted on a dataset of 442 YouTube vlogs and 2210 annotations collected in Amazon's Mechanical Turk, provides new findings regarding the suitability of collecting personality impressions from crowdsourcing, the types of personality impressions that emerge through vlogging, their association with social attention, and the level of utilization of nonverbal cues in this particular setting. In addition, it constitutes a first attempt to address the task of automatic vlogger personality impression prediction using nonverbal cues, with promising results.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Robust Real-Time Face Detection
Viola, P., & Jones, M. J. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000013087.49260.fb · Cited by 14,097
A tutorial on support vector regression
Smola, A. J., & Schölkopf, B. (2004) · Statistics and Computing · doi:10.1023/b:stco.0000035301.49549.88 · Cited by 13,723
Journal of personality and social psychology
Armstrong, J. (1988) · International Journal of Forecasting · doi:10.1016/0169-2070(88)90126-4 · Cited by 10,544
Amazon's Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data?
Buhrmester, M., Kwang, T., & Gosling, S. D. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691610393980 · Cited by 9,996
A very brief measure of the Big-Five personality domains
Gosling, S. D., Rentfrow, P. J., & Swann, W. B. (2003) · Journal of Research in Personality · doi:10.1016/s0092-6566(03)00046-1 · Cited by 8,307
An Introduction to the Five‐Factor Model and Its Applications
McCrae, R. R., & John, O. P. (1992) · Journal of Personality · doi:10.1111/j.1467-6494.1992.tb00970.x · Cited by 6,835
Journal of Statistical Software
de Leeuw, J. (2009) · Wiley Interdisciplinary Reviews Computational Statistics · doi:10.1002/wics.10 · Cited by 3,651
Robust real-time object detection.
Viola, P. A. (2001) · Cited by 2,340
Nonverbal communication in human interaction
Knapp, M. L. (1972) · Cited by 2,183
Research works printed but not linked: 9
- 2011, Thanks YouTube Community for Two BIG Gifts on Our Sixth Birthday!
- huberman, 2009, Social attention in the age of the web, Working Together or Apart Promoting the Next Generation of Digital Scholarship, 62
- 0, Skyecandy
- 0, Oovoo
- 2011, Shortform Video Platform VYou Reels in $3M
- 0, Videogenie
- 10.1037/0022-3514.81.1.116 · DOI · Paper page
- scherer, 1979, Social markers in speech, 147
- mason, 2010, A guide to conducting behavioral research on Amazon's mechanical turk, Social Science Research Network Working Paper Series
Cited by
Sorted by citations
Scherer, K. R., Schuller, B., & Elkins, A. (2017) · Cambridge University Press eBooks · doi:10.1017/9781316676202 · Cited by 768
“The main difference with respect to “standard” SSP approaches is the adoption of social network inspired features (e.g., number of times a video has been watched, on-line ratings, etc.) typically available in social media (Biel and Gatica-Perez, 2012; Salvagnini et al., 2012).”
A Survey of Personality Computing
Vinciarelli, A., & Mohammadi, G. (2014) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2014.2330816 · Cited by 540
Corneanu, C. A., Simon, M. O., Cohn, J. F., & Guerrero, S. E. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2515606 · Cited by 527
“Visual cues can refer to eye gaze [260], [261], frowning, head orientation, mouth fidgeting [260], primary FEs [252], [253] or characteristics of”
BackgroundComputational personality recognition in social media
Farnadi, G., Sitaraman, G., Sushmita, S., Celli, F., Kosiński, M., Stillwell, D. J., Davalos, S. V., Moens, M., & Cock, M. D. (2016) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-016-9171-0 · Cited by 224
Lab And/Or Field? Measuring Personality Processes and Their Social Consequences
Wrzus, C., & Mehl, M. R. (2015) · European Journal of Personality · doi:10.1002/per.1986 · Cited by 200
“Biel and Gatica-Perez (2013) recently explored crowdsourcing personality perceptions via Amazon’s Mechanical Turk.”
Background
Metadata
- Authors
- Biel, J.-I., & Gatica-Perez, D.
- Affiliations
- École Polytechnique Fédérale de Lausanne (CH)
- Venue
- IEEE Transactions on Multimedia
- Published
- 2013-01
- Volume
- 15
- Issue
- 1
- Pages
- 41-55
- ISSN
- 1520-9210 (ISSN-L)
- 1941-0077
- OpenAlex
- W2028422222
- Cited by
- 209
- References
- 60
- Citations by year
- 2026: 6 · 2025: 10 · 2024: 7 · 2023: 9 · 2022: 16 · 2021: 20 · 2020: 16 · 2019: 20 · 2018: 18 · 2017: 24 · 2016: 23 · 2015: 13 · 2014: 20 · 2013: 6
- FWCI
- 17.14
- Type
- journal article
- Language
- en
- Open access
- green
- infoscience.epfl.ch
- Locations
- IEEE Transactions on Multimedia (publishedVersion)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion, cc-by-nc-nd)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Social Sciences › Business, Management and Accounting › Marketing › Digital Marketing and Social Media
- Keywords
- personality impressions, vlogs, YouTube, crowdsourcing, nonverbal cues, audiovisual analysis, social attention, personality prediction, conversational video, vloggers, social media perception
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review