The DOI matches its Crossref record; 55 of the 60 references it cites were found in a registry or an index.
The YouTube Lens: Crowdsourced Personality Impressions and Audiovisual Analysis of Vlogs
Open accessAbstract
Despite an increasing interest in understanding human perception in social media through the automatic analysis of users' personality, existing attempts have explored user profiles and text blog data only. We approach the study of personality impressions in social media from the novel perspective of crowdsourced impressions, social attention, and audiovisual behavioral analysis on slices of conversational vlogs extracted from YouTube. Conversational vlogs are a unique case study to understand users in social media, as vloggers implicitly or explicitly share information about themselves that words, either written or spoken cannot convey. In addition, research in vlogs may become a fertile ground for the study of video interactions, as conversational video expands to innovative applications. In this work, we first investigate the feasibility of crowdsourcing personality impressions from vlogging as a way to obtain judgements from a variate audience that consumes social media video. Then, we explore how these personality impressions mediate the online video watching experience and relate to measures of attention in YouTube. Finally, we investigate on the use of automatic nonverbal cues as a suitable lens through which impressions are made, and we address the task of automatic prediction of vloggers' personality impressions using nonverbal cues and machine learning techniques. Our study, conducted on a dataset of 442 YouTube vlogs and 2210 annotations collected in Amazon's Mechanical Turk, provides new findings regarding the suitability of collecting personality impressions from crowdsourcing, the types of personality impressions that emerge through vlogging, their association with social attention, and the level of utilization of nonverbal cues in this particular setting. In addition, it constitutes a first attempt to address the task of automatic vlogger personality impression prediction using nonverbal cues, with promising results.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Robust Real-Time Face Detection
Viola, P., & Jones, M. J. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000013087.49260.fb · Cited by 14,097
A tutorial on support vector regression
Smola, A. J., & Schölkopf, B. (2004) · Statistics and Computing · doi:10.1023/b:stco.0000035301.49549.88 · Cited by 13,723
Journal of personality and social psychology
Armstrong, J. (1988) · International Journal of Forecasting · doi:10.1016/0169-2070(88)90126-4 · Cited by 10,544
Amazon's Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data?
Buhrmester, M., Kwang, T., & Gosling, S. D. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691610393980 · Cited by 9,996
A very brief measure of the Big-Five personality domains
Gosling, S. D., Rentfrow, P. J., & Swann, W. B. (2003) · Journal of Research in Personality · doi:10.1016/s0092-6566(03)00046-1 · Cited by 8,307
An Introduction to the Five‐Factor Model and Its Applications
McCrae, R. R., & John, O. P. (1992) · Journal of Personality · doi:10.1111/j.1467-6494.1992.tb00970.x · Cited by 6,835
Journal of Statistical Software
de Leeuw, J. (2009) · Wiley Interdisciplinary Reviews Computational Statistics · doi:10.1002/wics.10 · Cited by 3,608
Robust real-time object detection.
Viola, P. A. (2001) · Cited by 2,340
Nonverbal communication in human interaction
Knapp, M. L. (1972) · Cited by 2,183
Thin slices of expressive behavior as predictors of interpersonal consequences: A meta-analysis.
Ambady, N., & Rosenthal, R. (1992) · Psychological Bulletin · doi:10.1037/0033-2909.111.2.256 · Cited by 2,003
Crowdsourcing user studies with Mechanical Turk
Kittur, A., Ed, H., & Suh, B. (2008) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357127 · Cited by 1,941
I tube, you tube, everybody tubes
Cha, M., Kwak, H., Rodríguez, P., Ahn, Y., & Moon, S. B. (2007) · ACM Internet Measurement Conference (IMC) · doi:10.1145/1298306.1298309 · Cited by 1,571
YouTube: online video and participatory culture
(2010) · Choice Reviews Online · doi:10.5860/choice.47-2989 · Cited by 1,134
Using linguistic cues for the automatic recognition of personality in conversation and text
Mairesse, F., Walker, M. A., Mehl, M. R., & Moore, R. K. (2007) · Journal of Artificial Intelligence Research · doi:10.1613/jair.2349 · Cited by 1,046
Who attains social status? Effects of personality and physical attractiveness in social groups.
Anderson, C., John, O. P., Keltner, D., & Kring, A. M. (2001) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.81.1.116 · Cited by 987
Nonparametric Statistics for Non‐Statisticians
Corder, G. W., & Foreman, D. I. (2009) · Wiley eBooks · doi:10.1002/9781118165881 · Cited by 971
Publicly Private and Privately Public: Social Networking on YouTube
Lange, P. G. (2007) · Journal of Computer-Mediated Communication · doi:10.1111/j.1083-6101.2007.00400.x · Cited by 962
A room with a cue: Personality judgments based on offices and bedrooms.
Gosling, S. D., Ko, S. J., Mannarelli, T., & Morris, M. E. (2002) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.82.3.379 · Cited by 895
Personality in 100,000 Words: A large-scale analysis of personality and word use among bloggers
Yarkoni, T. (2010) · Journal of Research in Personality · doi:10.1016/j.jrp.2010.04.001 · Cited by 637
Trait inferences: Sources of validity at zero acquaintance.
Borkenau, P., & Liebler, A. (1992) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.62.4.645 · Cited by 630
What is the central feature of extraversion? Social attention versus reward sensitivity
Ashton, M. C., Lee, K., & Paunonen, S. V. (2002) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.83.1.245 · Cited by 481
e-Perceptions: Personality Impressions Based on Personal Websites.
Vazire, S., & Gosling, S. D. (2004) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.87.1.123 · Cited by 460
Pentland, A. (2008) · The MIT Press eBooks · doi:10.7551/mitpress/8022.001.0001 · Cited by 371
On judging and being judged accurately in zero-acquaintance situations.
Ambady, N., Hallahan, M., & Rosenthal, R. (1995) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.69.3.518 · Cited by 367
A thin slice perspective on the accuracy of first impressions
Carney, D. R., Colvin, C. R., & Hall, J. A. (2007) · Journal of Research in Personality · doi:10.1016/j.jrp.2007.01.004 · Cited by 358
Automatic nonverbal analysis of social interaction in small groups: A review
Gática-Pérez, D. (2009) · Image and Vision Computing · doi:10.1016/j.imavis.2009.01.004 · Cited by 309
Consensus and dissention: A measure of ordinal dispersion
Tastle, W. J., & Wierman, M. J. (2006) · International Journal of Approximate Reasoning · doi:10.1016/j.ijar.2006.06.024 · Cited by 286
Crowdsourcing, attention and productivity
Huberman, B. A., Romero, D. M., & Wu, F. (2009) · Journal of Information Science · doi:10.1177/0165551509346786 · Cited by 266
YouTube and You Experiences of Self-Awareness in the Context Collapse of the Recording Webcam
Wesch, M. (2009) · Explorations in Media Ecology · doi:10.1386/eme.8.2.99_1 · Cited by 249
YouTube: Online Video and Participatory Culture
(2010) · Online Information Review · doi:10.1108/14684521011037052 · Cited by 235
Personality impressions based on facebook profiles
Gosling, S. D., Gaddis, S., & Vazire, S. (2007) · Cited by 221
Modeling dominance in group conversations using nonverbal activity cues
Jayagopi, D. B., Hung, H., Yeo, C., & Gatica-Perez, D. (2009) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2008.2008238 · Cited by 217
Oberlander, J., & Nowson, S. (2006) · International Conference on Computational Linguistics and Annual Meeting of the Association for Computational Linguistics (COLING/ACL) · doi:10.3115/1273073.1273154 · Cited by 211
Dovidio, J. F., & Ellyson, S. L. (1982) · Social Psychology Quarterly · doi:10.2307/3033933 · Cited by 164
What Are They Blogging About? Personality, Topic and Motivation in Blogs
Gill, A. J., Nowson, S., & Oberlander, J. (2009) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v3i1.13949 · Cited by 144
Nguyen, D. T., & Canny, J. (2009) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518770 · Cited by 104
Using Crowdsourcing and Active Learning to Track Sentiment in Online Media
Brew, A., Greene, D., & Cunningham, P. (2010) · Frontiers in artificial intelligence and applications · doi:10.3233/978-1-60750-606-5-145 · Cited by 101
Please, tell me about yourself: automatic personality assessment using short self-presentations
Batrinca, L. M., Mana, N., Lepri, B., Pianesi, F., & Sebe, N. (2011) · Proceedings of the 13th international conference on multimodal interfaces · doi:10.1145/2070481.2070528 · Cited by 96
Basu, S., & Pentland, A. (2002) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 96
You Are Known by How You Vlog: Personality Impressions and Nonverbal Behavior in YouTube
Biel, J.-I., Aran, O., & Gática-Pérez, D. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v5i1.14160 · Cited by 92
Self-citationMohammadi, G., Vinciarelli, A., & Mortillaro, M. (2010) · International Workshop on Social Signal Processing (SSPW) · doi:10.1145/1878116.1878123 · Cited by 89
Crowdsourcing for Affective Annotation of Video: Development of a Viewer-reported Boredom Corpus
Soleymani, M., & Larson, M. (2010) · Archive ouverte UNIGE (University of Geneva) · Cited by 84
Identifying more bloggers Towards large scale personality classification of personal weblogs
Nowson, S., & Oberlander, J. (2007) · Cited by 65
Investigating automatic dominance estimation in groups from visual attention and speaking activity
Hung, H., Jayagopi, D. B., Ba, S., Odobez, J., & Gática-Pérez, D. (2008) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/1452392.1452441 · Cited by 49
Modeling the Personality of Participants During Group Interactions
Lepri, B., Mana, N., Cappelletti, A., Pianesi, F., & Zancanaro, M. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-02247-0_13 · Cited by 46
Evans, D., Gosling, S. D., & Carroll, A. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v2i1.18613 · Cited by 43
Biel, J.-I., & Gática-Pérez, D. (2011) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/2037676.2037690 · Cited by 38
Self-citationEmploying social gaze and speaking activity for automatic determination of the Extraversion trait
Lepri, B., Subramanian, R., Kalimeri, K., Staiano, J., Pianesi, F., & Sebe, N. (2010) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/1891903.1891913 · Cited by 34
Steele, F., Evans, D. C., & Green, R. (2009) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v3i1.13997 · Cited by 31
Self-Presentation of Personality During Online Profile Creation
Counts, S., & Stecher, K. B. (2009) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v3i1.13961 · Cited by 26
Spontaneous Inference of Personality Traits and Effects on Memory for Online Profiles
Stecher, K. B., & Counts, S. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v2i1.18625 · Cited by 24
Extraversion, Introversion, and Visual Interaction
Iizuka, Y. (1992) · Perceptual and Motor Skills · doi:10.2466/pms.1992.74.1.43 · Cited by 24
Biel, J.-I., & Gática-Pérez, D. (2010) · International Conference on Weblogs and Social Media · Cited by 14
Self-citationBiel, J.-I., & Gática-Pérez, D. (2010) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v4i1.14057 · Cited by 10
Self-citation
Flagged first, then by citations
5 of the 60 references couldn’t be matched to a known paper.
Research works printed but not linked: 9
- 2011, Thanks YouTube Community for Two BIG Gifts on Our Sixth Birthday!
- huberman, 2009, Social attention in the age of the web, Working Together or Apart Promoting the Next Generation of Digital Scholarship, 62
- 0, Skyecandy
- 0, Oovoo
- 2011, Shortform Video Platform VYou Reels in $3M
- 0, Videogenie
- 10.1037/0022-3514.81.1.116 · DOI · Paper page
- scherer, 1979, Social markers in speech, 147
- mason, 2010, A guide to conducting behavioral research on Amazon's mechanical turk, Social Science Research Network Working Paper Series
Cited by
Sorted by citations
Scherer, K. R., Schuller, B., & Elkins, A. (2017) · Cambridge University Press eBooks · doi:10.1017/9781316676202 · Cited by 768
“The main difference with respect to “standard” SSP approaches is the adoption of social network inspired features (e.g., number of times a video has been watched, on-line ratings, etc.) typically available in social media (Biel and Gatica-Perez, 2012; Salvagnini et al., 2012).”
A Survey of Personality Computing
Vinciarelli, A., & Mohammadi, G. (2014) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2014.2330816 · Cited by 540
Corneanu, C. A., Simon, M. O., Cohn, J. F., & Guerrero, S. E. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2515606 · Cited by 527
“Visual cues can refer to eye gaze [260], [261], frowning, head orientation, mouth fidgeting [260], primary FEs [252], [253] or characteristics of”
BackgroundComputational personality recognition in social media
Farnadi, G., Sitaraman, G., Sushmita, S., Celli, F., Kosiński, M., Stillwell, D. J., Davalos, S. V., Moens, M., & Cock, M. D. (2016) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-016-9171-0 · Cited by 224
Lab And/Or Field? Measuring Personality Processes and Their Social Consequences
Wrzus, C., & Mehl, M. R. (2015) · European Journal of Personality · doi:10.1002/per.1986 · Cited by 200
“Biel and Gatica-Perez (2013) recently explored crowdsourcing personality perceptions via Amazon’s Mechanical Turk.”
Background
Metadata
- Authors
- Biel, J.-I., & Gatica-Perez, D.
- Affiliations
- École Polytechnique Fédérale de Lausanne (CH)
- Venue
- IEEE Transactions on Multimedia
- Published
- 2013-01
- Volume
- 15
- Issue
- 1
- Pages
- 41-55
- ISSN
- 1520-9210 (ISSN-L)
- 1941-0077
- OpenAlex
- W2028422222
- Cited by
- 209
- References
- 60
- Citations by year
- 2026: 6 · 2025: 10 · 2024: 7 · 2023: 9 · 2022: 16 · 2021: 20 · 2020: 16 · 2019: 20 · 2018: 18 · 2017: 24 · 2016: 23 · 2015: 13 · 2014: 20 · 2013: 6
- FWCI
- 17.14
- Type
- journal article
- Language
- en
- Open access
- green
- infoscience.epfl.ch
- Locations
- IEEE Transactions on Multimedia (publishedVersion)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion, cc-by-nc-nd)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Social Sciences › Business, Management and Accounting › Marketing › Digital Marketing and Social Media
- Keywords
- personality impressions, vlogs, YouTube, crowdsourcing, nonverbal cues, audiovisual analysis, social attention, personality prediction, conversational video, vloggers, social media perception
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review