Cited by 209Emotion and Mood RecognitionMobile Crowdsensing and CrowdsourcingDigital Marketing and Social Media

The YouTube Lens: Crowdsourced Personality Impressions and Audiovisual Analysis of Vlogs

Open access
Biel, Joan-Isaac, Gatica-Perez, Daniel·2013·IEEE Transactions on Multimedia

Abstract

Despite an increasing interest in understanding human perception in social media through the automatic analysis of users' personality, existing attempts have explored user profiles and text blog data only. We approach the study of personality impressions in social media from the novel perspective of crowdsourced impressions, social attention, and audiovisual behavioral analysis on slices of conversational vlogs extracted from YouTube. Conversational vlogs are a unique case study to understand users in social media, as vloggers implicitly or explicitly share information about themselves that words, either written or spoken cannot convey. In addition, research in vlogs may become a fertile ground for the study of video interactions, as conversational video expands to innovative applications. In this work, we first investigate the feasibility of crowdsourcing personality impressions from vlogging as a way to obtain judgements from a variate audience that consumes social media video. Then, we explore how these personality impressions mediate the online video watching experience and relate to measures of attention in YouTube. Finally, we investigate on the use of automatic nonverbal cues as a suitable lens through which impressions are made, and we address the task of automatic prediction of vloggers' personality impressions using nonverbal cues and machine learning techniques. Our study, conducted on a dataset of 442 YouTube vlogs and 2210 annotations collected in Amazon's Mechanical Turk, provides new findings regarding the suitability of collecting personality impressions from crowdsourcing, the types of personality impressions that emerge through vlogging, their association with social attention, and the level of utilization of nonverbal cues in this particular setting. In addition, it constitutes a first attempt to address the task of automatic vlogger personality impression prediction using nonverbal cues, with promising results.

Integrity signals

Registry

Crossref · 10.1109/tmm.2012.2225032

Cites

55 of 55 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Cites

Flagged first, then by citations

5 of the 60 references couldn’t be matched to a known paper.

Cited by

Sorted by citations

Authors
Biel, J.-I., & Gatica-Perez, D.
Affiliations
École Polytechnique Fédérale de Lausanne (CH)
Venue
IEEE Transactions on Multimedia
Published
2013-01
Volume
15
Issue
1
Pages
41-55
ISSN
  • 1520-9210 (ISSN-L)
  • 1941-0077
OpenAlex
W2028422222
Cited by
209
References
60
Citations by year
2026: 6 · 2025: 10 · 2024: 7 · 2023: 9 · 2022: 16 · 2021: 20 · 2020: 16 · 2019: 20 · 2018: 18 · 2017: 24 · 2016: 23 · 2015: 13 · 2014: 20 · 2013: 6 · 2012: 1
FWCI
17.14
Type
journal article
Language
en
Open access
Locations
  • IEEE Transactions on Multimedia (publishedVersion)
  • Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion)
  • Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion, cc-by-nc-nd)
Topics
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Emotion and Mood Recognition
  • Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
  • Social Sciences › Sociology and Political Science › Digital Marketing and Social Media
Keywords
personality impressions, vlogs, YouTube, crowdsourcing, nonverbal cues, audiovisual analysis, social attention, personality prediction, conversational video, vloggers, social media perception

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review